- collaboration
Invite Team Members
Assign Projects
Users & Role Management
Review Management [Test Cases]
Review Management [Elements]
Execution Controls
Manage Test Cases
Test Case List Actions
Import and Export Test Cases
Import Test Project Test Cases
Importing Postman Collections and Environments
Update Test Case result in a Test Plan
Test Cases (Mobile Web App)
- Test Step Types
Type: Natural Language
Type: REST API
Type: Step Group
Type: For Loop
Type: While Loop
Type: Block
Type: If Condition
Nested Step Groups
Image Injection
Cross-application testing
- Test Data Types
Raw
Parameter
Runtime
Random
Data Generator
Phone Number
Mail Box
Environment
Concat Test Data
Create Test Data [Parameter]
Update Test Data Profile
Updating Value in TDP
Import TDP
Bulk Deletion of a Test Data Profile
Create Test Data [Environment]
- Elements (Objects)
- Web Applications
Record Single Element
Record Multiple Elements
Create Elements
Supported Locator Types
Formulating Elements
Shadow DOM Elements
Verifying elements in Chrome DevTools
Handling iframe Elements?
Dynamic Locators using Parameter
Dynamic Locators using Runtime
Using Environment Test Data for Dynamic Locators
Locating Dynamic Elements in Date Widget
Freeze & Inspect Dynamic Elements (WebPage)
Locating Dynamic Elements in Tables
Import/Export Elements
AI Enabled Auto-Healing
Locator Precedence (Web Apps)
Verify Elements from Test Recorder
- test step recorder
Install Chrome Extension
Install Firefox Extension
Install Edge Extension
Exclude Attributes/Classes
- test plans
Add, Edit, Delete Test Machines
Add, Edit, Delete Test Suites
Schedule Test Plans
Run Test Suites In Parallel
Cross Browser Testing
Distributed Testing
Headless Testing
Test Lab Types
Disabling Test Cases in Test Plans
AfterTest Case
Post Plan Hook
AfterTest Suite
Email Configuration in Test Plan
Execute Partial Test Plans via API
Ad-hoc Run
Test Plan Executions
Dry Runs on Local Devices
Run Tests on Private Grid
Run Tests on Vendor Platforms
Run Test Plans on Local Devices
Test Locally Hosted Applications
Debug Test Case Failures
Parallel and Allowed queues
- debugging
Debug results on local devices (Web applications)
Debug Results on Local Devices
Launch Debugger in the Same Window
- Testsigma Agent
Pre-requisites
Setup: Windows, Mac, Linux
Setup: Android Local Devices
Setting up iOS Local Devices
Update Agent Manually
Update Drivers Manually
Delete Corrupted Agent
Delete Agents: Soft & Permanent
Triggering Tests on Local Devices
- troubleshooting
Agent - Startup and Registration Errors
Agent Logs
Upgrade Testsigma Agent Automatically
Specify Max Sessions for Agents
Testsigma Agent - FAQs
- continuous integration
Test Plan Details
REST API (Generic)
Jenkins
Azure DevOps
AWS DevOps
AWS Lambda
Circle CI
Bamboo CI
Travis CI
CodeShip CI
Shell Script(Generic)
Bitrise CI
GitHub CICD
Bitbucket CICD
GitLab CI/CD
- desired capabilities
Most Common Desired Capabilities
Browser Console Debug Logs
Geolocation Emulation
Bypass Unsafe Download Prompt
Geolocation for Chrome & Firefox
Custom User Profile in Chrome
Emulate Mobile Devices (Chrome)
Add Chrome Extension
Network Throttling
Network Logs
Biometric Authentication
Enable App Resigning in iOS
Enable Capturing Screenshots (Android & iOS)
Configure Android WebViews
Incognito/Private mode
Set Google Play Store Credentials
- addons
What is an Addon?
Addons Community Marketplace
Install Community Addon
Prerequisites(Create/Update Addon)
Create an Addon
Update Addon
Addon Types
Create a Post Plan Hook add-on in Testsigma
Create OCR Text Extraction Addon
- configuration
API Keys
- Security(SSO)
Setting Up Google Single Sign-On(SSO) Login in Testsigma
Setting Up Okta Single Sign-On Integration with SAML Login in Testsigma
Setting up SAML-based SSO login for Testsigma in Azure
iOS Settings
Creating WDA File for iOS App Testing
- uploads
Upload Files
Upload Android and iOS Apps
How to generate mobile builds for Android/iOS applications?
- Testsigma REST APIs
Environments
Elements
Test Plans
Upload Files
Get Project Wide Information
Upload & Update Test Data Profile
Fetch Test Results (All Levels)
Trigger Multiple Test Plans
Trigger Test Plans Remotely & Wait Until Completion
Run the Same Test Plan Multiple Times in Parallel
Schedule, Update & Delete a Test Plan Using API
Update Test Case Results Using API
Create and update values of Test Data Profile using REST API
Rerun Test Cases from Run Results using API
- open source dev environment setup
macOS and IntelliJ Community Edition
macOS and IntelliJ Ultimate Edition
Windows and IntelliJ Ultimate Edition
Setup Dev Environment [Addons]
- NLPs
Retrieve Value in Text Element
Capture Dropdown Elements
Unable to Select Radiobutton
Unable to Click Checkbox
Clearing the Session or Cookies
UI Identifier NLP
Drag & Drop NLP
Uploading Files NLP
- setup
Server Docker Deployment Errors
Secured Business Application Support
Troubleshooting Restricted Access to Testsigma
Why mobile device not displayed in Testsigma Mobile Test Recorder?
Unable to Create New Test Session
Agent Startup Failure Due to Used Ports
Tests Permanently Queued in Local Executions
Fix Testsigma Agent Registration Failures
Testsigma Agent Cleanup
Need of Apache Tomcat for Testsigma Agent
- web apps
URL not accessible
Test Queued for a Long Time
Issues with UI Identifiers
Missing Elements in Recorder
Collecting HAR File
Errors with Browser Session
Page Loading Issues
- mobile apps
Failed to Start Mobile Test Recorder
Troubleshooting “Failed to perform action Mobile Test Recorder” error
Test Execution State is Queued for a Long Time
Mobile app keeps stopping after successful launch
More pre-requisite settings
Unable to start WDA Process on iPhone
Most Common causes for Click/Tap NLP failure
Finding App Package & App Activity (Android)
Cross-environment Compatible ID Locators (Android)
Why Accessibility IDs Over other Locators?
Common Android Issues & Proposed Solutions
Finding the App Bundle ID for iOS
- on premise setup
On-Premise Setup Prerequisites
On-Premise Setup with Docker-compose File
Post-Installation Checklist for On-Premise Setup
Install Docker on an Unix OS in Azure Infrastructure
SMTP Configuration in Testsigma
Configure Custom Domains
- salesforce testing
Intro: Testsigma for Salesforce Testing
Creating a Connected App
Creating a Salesforce Project
Creating Metadata Connections
Adding User Connections
Build Test Cases: Manual+Live
Salesforce Element Repositories
Intro: Testsigma Special NLPs
Error Handling On Metadata Refresh
Automating Listview Table NLPs
- windows automation
Intro: Windows Desktop Automation
Windows (Adv) Project & Application
Object Learning (Using UFT One)
Converting TSR Files to TSRx
Importing/Updating TSRx Files
Test Cases for Windows Automation
Error Handling Post TSRx File Update
Test Plans
In Testsigma, the Test Plan helps plan and organise software testing. The Test Plan efficiently executes the tests, manages test data, and reports results. It includes details such as the scope of testing, objectives, features to be tested, testing resources, testing environment, test cases, schedules, and risk assessment. The Test Plan makes sure testing is organised and helps find problems early. It also helps the team work together.
Prerequisites
Before using a Test Plan, you must understand specific concepts, such as creating Projects, Test Cases and Test Suites.
Listing Test Plans
- Navigate to Test Plans in the left-side navbar.
- You can easily manage test suites on the Test Plans List page by sorting, filtering, or searching. The page displays test plans with titles, types, actions, test labs and test machines.
- Click the Schedules tab on the Test Plan List page to view test plan schedules.
- Click on the Refresh button on the top right corner of the Test Plan list page to reload the list of test plans being displayed.
- Click Create Test Plan in the top right corner of the Test Plan list page.
Creating a Test Plan
- Navigate to Test Plans in the left-side navbar. Click the Create Test Plan button in the top right corner of the Test Plans List page.
-
In the Basic Details tab, provide the following details and then click Continue:
- Name (Required): Enter the Test Plan's title in the Name field on the Basic Details page.
- Description: Enable the toggle for Description and briefly explain the Test Plan's purpose and scope. This helps your team understand what the Test Plan aims to do.
- Labels: You can label the Test Plan. Labels make it easier to manage multiple Test Plans, as they help with sorting and grouping.
- Test Plan Type: Select either the test plan type: Cross Browser Testing (Use single/ multiple browsers to test all the test suites; for more information, refer to Cross Browser Testing) or Custom Test Plan (Manually add test machine profiles to individual test suites).
-
In the Add Test Suites & Link Machine Profiles tab, provide the following details and then click Continue:
- Click Add Test Suites to include test suites in the test plan (for more information, refer to Manage Test Suites in Test Plan).
- Next, click the Test Machine icon to add machine profiles to the test plan. An overlay will appear, and you can select a pre-defined machine or create a new test machine. Once you have selected, click Save Selection (for more information, refer to Manage Test Machines in Test Plan).
-
In the Test Plan Settings tab, provide the following details, and click Create:
- Send Notification: Enable the toggle for Send Notification and specify when to receive the notifications (for example, select to receive notifications when your test plans are Passed, Failed, Not Executed, Queued, Stopped, or Running. You can enter the emails or check the box to Add my email for receiving notifications through email. Messages can also be sent to collaboration tools like Google Chat, Slack, or MS Teams.
-
Additional Settings: Provide the following details under additional settings:
- Environment: Select the test environment.
- Screenshot Capture: Select when the screenshots need to be taken, for None, All Steps or Failed Steps alone.
- Page Timeout: Duration for which the test should wait for the page to load.
- Element Timeout: Duration for which the test should wait for the element to load.
- Recovery Actions: Click Recovery Actions to open the recovery actions section and define what actions should happen.
- Post Plan Hook: Select the Post Plan Hook and define actions or tasks to be performed once the test plan is executed and conditions are met (for more information, refer to Post Plan Hook).
Editing a Test Plan
- Navigate to Test Plans in the left-side navbar. Locate the Test Plan you want to edit in the list.
- Click the Edit icon at the top right on the Test Plan details page, and the Edit Test Plan page will appear. You should follow the steps in the Creating a Test Plan section to update the test plan.
-
Alternatively, you can edit the test plan on the Test Plan details page:
- Test Plan Info: Click Test Plan Info in the right-side navbar. You can change the Test Plan Name and Description here and view details about when it was created and last updated.
-
Test Plan Settings: Click Test Plan Settings in the right-side navbar to update the Test Plan Type, Send Notification, Additional Settings, Recovery Actions, and Post Plan Hook.
NOTE:You cannot switch the test plan type once you have set up Test Machines.
- Activity: Click Activity in the right-side navbar to view the History and Comments related to the test plan.
-
In the Test Machine & Suites tab, you can view Machine Name, Configuration, No of Suites, Parallel Settings and Session Settings on the Test Suites details page.
- Click the ellipsis icon and select Edit or Delete to manage the Test Machine.
- Toggle the Test Machine switch in the test plan to turn the test machine on or off.
- Click the Search icon to search for a test machine in the test plan, and then click Add Machine to add a new Test Machine to the plan (for more information, refer to the Manage Test Machines).
- In the CI/CD Integrations tab, view Default Integrations tools and Rest API to integrate with other tools (for more information, refer to the Integrations).
- In the Schedules tab, view Test Plan Schedules, and you can edit and delete the schedules (for more information, refer to the Schedule Test Plans).
Deleting a Test Plan
- Navigate to Test Plans in the left-side navbar. Locate the Test Plan you want to delete from the list.
- Click the Delete button in the top right corner of the Test Plan details page.
- A Delete Confirmation pop-up will appear. To delete the Test Plan, you need to confirm the deletion by entering DELETE and then clicking on I understand, delete this Test Plan.
If you delete the Test Plan, you will lose all Schedules, Run reports and configurations associated with it.