Test Plan Scheduling
Test Plan Schedules are used to orchestrate the execution of test plans and can be created from a test plan record under its Execution section or from the Test Plan Schedules tab.
You can select one of the three supported testing tools:
- Salesforce (Apex) is used to execute Salesforce Apex unit tests.
- Provar Grid is used to execute Provar automated test cases in the cloud.
- Generic API is used to call out external APIs to trigger jobs.
You can also select a Missing Test Case Strategy to decide what should happen when Provar Manager retrieves results for test cases that are not present in Provar Manager.
After creating a Test Plan Schedule record, make sure to:
- Configure its settings by clicking on the Configure Settings button.
- (Optional) Select the tests to run, if you have configured it to run test cases or test suites added to the schedule, by clicking the Select Tests button.
- Set the status as Active.
Provar Manager has an hourly job that picks up all the active test plan schedules that should have run in the previous hour and runs them.
You can also click the Run button to run them immediately.
Schedule Job Alerts
Provar Manager can automatically send notifications when a job has succeeded or failed.
Under the Alerts section on a Test Plan Schedule, you can configure the channels and criteria to send alerts by checking the Enable Alerts checkbox.
Email Alerts
Select On Success and/or On Failure on the Email Alerts field, and add Alert Recipients in the related list so they can receive alerts.
Please verify the user’s email address in Salesforce, per this help article.
Slack Alerts
Select On Success and/or On Failure on the Slack Alerts field, and select a Slack Webhook to receive the alerts.
You can learn more about creating webhooks in Slack in this help article.
The Webhook URL required on the Slack Webhook record should look something like this: https://hooks.slack.com/services/T00000000/B00000000/XXXXXXXXXXXXXXXXXXXXXXXX
These are the variables you can use in your webhook:
- jobId
- jobUrl
- jobName
- jobStatus
- jobStartDate
- jobEndDate
- jobComments
- jobTotalExecuted
- jobTotalSkipped
- jobTotalPassed
- jobTotalFailed
- jobPassRate
- scheduleId
- scheduleUrl
- scheduleName
- scheduleDescription
- scheduleTestingTool
- scheduleTestPlanName
- scheduleSystemName
- scheduleEnvironmentName
Your message could look something like this:
JOB INFORMATION [{jobName}]
{jobUrl}
STATUS: {jobStatus
START-END DATE: {jobStartDate} - {jobEndDate}
COMMENTS: {jobComments}
PASS RATE: {jobPassRate}
SCHEDULE INFORMATION: {scheduleName}
{scheduleUrl}
DESCRIPTION: {scheduleDescription}
TEST PLAN: {scheduleTestPlanName}
ENVIRONMENT: {scheduleEnvironmentName}
SYSTEM: {scheduleSystemName}
TESTING TOOL: {scheduleTestingTool}
Salesforce Apex Unit Test Execution Scheduling
Create a Test Plan Schedule and select the testing tool to be Salesforce (Apex) if you want to leverage Provar Manager’s connections to your Salesforce orgs to run some Apex unit tests.
When configuring its settings, you will see the following form:
- Tests to Run
- Test cases/suites added to the Test Plan Schedule. Using the Select Tests button, this option will use the test cases you manually select on the schedule using the Select Tests button.
- Test suites were added to the Test Plan.
- All tests are in the org (except managed packages). This option is recommended if you haven’t imported any Apex unit tests into Provar Manager.
- All tests are in the org (including managed packages). This may run many irrelevant unit tests belonging to installed managed packages.
- Skip Code Coverage Calculation. You won’t be able to retrieve the latest code coverage reports if selected, but your tests may run faster.
Provar Grid Execution Scheduling
To learn more about how to configure Provar Grid schedules, please refer to its documentation.
Generic API Callout Scheduling
Create a Test Plan Schedule and select the testing tool to be Generic API if you want Provar Manager to make a callout to an API.
When configuring its settings, you will see the following form:
- Choose a System of type API.
- Choose a related API Path.
- (Optional) Send a file as a payload. You can upload a JSON or XML file containing the HTTP body that should be sent to the API.
- (Optional) URL Parameters. These will be appended to the URL like “?{key1}={param1}&{key2}={param2}”.
For more information, check out this course on University of Provar.
- Provar Automation
- System Requirements
- Browser and Driver Recommendations
- Installing Provar Automation
- Updating Provar Automation
- Licensing Provar
- Granting Org Permissions to Provar Automation
- Optimizing Org and Connection Metadata Processing in Provar
- Using Provar Automation
- Understanding Provar’s Use of AI Service for Test Automation
- Provar Automation
- Creating a New Test Project
- Import Test Project from a File
- Import Test Project from a Remote Repository
- Import Test Project from Local Repository
- Commit a Local Test Project to Source Control
- API Testing
- Behavior-Driven Development
- Consolidating Multiple Test Execution Reports
- Creating Test Cases
- Custom Table Mapping
- Functions
- Debugging Tests
- Defining a Namespace Prefix on a Connection
- Defining Proxy Settings
- Environment Management
- Exporting Test Cases into a PDF
- Exporting Test Projects
- Japanese Language Support
- Override Auto-Retry for Test Step
- Customize Browser Driver Location
- Mapping and Executing the Lightning Article Editor in Provar
- Managing Test Steps
- Namespace Org Testing
- NitroX
- Provar Test Builder
- ProvarDX
- Refresh and Recompile
- Reintroduction of CLI License Check
- Reload Org Cache
- Reporting
- Running Tests
- Searching Provar with Find Usages
- Secrets Management and Encryption
- Setup and Teardown Test Cases
- Tags and Service Level Agreements (SLAs)
- Test Cycles
- Test Data Generation
- Test Plans
- Testing Browser – Chrome Headless
- Testing Browser Options
- Tooltip Testing
- Using the Test Palette
- Using Custom APIs
- Callable Tests
- Data-Driven Testing
- Page Objects
- Block Locator Strategies
- Introduction to XPaths
- Creating an XPath
- JavaScript Locator Support
- Label Locator Strategies
- Maintaining Page Objects
- Mapping Non-Salesforce fields
- Page Object Operations
- ProvarX™
- Refresh and Reselect Field Locators in Test Builder
- Using Java Method Annotations for Custom Objects
- Applications Testing
- Provar Manager
- How to Use Provar Manager
- Provar Manager Setup
- Provar Manager Integrations
- Release Management
- Test Management
- Test Operations
- Provar Manager and Provar Automation
- Setting Up a Connection to Provar Manager
- Object Mapping Between Automation and Manager
- How to Upload Test Plans, Test Plan Folders, Test Plan Instances, and Test Cases
- Provar Manager Filters
- Uploading Callable Test Cases in Provar Manager
- Uploading Test Steps in Provar Manager
- How to Know if a File in Automation is Linked in Test Manager
- Test Execution Reporting
- Metadata Coverage with Manager
- Provar Grid
- DevOps
- Introduction to Provar DevOps
- Introduction to Test Scheduling
- Apache Ant
- Configuration for Sending Emails via the Automation Command Line Interface
- Continuous Integration
- AutoRABIT Salesforce DevOps in Provar Test
- Azure DevOps
- Running a Provar CI Task in Azure DevOps Pipelines
- Configuring the Automation secrets password in Microsoft Azure Pipelines
- Parallel Execution in Microsoft Azure Pipelines using Multiple build.xml Files
- Parallel Execution in Microsoft Azure Pipelines using Targets
- Parallel execution in Microsoft Azure Pipelines using Test Plans
- Bitbucket Pipelines
- CircleCI
- Copado
- Docker
- Flosum
- Gearset
- GitHub Actions
- Integrating GitHub Actions CI to Run Automation CI Task
- Remote Trigger in GitHub Actions
- Parameterization using Environment Variables in GitHub Actions
- Parallel Execution in GitHub Actions using Multiple build.xml Files
- Parallel Execution in GitHub Actions using Targets
- Parallel Execution in GitHub Actions using Test Plan
- Parallel Execution in GitHub Actions using Job Matrix
- GitLab Continuous Integration
- Travis CI
- Jenkins
- Execution Environment Security Configuration
- Provar Jenkins Plugin
- Parallel Execution
- Running Provar on Linux
- Reporting
- Salesforce DX
- Git
- Version Control
- Salesforce Testing
- Recommended Practices
- Salesforce Connection Best Practices
- Improve Your Metadata Performance
- Java 21 Upgrade
- Testing Best Practices
- Automation Planning
- Supported Testing Phases
- Provar Naming Standards
- Test Case Design
- Create records via API
- Avoid using static values
- Abort Unused Test Sessions/Runs
- Avoid Metadata performance issues
- Increase auto-retry waits for steps using a global variable
- Create different page objects for different pages
- The Best Ways to Change Callable Test Case Locations
- Working with the .testProject file and .secrets file
- Best practices for the .provarCaches folder
- Best practices for .pageObject files
- Troubleshooting
- How to Use Keytool Command for Importing Certificates
- Installing Provar After Upgrading to macOS Catalina
- Browsers
- Configurations and Permissions
- Connections
- DevOps
- Error Messages
- Provar Manager 3.0 Install Error Resolution
- Provar Manager Test Case Upload Resolution
- Administrator has Blocked Access to Client
- JavascriptException: Javascript Error
- macOS Big Sur Upgrade
- Resolving Failed to Create ChromeDriver Error
- Resolving Jenkins License Missing Error
- Resolving Metadata Timeout Errors
- Test Execution Fails – Firefox Not Installed
- Selenium 4 Upgrade
- Licensing, Installation and Firewalls
- Memory
- Test Builder and Test Cases
- Release Notes
- Provar AI Assistant Popup Test