Provar Manager Test Operations
The main goal of Test Operations is to ensure that software is released with high quality by executing effective and efficient tests throughout the development process. This includes functional testing, performance testing, security testing, regression testing, integration testing, and user acceptance testing.
Test Operations also involve maintaining test environments, managing test data, and providing test environment support for development teams and other stakeholders. Test Operations teams collaborate closely with various teams such as Development, Quality Assurance (QA), DevOps, and Project Management to ensure that testing is integrated seamlessly into the software development process and that testing activities are executed consistently, reliably, and efficiently.
Effective Test Operations help organizations minimize the risks of releasing software that doesn’t meet its intended quality standards. By continuously monitoring and improving testing processes, organizations can reduce the number of defects, improve time-to-market, and ultimately deliver high-quality software products that meet customer expectations and requirements.
Provar Manager’s Test Operations module lets teams manage environments, version control systems, and repositories and orchestrate test plan executions.
You can open the Test Operations app from the App drawer in Salesforce:
Test Environment Setup
Environments in Provar Manager are used to identify groups of systems with a common level of production-ready features. For example, depending on their development process, teams may want to define their environments as Production, User Acceptance Testing, QA, System Integration Testing, and Development.
To define a new environment, open the Environments tab and click the New button.
Within an environment record, you can define systems of various types.
Salesforce System Setup
Provar Manager lets you set up connections to Salesforce orgs in case you want to run Apex unit tests and retrieve the results and the code coverage reports.
Follow these steps to set up a connection to Salesforce:
- Open the System record of System Type equal to Salesforce.
- You will find the Salesforce Connection Assistant card on the right-hand side of the page.
- Select the right Org Type and click Request Authorization.
- Follow the instructions on the screen:
- Open the link, enter the user code, and click Connect.
- Log into the Salesforce org and click Allow.
- Then click Continue.
- Once you have authorized Provar Manager to access the Salesforce org, the Salesforce Connection Assistant will automatically refresh to indicate that the connection has been established.
- If you have not set up Provar Manager’s metadata connection (see Setup section of this document), follow the final steps in the assistant to manually add the Remote Site Setting, allowing Provar Manager to communicate with the other Salesforce org.
Org Browser
Salesforce system records let you browse the connected orgs to retrieve their Apex Classes, Apex Triggers, or Flows as Metadata Components (to be used for metadata coverage reporting and smart testing) or import the Apex Unit Tests as Test Cases (for test execution and metadata coverage reporting).
To browse the Salesforce org and import its information, follow these steps:
- Click the Browse Org button on a connected Salesforce system record page.
- Click the corresponding button (e.g., Browse Apex Classes) to load the list of metadata items in the org.
- Select the metadata items you want to import. You can see if they have been imported in the Imported column.
- Click Import as Metadata Components or Import as Test Cases to import the metadata items.
Code Quality Scans
Provar Manager provides two ways of tracking code quality scans:
Use a plugin to connect to 3rd-party code quality scanning tools like Clayton or QualityClouds and import their results on a scheduled basis.
Manually importing code quality results.
To manually import the results of a static code analysis performed with tools like PMD or Salesforce Code Analyzer, follow these steps:
- Go to a Salesforce system record.
- In its Code Quality section, click the New button on the Code Scans related list.
- Enter a scan date and time.
- Set the status as Draft.
- Click the Save button.
- Open the newly created Code Scan record.
- In its Files section, upload the code scan results. The file must be in SARIF format with the .sarif extension (e.g., myscan.sarif).
- Change the Code Scan status to Ready and save the changes.
- Provar Manager will start processing the file immediately, changing the status to In Progress and then to Completed or Failed once the file has been processed.
- Refresh the page after a few seconds to see the results.
Code Coverage Reports
Code coverage can be used to understand how much of the code is being tested, but it doesn’t measure how thorough or adequate those tests are.
Still, it can help your team progress toward a more thorough test suite, highlighting trouble spots requiring more attention (e.g., new code introduced but not covered or coverage % dropping after a deployment).
Provar Manager can monitor Salesforce Apex code coverage across multiple orgs. Follow the below instructions to set it up.
- Go to a System record and type Salesforce or create a new one.
- Ensure Provar Manager is connected to the Salesforce org (see Test Environment Setup > Salesforce System Setup).
- Click on the Coverage tab.
To schedule coverage reports to run regularly, create a Coverage Report Schedule record from the System record page (see above instructions).
Once the Coverage Report Schedule Status is set to Active, Provar Manager will regularly create a Coverage Report record under the selected System per the schedule settings.
API System Setup
With Provar Manager, you can define a System record of type API to represent an external API you may want to call at some point.
When setting up this type of System, it’s essential to specify the following:
- API Endpoint
- Authentication Type
- No Authentication
- Basic Authentication, which requires the fields Username and Password to be filled.
Set the Password to NULL if you want it to be empty. - Named Credential (recommended) requires the field Named Credential to be filled with the name of a Salesforce Named Credential.
Named Credentials allow you to authenticate using Username/Password, OAuth 2.0, JWT, JWT Token Exchange, and AWS Signature Version 4.
Salesforce documentation on how to define a Named Credential.
- API Paths
Note: remember to add the API Endpoint URL to the Salesforce Remote Site Settings if you’re not using the Named Credential authentication type.
As an example, if you wanted to define an API System that represents the OpenWeatherMap API, you would follow these steps:
- Create a system record of type API
- Set the API Endpoint to https://api.openweathermap.org/data/2.5
- Set the Version to 2.5
- Set the Authentication Type to No Authentication.
- Create an API Path record for the Current Weather Data API:
- Set the Path to “/weather”
- Set the Summary to “Current weather data”
- Set the HTTP Method to “GET”
- Set the Content-Type to “application/json”
For more information, check out this course on University of Provar.
- Provar Automation
- System Requirements
- Browser and Driver Recommendations
- Installing Provar Automation
- Updating Provar Automation
- Licensing Provar
- Granting Org Permissions to Provar Automation
- Optimizing Org and Connection Metadata Processing in Provar
- Using Provar Automation
- Provar Automation
- Creating a New Test Project
- Import Test Project from a File
- Import Test Project from a Remote Repository
- Import Test Project from Local Repository
- Commit a Local Test Project to Source Control
- API Testing
- Behavior-Driven Development
- Consolidating Multiple Test Execution Reports
- Creating Test Cases
- Custom Table Mapping
- Functions
- Debugging Tests
- Defining a Namespace Prefix on a Connection
- Defining Proxy Settings
- Environment Management
- Exporting Test Cases into a PDF
- Exporting Test Projects
- Japanese Language Support
- Override Auto-Retry for Test Step
- Mapping and Executing the Lightning Article Editor in Provar
- Managing Test Steps
- Namespace Org Testing
- NitroX
- Provar Test Builder
- ProvarDX
- Refresh and Recompile
- Reintroduction of CLI License Check
- Reload Org Cache
- Reporting
- Running Tests
- Searching Provar with Find Usages
- Secrets Management and Encryption
- Setup and Teardown Test Cases
- Tags and Service Level Agreements (SLAs)
- Test Cycles
- Test Data Generation
- Test Plans
- Testing Browser Options
- Tooltip Testing
- Using the Test Palette
- Using Custom APIs
- Callable Tests
- Data-Driven Testing
- Page Objects
- Block Locator Strategies
- Introduction to XPaths
- Creating an XPath
- JavaScript Locator Support
- Label Locator Strategies
- Maintaining Page Objects
- Mapping Non-Salesforce fields
- Page Object Operations
- ProvarX™
- Refresh and Reselect Field Locators in Test Builder
- Using Java Method Annotations for Custom Objects
- Applications Testing
- Provar Manager
- How to Use Provar Manager
- Provar Manager Setup
- Provar Manager Integrations
- Release Management
- Test Management
- Test Operations
- Provar Manager and Provar Automation
- Setting Up a Connection to Provar Manager
- Object Mapping Between Automation and Manager
- How to Upload Test Plans, Test Plan Folders, Test Plan Instances, and Test Cases
- Provar Manager Filters
- Uploading Callable Test Cases in Provar Manager
- Uploading Test Steps in Provar Manager
- How to Know if a File in Automation is Linked in Test Manager
- Test Execution Reporting
- Metadata Coverage with Manager
- Provar Grid
- DevOps
- Introduction to Provar DevOps
- Introduction to Test Scheduling
- Apache Ant
- Configuration for Sending Emails via the Automation Command Line Interface
- Continuous Integration
- AutoRABIT Salesforce DevOps in Provar Test
- Azure DevOps
- Running a Provar CI Task in Azure DevOps Pipelines
- Configuring the Automation secrets password in Microsoft Azure Pipelines
- Parallel Execution in Microsoft Azure Pipelines using Multiple build.xml Files
- Parallel Execution in Microsoft Azure Pipelines using Targets
- Parallel execution in Microsoft Azure Pipelines using Test Plans
- Bitbucket Pipelines
- CircleCI
- Copado
- Docker
- Flosum
- Gearset
- GitHub Actions
- Integrating GitHub Actions CI to Run Automation CI Task
- Remote Trigger in GitHub Actions
- Parameterization using Environment Variables in GitHub Actions
- Parallel Execution in GitHub Actions using Multiple build.xml Files
- Parallel Execution in GitHub Actions using Targets
- Parallel Execution in GitHub Actions using Test Plan
- Parallel Execution in GitHub Actions using Job Matrix
- GitLab Continuous Integration
- Travis CI
- Jenkins
- Execution Environment Security Configuration
- Provar Jenkins Plugin
- Parallel Execution
- Running Provar on Linux
- Reporting
- Salesforce DX
- Git
- Version Control
- Salesforce Testing
- Recommended Practices
- Salesforce Connection Best Practices
- Improve Your Metadata Performance
- Java 21 Upgrade
- Testing Best Practices
- Automation Planning
- Supported Testing Phases
- Provar Naming Standards
- Test Case Design
- Create records via API
- Avoid using static values
- Abort Unused Test Sessions/Runs
- Avoid Metadata performance issues
- Increase auto-retry waits for steps using a global variable
- Create different page objects for different pages
- The Best Ways to Change Callable Test Case Locations
- Working with the .testProject file and .secrets file
- Best practices for the .provarCaches folder
- Best practices for .pageObject files
- Troubleshooting
- How to Use Keytool Command for Importing Certificates
- Installing Provar After Upgrading to macOS Catalina
- Browsers
- Configurations and Permissions
- Connections
- DevOps
- Error Messages
- Provar Manager 3.0 Install Error Resolution
- Provar Manager Test Case Upload Resolution
- Administrator has Blocked Access to Client
- JavascriptException: Javascript Error
- macOS Big Sur Upgrade
- Resolving Failed to Create ChromeDriver Error
- Resolving Jenkins License Missing Error
- Resolving Metadata Timeout Errors
- Test Execution Fails – Firefox Not Installed
- Selenium 4 Upgrade
- Licensing, Installation and Firewalls
- Memory
- Test Builder and Test Cases
- Release Notes