Spring ‘24 Release 2 (v2.12.1.2)
Executive Summary
We’re excited to announce the latest updates to the Provar product suite with our Spring ‘24 Release 2. This newest release is now available for installation via the Provar Success Portal. This release includes compatibility with the Salesforce Spring ‘24 release to keep your tests working as expected.
Notice: Selenium 4 Upgrade
In the latest Provar Spring ‘24 Release 2, the Selenium and related dependencies have been upgraded to version 4.16.1. It provides enhanced test automation features, more reliable testing capabilities, and better-quality test scripts.
This upgrade may impact users using existing PageObjects, Page Operations, Custom APIs, or SSO Java files. If so, users could need to make minor adjustments to classes and functions after installing the latest Provar release. For more guidance and instructions on how to make these changes, please visit our help page.
Provar Automation Features
Highlight Panel Component Support
We’ve introduced support for independent mapping and testing capabilities for the highlight panel. The intention is to maintain the current scripts’ functionality, the test cases’ cleanliness, and the modifications’ compatibility with Salesforce’s Dynamic Actions feature. This enables users to create tests targeting the highlight panel with complete support for various field types and buttons and compatibility with standard and flexible pages. Find more information here.
Dynamic File Selection for API-Based Records
To improve the Template Editor component and enable changeable file paths, Provar now offers flexibility in file selection during API tests. This allows users to choose different files dynamically using local and global variables. When applicable, Content Assist also works in the template editor.
Renamed Connections Reflected in Logs Using GUIDs
If a connection with a GUID is renamed, the execution works fine, but the logs are now reflected with a new name. The logs shown in the execution window are consistent with the GUID mechanism. If the connection has been renamed but the test case has not been updated, the logs will show the new connection name with an info message.
Dynamic Action Support
Provar allows users to map and perform Dynamic Actions, increasing the flexibility and efficiency of test case generation. Legacy scripts for action buttons (in the highlight panel) work properly when the action is changed to Dynamic Actions, so users do not have to recreate the scripts. Find more information here.
NitroX Editor/UI Changes
The NitroX UI has been modified to add an editor with capabilities related to page mapping/structure in Provar Automation. Users can launch the new editor in a new tab by double-clicking on the custom JSON (.po. JSON) files. The page structure is displayed in a tree-like fashion. Standard components, added to NitroX’s tree structure through the Test Builder, are shown alongside custom components, added by the ‘+’ symbol on a node.
Provar Automation Enhancements
Instrumentation License Type and Usage
To improve the deployment of instrumentation for collecting detailed data on license usage. The emphasis is on capturing license types, keys, timestamps, client information, usage times, and concurrency levels during ANT version job executions and Provar Automation logins. The purpose is to proactively identify and warn consumers about incorrect license usage as a preventative measure to ensure proper licensing. When a user logs in to Provar Automation, the license type, license key, time, date, and customer are recorded. Instrumentation will return data about which license type was used for execution and which license type is used for Provar Automation or Provar Grid.
New Context Menu
We have upgraded the context menu according to the functionality and grouped various menu items.
Callable Test Step in Test Builder
Provar users can easily add a Callable Test Case to another Test Case as a Test Step after selecting a test case from a list of possible callable test cases. This update aims to make the Test Palette more efficient, removing the switch to Provar Studio requirement.
Collapsible Option Section
In Test Builder, the Options section in the Test step editor is now collapsible by default. The users can choose to expand the section and collapse it.
Renamed Connection Log as a Warning
When there is an outdated connection name in use by a running test, Provar will highlight this in the test log as an orange warning message.
Metadata Process Improvement
The Org and Connection metadata processing has been analyzed and improved to shorten processing times and enhance Provar Automation performance. We have effectively boosted Quick Actions, Tabs Navigation, and Apps Navigation performance. These enhancements positively influence your test projects, which include up to 25% improvement in downloading metadata and loading the Org browser.
In addition, we effectively addressed Provar Automation’s longer startup time. With the most recent release, it now loads up to 60% faster than before.
Undo and Redo Functionality
Provar has added Undo and Redo capabilities, as well as shortcuts, to the Java code editor. However, a known bug in the Page Object Editor causes Undo and Redo not to work as intended. A workaround was offered for the Page Object Editor.
GUID Status Detection
A project’s GUID status is now identifiable and reported via Provar (Yes/No). The reporting system allows cross-referencing data points to determine which customers have enabled GUIDs in their projects. Reporting is triggered for all project launch mechanisms, including ANT, ProvarDX, Jenkins, and Grid.
Provar Manager Features & Enhancements
With Provar Manager version 3.1.1, the following features and enhancements are now available:
- Improved Quality Center performance.
- Improved Apex Unit Test Coverage reporting.
- Updated OpenAI models used for test case generation and RCA reporting.
New UI and Improved Apps
We have improved the UI, apps, and permission sets for Release Management, Test Management, and Test Operations.
New UI Tools to Manage Test Suites
Users can now mass-select the test suites and test cases for any test plan schedule records, removing the hassle of adding them individually. The test suites and test cases can also be searched manually.
New Provar Manager API
With Provar Manager, you can get the status of any REST API requests and retrieve test results. You can also utilize the API to execute test jobs from external systems.
Email and Slack Alerts
We have implemented an email and Slack notification system for Test Plan schedule jobs. Users can enable email notifications and enter recipient email addresses for each schedule. When a Test Plan schedule job is completed or failed, and the email notification option is enabled, an email is sent to the provided addresses to confirm the job’s status. Similarly, users can also opt to receive Slack alerts for the same, using a toggle to enable Slack Notifications.
Provar Grid Features & Enhancements
Support for Bitbucket Enterprise Server & Cloud
Customers with their own Enterprise Server or Cloud instances of Bitbucket will have their own BitBucket URL. Provar Manager now supports importing branches from these instances.
Support for Multi-environment Test Schedule Executions
By default, each branch test selected for execution in a Test Plan Schedule is assigned to a specific environment. If you would like to execute your tests against multiple or different environments, users now have the option to Override the Environment.
Users can then take their pick from the environments to run their tests against.
Selecting multiple environments will mean creating a ‘Test Plan Schedule Job’ for each environment.
This new feature allows users to configure tests against different environments, platforms, browsers, and browser versions from a single schedule.
Email and Slack Notifications for Test Plan Schedule jobs
A new ‘Alert’ feature has been added to Provar Manager for Test Plan Schedules. This also applies to Provar Grid jobs. Email notifications can be configured to be sent to a list of your chosen users on success or failure.
Alternatively, you can configure your alerts to trigger a Slack webhook, sending the job details to the chosen Slack channel.
Note: Once a user has upgraded their project to 2.12.2 or above, they cannot run tests on an older version of Provar, whether in Grid or locally, because the tests are no longer backwards compatible due to Selenium changes. To resolve this, users must remove all selenium plugins from the manifest file, beginning with org.seleniumhq. Grid users must ensure that any tests they create and run on Grid schedules must use version 2.12.1.1 or lower (not 2.12.2).
Platform Updates
Browser Compatibility Updates
As part of our pre-release testing, we have confirmed that Automation v2.12.2 is compatible with Chrome version 123.
Why is this important?
Ensuring that Automation v2.12.2 includes ChromeDriver 123 and is compatible with Chrome 123 eliminates the risk of incompatibility issues, which could prevent test cases from working as expected.
How can I use this?
If you want to start using Chrome 123, we recommend upgrading to Provar Automation v2.12.2, which will use ChromeDriver 123 out of the box.
Automation will automatically attempt to download the correct ChromeDriver if it detects a driver exception. If your organization’s security protocols block the automatic download, you can manually override the ChromeDriver.
To downgrade or revert the ChromeDriver, refer to this support article that explains how to use a ChromeDriver that differs from the one provided by default in your Provar Automation installation.
Browser and Driver Combinations Recommended for Provar Automation v2.12.2
Please refer to the Browser and Driver Recommendations support article for a comprehensive guide.
Salesforce Jars Upgrade
We updated the revised jars following the Salesforce Spring ’24 Release (version 69.0) to use them in future releases. To accomplish this, we updated the necessary jars, added the new objects to the translation files, and removed the old unused Salesforce jars.
End of Life for TEE (Team Explorer Everywhere) Plugin Support
We have discontinued the support and use of the TEE plugin for Provar Automation. If the user updates to the new version of Provar that has TEE disabled, the TEE plugin is no longer installable and has no effect if TEE is already in use.
Note: The SVN, JIRA plugin, and Legacy Editors will be removed in future.
Provar Labs
The Provar Labs team is happy to announce that Provar Assistant is now available. Provar Assistant is an AI chatbot designed to provide instant support and real-time responses to your Provar-related questions. It’s your go-to resource for rapid access to useful product information, best practices, and troubleshooting advice. Access Provar Assistant and log in with your Google or Success Portal. You may learn more about Provar Assistant here.
University of Provar
The University of Provar is excited to announce an updated Provar Manager Essentials Certification. Check it out to familiarize yourself with the new Manager updates!
Customer Support
Providing ongoing support is our promise to you. If you have any questions regarding this release, please contact us anytime; we are happy to help. To get in touch, simply log in to the Provar Success Portal and select ‘Raise a Case,’ or reach out directly to your dedicated Customer Success Specialist.
- Home
- System Requirements
- Browser and Driver Recommendations
- Installing Provar Automation
- Updating Provar Automation
- Licensing Provar
- Granting Org Permissions to Provar Automation
- Optimizing Org and Connection Metadata Processing in Provar
- Using Provar
- Understanding Provar’s Use of AI Service for Test Automation
- Provar Automation
- Creating a New Test Project
- Import Test Project from a File
- Import Test Project from a Remote Repository
- Import Test Project from Local Repository
- Commit a Local Test Project to Source Control
- Salesforce API Testing
- Behavior-Driven Development
- Consolidating Multiple Test Execution Reports
- Creating Test Cases
- Custom Table Mapping
- Functions
- Debugging Tests
- Defining a Namespace Prefix on a Connection
- Defining Proxy Settings
- Environment Management
- Exporting Test Projects
- Exporting Test Cases into a PDF
- Japanese Language Support
- Override Auto-Retry for Test Step
- Customize Browser Driver Location
- Mapping and Executing the Lightning Article Editor in Provar
- Managing Test Steps
- Namespace Org Testing
- NitroX
- Provar Test Builder
- ProvarDX
- Refresh and Recompile
- Reintroduction of CLI license Check
- Reload Org Cache
- Reporting
- Running Tests
- Searching Provar with Find Usages
- Secrets Management and Encryption
- Setup and Teardown Test Cases
- Tags and Service Level Agreements (SLAs)
- Test Cycles
- Test Plans
- Testing Browser – Chrome Headless
- Testing Browser Options
- Tooltip Testing
- Using the Test Palette
- Using Custom APIs
- Callable Tests
- Data-Driven Testing
- Page Objects
- Block Locator Strategies
- Introduction to XPaths
- Creating an XPath
- JavaScript Locator Support
- Label Locator Strategies
- Maintaining Page Objects
- Mapping Non-Salesforce Fields
- Page Object Operations
- ProvarX™
- Refresh and Reselect Field Locators in Test Builder
- Using Java Method Annotations for Custom Objects
- Applications Testing
- Database Testing
- Document Testing
- Email Testing
- Email Testing in Automation
- Email Testing Examples
- Gmail Connection in Automation with App Password
- App Configuration for Microsoft Connection in MS Portal for OAuth 2.0
- OAuth 2.0 Microsoft Exchange Email Connection
- Support for Existing MS OAuth Email Connection
- OAuth 2.0 MS Graph Email Connection
- Create a Connection for Office 365 GCC High
- Mobile Testing
- OrchestraCMS Testing
- Salesforce CPQ Testing
- ServiceMax Testing
- Skuid Testing
- Vlocity API Testing
- Webservices Testing
- DevOps with V2
- Introduction to Provar DevOps
- Introduction to Test Scheduling
- Apache Ant
- Configuration for Sending Emails via the Automation Command Line Interface
- Continuous Integration
- AutoRABIT Salesforce DevOps in Provar Test
- Azure DevOps
- Running a Provar CI Task in Azure DevOps Pipelines
- Configuring the Automation Secrets Password in Microsoft Azure Pipelines
- Parallel Execution in Microsoft Azure Pipelines using Multiple build.xml Files
- Parallel Execution in Microsoft Azure Pipelines using Targets
- Parallel Execution in Microsoft Azure Pipelines using Test Plans
- Bitbucket Pipelines
- CircleCI
- Copado
- Docker
- Flosum
- Gearset
- GitHub Actions
- Integrating GitHub Actions CI to Run Automation CI Task
- Remote Trigger in GitHub Actions
- Parameterization using Environment Variables in GitHub Actions
- Parallel Execution in GitHub Actions using Multiple build.xml Files
- Parallel Execution in GitHub Actions using Targets
- Parallel Execution in GitHub Actions using Test Plan
- Parallel Execution in GitHub Actions using Job Matrix
- GitLab Continuous Integration
- Travis CI
- Jenkins
- Execution Environment Security Configuration
- Provar Jenkins Plugin
- Parallel Execution
- Running Provar on Linux
- Reporting
- Salesforce DX
- Git
- Version Control
- Salesforce Testing
- Recommended Practices
- Salesforce API Access Control Security Update – Impact on Provar Connections
- Salesforce Connection Best Practices
- Improve Your Metadata Performance
- Java 21 Upgrade
- Testing Best Practices
- Automation Planning
- Supported Testing Phases
- Provar Naming Standards
- Test Case Design
- Create records via API
- Avoid using static values
- Abort Unused Test Sessions/Runs
- Avoid Metadata performance issues
- Increase auto-retry waits for steps using a global variable
- Create different page objects for different pages
- The Best Ways to Change Callable Test Case Locations
- Working with the .testProject file and .secrets file
- Best practices for the .provarCaches folder
- Best practices for .pageObject files
- Testing Best Practices
- Troubleshooting with V2
- How to Use Keytool Command for Importing Certificates
- Browsers
- Configurations and Permissions
- Add Permissions to Edit Provar.ini File
- Configure Provar UI in High Resolution
- Enable Prompt to Choose Workspace
- Increase System Memory for Provar
- Refresh Org Cache Manually
- Show Hidden Provar Files on Mac
- Java Version Mismatch Error
- Unable to create test cases, test suites, etc… from the Test Project Navigation sidebar
- Connections
- DevOps with V2
- Error Messages
- Provar Manager 3.0 Install Error Resolution
- Provar Manager Test Case Upload Resolution
- Administrator has Blocked Access to Client
- JavascriptException: Javascript Error
- Resolving Failed to Create ChromeDriver Error
- Resolving Jenkins License Missing Error
- Resolving Metadata Timeout Errors
- Test Execution Fails – Firefox Not Installed
- Selenium 4 Upgrade
- Licensing and Installation
- Memory
- Test Builder
- Release Notes