Winter '25 Release 1 (v2.14.1)
Executive Summary
We’re excited to announce the latest updates to the Provar product suite with our Winter ’25 Release 1. You can now download and install Winter ’25 Release 1 through the Provar Success Portal.
Winter ’25 Salesforce Changes
Provar Automation Features and Enhancements
NitroX: Custom XPath Generation for Non-Unique Elements
We have added a new feature that improves our XPath-generating capability. Users can now develop XPath expressions when standard attributes are insufficient due to element non-uniqueness. This feature uses JavaScript properties to automatically build XPath expressions, resulting in more accurate element identification. It works for both page structure nodes and field elements. If conventional JSON attributes cannot guarantee an element’s uniqueness, the system will automatically create an XPath based on additional JavaScript properties.
Updated FACT to NitroX within the product.
We have updated the fact & factPackages folder to nitroX & nitroXPackages respectively.
Similarly, the .fact folder has been updated to .nitroX in USER_HOME/Provar.
Note: In case the renaming issue is encountered, please delete the folder and restart the Provar or rename the .fact folder to .nitroX in the USER_HOME/Provar directory.
Validation Error for Duplicate Tagname and Qualifier Combinations
We’ve included a validation mechanism to prevent duplicate tag names and qualifier combinations from being created when creating custom components via Test Builder. A validation error will be raised whenever a user attempts to create a component with an already-existing tag name and qualifier, ensuring that only distinct combinations are used.
Fix for Picklist Options Extraction in UI Connection
We fixed an issue where picklist options were inconsistently extracted for some fields via UI Connection, while others worked fine. This issue was caused by the lack of support for combobox-type picklists in PageObjects. With this release, the extraction method has been improved, resulting in consistent and reliable retrieval of picklist options across all relevant fields.
Appropriate Error Message for Execution Failure
We have added a critical validation improvement for NitroX. If an execution fails due to a duplicate tag name and qualifier combination, an appropriate error message will now be displayed.
Removal of File Extensions from Test Builder Messages
We improved message clarity in TB by removing file extensions (e.g., .cp.json) from alert and success messages during component creation, updating, and overriding. The file extension will no longer be displayed in these messages, making the experience cleaner and more user-friendly.
Provar Manager Features & Enhancements
With Provar Manager version 3.9.0, the following features and enhancements are now available:
Test Management App
Risk Mitigation Plans with Gen AI
Provar Manager adds a new function to improve risk management by utilizing Generative AI. A new button titled “Generate Risk Mitigation Strategies” has been added to the top right column of the Risk page layout. It uses AI to analyze the details of the current risk record and provide a proposed solution for mitigating potential risks based on the description provided.
Added Numbering for Test Steps in Provar Manager
This update allows users to easily identify and reference specific steps, especially in large test cases. By implementing step numbering, users can more easily locate and manage particular steps, addressing client feedback and highlighting the need for simpler organization and navigation.
Test Operations App
Automatic Scheduling for Test Plan Frequency Changes
We’ve introduced an enhancement to automatically schedule the Run Test Plan when a Test Plan Schedule changes from ‘One-Off’ to any other frequency while it remains active. Previously, automatic scheduling only occurred when switching from an inactive to an active state. With this upgrade, if a Test Plan Schedule is still active and changes from “One-Off” to a Daily or Weekly schedule, it will now be scheduled automatically if needed.
Environment Selection for Branch Import
We have improved the branch import procedure to create a more seamless experience by requiring environment selection before proceeding with an upload. Previously, users received a vague error message if an environment was not assigned. With this upgrade, users will be prompted to choose an environment for each branch before completing the import.
Enhanced VCS Connection Management
We’ve enhanced VCS connection management with important improvements to diagnostics and operational efficiency. Users will now receive precise error messages when establishing a VCS connection or loading repositories, making debugging easier. Additionally, the VCS Connect component will indicate the current connection status, allowing users to immediately determine whether the connection is valid, expired, or experiencing issues.
Automatic Defect Creation on Apex Test Executions
When setting up an Apex test plan schedule, users can choose whether to create defects for each unit test failure using a new toggle labeled “Raise Defects on Failures,” located just below the “Skip Code Coverage Calculation” option. This toggle is enabled by default, and its behavior is controlled by the option APEX_RAISE_DEFECTS_ON_FAILURE.
Enhanced Scheduling Features
We have made significant changes to improve the scheduling of test programs. Test plan schedules will now run every 15 minutes instead of every hour, allowing schedules configured for specific times between the hours (such as 13:15 or 08:45) to execute more quickly. Additionally, we’ve included explanatory text to indicate the local time at which a schedule is set to execute, providing users with better visibility and understanding of the actual timing of their schedules.
Provar Grid Features & Enhancements
VCS Connection Check
We’ve implemented a new feature that streamlines job execution by ensuring the Version Control System (VCS) connection is valid before starting a Provar Grid job. As part of this upgrade, the system now performs a preliminary check of the VCS connection. If the connection is misconfigured or non-functional, the job will fail immediately with the error message “The connection to the VCS failed.”
Provar Grid Test Case Level Executions and Retries
This new feature allows users to run individual test cases either directly or as part of a retry. It provides testers with more precise control by enabling them to select specific test suite cases within test plan schedules. Additionally, during test cycle retries, only the selected test cases will be re-executed.
Provar DX CLI
Support for Test and Plugin Output Level
We’ve enhanced ProvarDX’s logging settings by enabling you to specify different output levels for tests and plugins. With this update, users can now configure the testOutputLevel and pluginOutputLevel in the provardx-properties.json file.
OAuth Connection Override
When running tests against Salesforce Scratch Orgs, the ProvarDX CLI can override OAuth connections with username/password connections. Previously, users faced issues due to ProvarDX’s inability to support OAuth connection overrides, which led to failures with error messages like ‘Error in refreshing access token.’ This update ensures that tests run smoothly when an override of a connection is specified in the properties file to replace an OAuth connection with a username/password connection.
Platform Updates
Enhanced Security
We have strengthened security by addressing vulnerabilities throughout the product. These enhancements improve our product’s reliability and help maintain customer trust, safeguarding against potential risks.
Enhanced GUID Handling
In this release, we’ve made significant improvements to GUID management across the project. These enhancements address callable and non-callable test cases, test plans, and their associated folders and instances. This optimization ensures more accurate and faster integration with Provar Manager and eliminates unnecessary duplication errors in the project.
Strategic Fix for Longer Execution Pack Errors
This release introduces a strategic fix to address intermittent WebDriver and null pointer exceptions that have been affecting longer execution pack runs on servers. With this update, we have implemented enhancements to improve the reliability of longer execution packs, ensuring smoother and more stable test execution. This fix is designed to enhance overall performance and reduce disruptions, contributing to more consistent and predictable outcomes in your testing processes.
CI/CD Updates
The following updates are available with Provar Automation v2.14.1:
- Both Docker Images (ProvarDX and Provar ANT) have been updated to the latest version of Provar, 2.14.1.
- CircleCI Orb has been updated to the latest version of Provar, 2.14.1.
- Jenkins Plugin installer files now reflect the latest installation links for Provar.
Browser Compatibility Updates
As part of our pre-release testing, we have confirmed that Automation v2.14.1 is compatible with Chrome version 128.
Why is this important?
Ensuring that Automation v2.14.1 includes ChromeDriver 128 and is compatible with Chrome 128 eliminates the risk of incompatibility issues, which could otherwise prevent test cases from functioning as expected.
How can I use this?
If you want to start using Chrome 128, we recommend upgrading to Provar Automation v2.14.1, which includes ChromeDriver 128 by default.
Automation will automatically attempt to download the correct ChromeDriver if it detects a driver exception. If your organization’s security protocols block the automatic download, you can manually override the ChromeDriver.
To downgrade or revert the ChromeDriver, refer to this support article, which explains how to use a ChromeDriver different from the one provided by default in your Provar Automation installation.
Browser and Driver Combinations Recommended for Provar Automation v2.14.1
For a comprehensive guide, please refer to the Browser and Driver Recommendations support article.
University of Provar
Want to learn more about ProvarDX and how to implement CLI testing? Our newest ProvarDX course has you covered! Explore this course and more at the University of Provar!
We’re here to support you every step of the way. Please let us know what additional content you’d like to see by using the course feedback form.
Customer Support
We are committed to providing ongoing support. If you have any questions regarding this release, please contact us anytime; we are happy to help. To get in touch, simply log in to the Provar Success Portal and select ‘Raise a Case,’ or contact your dedicated Customer Success Specialist.