Use this article to find the Evals that apply to a Release, run them, add more Evals to the Release, and understand why Batch Test is unavailable inside a Release.
How to see which Evals apply to a Release
To see which Evals apply to a Release, open the Release and click the Evals tab. The tab lists Evals in two groups:
Changed in this release: Evals that were edited or added as part of this Release. An Edited label marks an Eval that already existed and was changed.
From Main: Evals that already exist in Fin Main and are available to run against this Release. Fin Main is your live production version of Fin.
Each Eval row shows its name, its run status, and a … menu. The run status can be Queued, Running (for example, 6/6 Running), or Not run. To hide or show a group, click its name. The Evals tab also shows a count of the Evals in each group.
How to run an Eval inside a Release
To run an Eval inside a Release, click the run button on the Eval's row in the Evals tab. A run runs the Eval's Simulations (realistic test conversations) against your Release's changes instead of your live Fin Main setup. While an Eval runs, its row shows a stop button, which you can click to stop the run.
To add more Evals to the Release, click Add more Evals below the two groups.
How to see all Evals while working inside a Release
To see all Evals while working inside a Release, select the Release in the switcher at the top left of the nav, then go to Test > Evals. The Evals page lists every Eval with its name, result, tags, last run date, and who last ran it. You can search Evals by name, add filters, and use the run or stop button next to an Eval name.
Why is Batch Test unavailable inside a Release?
Batch Test is unavailable inside a Release because it is only available in Fin Main. When a Release is selected, hovering over Batch Test in the Test menu shows the message "Batch Test is only available in Fin Main." To use Batch Test, switch back to Fin Main using the switcher at the top left of the nav.
Evals in a Release FAQs
What is the difference between Changed in this release and From Main?
What is the difference between Changed in this release and From Main?
In the Evals tab of a Release, Changed in this release lists Evals that were edited or added as part of the Release, while From Main lists Evals that already exist in Fin Main.
Can I use Batch Test inside a Release?
Can I use Batch Test inside a Release?
Batch Test can't be used inside a Release because it is only available in Fin Main. Switch to Fin Main to use it.
Need more help? Get support from our Community Forum
Find answers and get help from Intercom Support and Community Experts
