Evals and Releases
New ways to make changes to Fin with confidence
You are always changing Fin: adding content, updating Procedures, refining Guidance. Releases give you a space to prepare those changes away from live Fin, and Evals test how they behave before customers see them.
Releases: Bundle related changes to Content, Procedures and Guidance into one unit and work on them with your team, away from the version of Fin your customers talk to.
Evals: Run up to 50 Simulations, realistic multi-turn conversations, against a Release and have each one scored automatically against criteria you set.
Roll out gradually: Publish to everyone at once, or send the Release to a share of conversations and A/B test it against your live Fin before going further.
Evals: Run up to 50 Simulations, realistic multi-turn conversations, against a Release and have each one scored automatically against criteria you set.
Roll out gradually: Publish to everyone at once, or send the Release to a share of conversations and A/B test it against your live Fin before going further.
