> ## Documentation Index
> Fetch the complete documentation index at: https://docs.weflayr.com/llms.txt
> Use this file to discover all available pages before exploring further.

# Evaluators

> The checks that decide whether a model's answer is as good as your current one.

An evaluator judges each answer of a [benchmark](/product/model-benchmarks) against the baseline's: better, same or worse. Your library keeps them to reuse across benchmarks.

<Frame>
  <video src="https://mintcdn.com/weflayr/jf99vD0W4dsGuj5S/images/product/evaluators.mp4?fit=max&auto=format&n=jf99vD0W4dsGuj5S&q=85&s=1f843af487d40dca767ddca9aa77d5a9" poster="/images/product/evaluators-poster.jpg" aria-label="Evaluators library, then an AI judge evaluator open with a test on a real call" controls loop muted playsInline preload="metadata" className="w-full rounded-xl" data-path="images/product/evaluators.mp4" />
</Frame>

## Types

* **AI judge**: a model reads both answers and follows your instructions, e.g. "The answer names the policy clause it relies on".
* **Deterministic**: a Python check, e.g. at most 120 words. Describe it and **Generate code** writes it for you.
* **Built-in**: ready-made judges (Overall quality, Context fidelity, Instruction fidelity, Completeness, Tone fidelity).

## Test before you save

**Test on a real call** runs the evaluator on one of your calls, with your production answer and another model's, so you can check its verdict before using it in a benchmark.


This documentation is built and hosted on [Mintlify](https://mintlify.com), a developer documentation platform.