Skip to main content

The llm entrypoint provides reusable evaluator factories that call an AI SDK model and return structured evaluation results.

Example#

Built-In Evaluator Factories#

  • createConcisenessEvaluator
  • createCorrectnessEvaluator
  • createRetrievalRelevanceEvaluator
  • createFaithfulnessEvaluator
  • createRefusalEvaluator
  • createClassificationEvaluator
  • createToolSelectionEvaluator
  • createToolInvocationEvaluator
  • createToolResponseHandlingEvaluator