Skip to content
AgentV

Validate

The validate command checks evaluation files for schema errors without running them.

Usage

Section titled “Usage”
Terminal window
agentv validate evals/my-eval.yaml

Validate multiple files:

Terminal window
agentv validate evals/**/*.yaml

What It Checks

Section titled “What It Checks”
  • YAML/JSONL syntax
  • Required fields (id, input_messages, expected_outcome)
  • Evaluator references (script paths, prompt files)
  • Target references match entries in targets.yaml
  • Rubric structure and field types

When to Use

Section titled “When to Use”
  • Before running evaluations to catch config errors early
  • In CI/CD pipelines as a pre-check
  • After editing eval files to verify correctness