Skip to main content

Available in @arizeai/phoenix-cli 1.0.4+

The Phoenix CLI now supports writing annotations to spans and traces. Use px span annotate and px trace annotate to attach labels, scores, and explanations directly from the terminal — useful for labeling traces in CI pipelines, scripting evaluation workflows, or quick manual review.

Annotate a Span#

Annotate a Trace#

Both commands accept:

FlagDescription
--nameAnnotation name (e.g. correctness, quality)
--labelCategorical label (e.g. correct, incorrect)
--scoreNumeric score
--explanationFree-text explanation
--annotator-kindHUMAN, LLM, or CODE
--formatOutput format: pretty, json, or raw

At least one of --label or --score is required. Submitting again with the same --name updates the existing entry rather than creating a duplicate.

View Annotations in Output#

Pass --include-annotations when reading traces or spans to see existing annotations alongside the data: