Anthropic Tracing

Anthropic is a leading provider for state-of-the-art LLMs. The Anthropic SDK can be instrumented using the openinference-instrumentation-anthropic package.

Install#

pip install openinference-instrumentation-anthropic anthropic

Setup#

Connect your application to Phoenix with the register function:

from phoenix.otel import register# configure the Phoenix tracertracer_provider = register(project_name="my-llm-app", # Default is 'default'auto_instrument=True # Auto-instrument your app based on installed OI dependencies)

Run Anthropic#

A simple Anthropic application that is now instrumented

import anthropicclient = anthropic.Anthropic()message = client.messages.create(    model="claude-3-5-sonnet-20240620",    max_tokens=1000,    messages=[        {            "role": "user",            "content": [                {                    "type": "text",                    "text": "Why is the ocean salty?"                }            ]        }    ])print(message.content)

Observe#

Now that you have tracing setup, all invocations of pipelines will be streamed to your running Phoenix for observability and evaluation.

Install#

Setup#

Run Anthropic#

Observe#

Resources:#