MistralAI Tracing

MistralAI is a leading provider for state-of-the-art LLMs. The MistralAI SDK can be instrumented using the openinference-instrumentation-mistralai package.

Install#

pip install openinference-instrumentation-mistralai mistralai

Setup#

Set the MISTRAL_API_KEY environment variable to authenticate calls made using the SDK.

export MISTRAL_API_KEY=[your_key_here]

Connect your application to Phoenix with the register function:

from phoenix.otel import register# configure the Phoenix tracertracer_provider = register(project_name="my-llm-app", # Default is 'default'auto_instrument=True # Auto-instrument your app based on installed OI dependencies)

Run Mistral#

import osfrom mistralai import Mistralfrom mistralai.models import UserMessageapi_key = os.environ["MISTRAL_API_KEY"]model = "mistral-tiny"client = Mistral(api_key=api_key)chat_response = client.chat.complete(    model=model,    messages=[UserMessage(content="What is the best French cheese?")],)print(chat_response.choices[0].message.content)

Observe#

Now that you have tracing setup, all invocations of Mistral (completions, chat completions, embeddings) will be streamed to your running Phoenix for observability and evaluation.

Install#

Setup#

Run Mistral#

Observe#

Resources#