Documentation index
Fetch the complete documentation index at: /llms.txt
Ask it with GET /ask?q=<keywords or question>. Short keywords rank best.
Use these to discover all available pages before exploring further.

Skip to main content

Documentation Integrations SDK & API Reference Self-Hosting Cookbooks Release Notes

/

Cookbooks

Agent Workflow Patterns

Overview
AutoGen
CrewAI
Google GenAI SDK (manual orchestration)
OpenAI Agents
LangGraph
Smolagents

AI Engineering Workflows

Iterative Evaluation & Experimentation Workflow (Python)
Iterative Evaluation & Experimentation Workflow (TypeScript)
Aligning LLM Evals with Human Feedback (TypeScript)
Prompt Optimization Techniques
Run Repetition Experiments

Tracing

Identifying High-Signal Traces in Production
Agentic RAG Tracing
Trace and Evaluate Claude Managed Agents
Generating Synthetic Datasets for LLM Evaluators & Agents
Structured Data Extraction
Product Recommendation Agent: Google Agent Engine & LangGraph
OpenInference Best Practices
More Cookbooks

Human-in-the-Loop Workflows (Annotations)

Using Human Annotations for Eval Driven Development
Aligning LLM Evals with Human Feedback (TypeScript)

Prompts

Optimizing Coding Agent Prompts - Prompt Learning
Optimizing Prompts for LLM Classification - Prompt Learning
Few Shot Prompting
ReAct Prompting
Chain of Thought Prompting
Prompt Optimization Techniques
LLM-as-a-Judge Prompt Optimization

Evaluation

Write Your First Custom Eval
OpenAI Agents SDK Cookbook
Evaluate a Talk-to-Your-Data Agent
Trace-level Evaluation: Beyond Input/Output Checks
Session-level Evaluation: Scoring the Whole Conversation
Evaluate RAG
Code Readability Evaluation

Guardrails & Safety

Jailbreak and Prompt Injection Defense
Designing Realtime Guardrails: Input, Output, and the Cost of Blocking

Datasets & Experiments

Analyzing Customer Review Evals with Repetition Experiments
Experiment with a Customer Support Agent
Comparing LlamaIndex Query Engines with a Pairwise Evaluator
Prompt Template Iteration for a Summarization Service
Text2SQL Experiments
Why Public Benchmarks Lie: Building Your Own Eval Harness
More Cookbooks

Tracing

More Cookbooks

Trace through the execution of your LLM application to understand its internal structure and to troubleshoot issues with retrieval, tool execution, LLM calls, and more.

1 min read

Use Cases#

LlamaIndex + OpenAI RAG Application
LangChain + OpenAI RAG Application
LangChain OpenAI Agent
LlamaIndex OpenAI Agent
Multilingual Text2Cypher with Custom Evaluation Tracing
Trace and Evaluate Claude Managed Agents

OpenInference Best Practices Using Human Annotations for Eval Driven Development

Phoenix home page

slack x bluesky linkedin github

English 日本語 (Japanese)中文 (Chinese)

On this page

Use Cases