01 What is it?
Arize Phoenix is an open-source observability and evaluation tool for LLM and agent applications, with full OpenTelemetry tracing. TruLens provides programmatic evaluation primitives for RAG and agent applications. Together they cover open-source LLM observability and evaluation end-to-end.
02 Why implement it?
- Open source and self-hostable
- Native OpenTelemetry support for traces
- Programmatic evaluators for RAG and agent quality
- Integrations with LangChain, LlamaIndex, OpenAI Agents
- Plays well with Langfuse and other observability layers
03 How I help
I integrate Phoenix and TruLens into your existing LLM stack, design the evaluation harness, configure custom evaluators for your domain, and connect the traces into your broader observability platform.
04 Expected deliverables
- Phoenix and TruLens deployment design
- Evaluation harness with custom evaluators
- OpenTelemetry trace integration
- Drift and quality alerting
- Operating model and team enablement