AutoGen is Microsoft’s framework for building multi-agent LLM applications — agents that converse with each other to solve tasks. Arize AX captures every AutoGen run — assistant turns, user-proxy auto-replies, and the underlying LLM calls — via theDocumentation Index
Fetch the complete documentation index at: https://arize-ax.mintlify.dev/docs/llms.txt
Use this file to discover all available pages before exploring further.
openinference-instrumentation-autogen package, paired with openinference-instrumentation-openai for full visibility into each LLM call.
AutoGen Tracing Tutorial (Google Colab)
This guide covers the original AutoGen API (
autogen.AssistantAgent / UserProxyAgent / initiate_chat). For the newer AgentChat API (autogen-agentchat package), see the AutoGen AgentChat tracing guide.Prerequisites
- Python 3.10+
- An Arize AX account (sign up)
- An
OPENAI_API_KEYfrom the OpenAI Platform
Launch Arize AX
- Sign in to your Arize AX account.
- From Space Settings, copy your Space ID and API Key. You will set them as
ARIZE_SPACE_IDandARIZE_API_KEYbelow.
Install
Configure credentials
Setup tracing
Run AutoGen
Expected output
Verify in Arize AX
- Open your Arize AX space and select project
autogen-tracing-example. - You should see a new trace within ~30 seconds containing an
Autogenparent span wrapping OpenAIChatCompletionLLM child spans with the prompt, response, and token usage attached. - If no traces appear, see Troubleshooting.
Troubleshooting
- No traces in Arize AX. Confirm
ARIZE_SPACE_IDandARIZE_API_KEYare set in the same shell that runsexample.py. Enable OpenTelemetry debug logs withexport OTEL_LOG_LEVEL=debugand re-run. - AutoGen spans missing but OpenAI spans present.
AutogenInstrumentor().instrument(...)must run before anyautogenimport. Make sureinstrumentation.pyis the first import in your entry point. 401from OpenAI. VerifyOPENAI_API_KEYis set and has access togpt-5. Swap for a model your key can call.- Conversation never terminates. AutoGen’s
UserProxyAgentkeeps replying untilmax_consecutive_auto_replyis reached oris_termination_msgreturnsTrue. Tighten the termination check or lower the cap.