2024-05-10
What’s New
SessionsA session is a grouping of traces based on a session ID attribute. When building or debugging a chatbot application, being able to see groups of messages or traces belonging to a series of interactions between a human and the AI can be particularly helpful. By addingsession.id and user.id as attributes to spans, you can:- Find exactly where a conversation “breaks” or goes off the rails. This can help identify if a user becomes progressively more frustrated or if a chatbot is not helpful.
-
Find groups of traces where your application is not performing well. Adding
session.idand/oruser.idfrom an application enables back-and-forth interactions to be grouped and filtered further. -
Construct custom metrics based on evals using
session.idoruser.idto find best/worst performingsessionsandusers.


Enhancements
Join Evals on Existing Traces-
Send in latent evals through our Python SDK. They will be joined daily on spans with matching
span_ids*. *The functionality is very similar to that of latent actuals or tags, but with Evals. -
Send in your evaluations through the new
log_evaluationsmethod in the new Python SDKv7.16.1.

-
Add
session.idanduser.idto spans batch logging - Send Arize schema as part of the request body
📚 New Content
The latest paper readings, ebooks, self-guided learning modules, and technical posts:- Four tips on how to read AI research papers effectively
- ReAct: Synergizing Reasoning and Acting in Language Models
- LLM Time Series: Research on Performance of GPT-4 and Claude 3 At Time Series Analysis
- Citi: Good Things Happen Podcast on AI