Skip to main content
​
2024-11-07

​
What’s New

​
New Copilot Skills

  • Custom Metric Skill: Copilot now writes custom metrics! Users can generate their desired metric by having copilot translate natural language descriptions or existing code (e.g., SQL, Python) into AQL. Learn more →

    Copilot Custom Metric Skill

  • Embedding Summarization Skill: Copilot now works for embeddings! Users can select embedding data point and Copilot will analyze for patterns and insights. Learn more →

    Copilot Embedding Summarization Skill

​
Enhancements

​
Local Explainability Support

Local Explainability is now live, providing both a table view and waterfall style plot for detailed, per-feature SHAP values on individual predictions. Learn more →

Local Explainability Support

​
Experiment Over Time Widget

This widget allows users to integrate experiment data directly into their dashboards for ongoing visibility and analysis. Users can now:
  • Select dataset of interest
  • Choose specific evaluations they want to visualize over time
  • Complete with direct connectivity to experiment details, making it easy to access the individual experiment results
Learn more →

Experiment Over Time Widget

​
Full Function Calling Replay in Prompt Playground

Now users can follow the full function calling tutorial from OpenAI and iterate on different functions in different messages from within the Prompt Playground.

Full Function Calling Replay

​
Instrumentation Enhancements

  • Context Attribute Propagation - Arize now has a set of utilities (eg: using_session) that allow users to set properties on context. All of these properties will be picked up by all of our auto instrumentations and added to spans. Learn more →
  • Typescript Trace Configuration - Typescript auto instrumentations now accept a trace configuration which allows for data masking and configuration of attribute values on spans. Learn more →
  • Vercel AI SDK - User can now ingest traces created by the Vercel AI SDK into Arize. Learn more →
  • LangChain Auto Instrumentation: Arize’s LangChain auto instrumentation now supports langchain.js version 0.3 and is backwards compatible with all previous versions. Learn more →

​
📚 New Content

The latest video tutorials, paper readings, ebooks, self-guided learning modules, and technical posts:🧑‍🏫 Prompt Optimization Course📊 Evaluation Workflows to Accelerate Generative App Development and AI ROI🐝 Swarm: OpenAI’s Experimental Approach to Multi-Agent Systems✏️ LLM Evaluation Course🤖 Techniques for Self-Improving LLM Evals