Skip to main content
POST
/
v2
/
evaluators
Create evaluator
curl --request POST \
  --url https://api.arize.com/v2/evaluators \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '
{
  "space_id": "U3BhY2U6NDkzOkJaSkc=",
  "name": "Hallucination Eval",
  "description": "Detects hallucinated content in LLM responses",
  "type": "template",
  "version": {
    "commit_message": "Initial version",
    "template_config": {
      "name": "hallucination",
      "template": "You are an evaluation assistant. Given the following input and output, determine if the output contains hallucinated content.\n\nInput: {{input}}\nOutput: {{output}}\nReference: {{reference}}",
      "include_explanations": true,
      "use_function_calling_if_available": true,
      "classification_choices": {
        "hallucinated": 0,
        "factual": 1
      },
      "direction": "maximize",
      "data_granularity": "span",
      "llm_config": {
        "ai_integration_id": "TGxtSW50ZWdyYXRpb246MTI6YUJjRA==",
        "model_name": "gpt-4o",
        "invocation_parameters": {
          "temperature": 0
        },
        "provider_parameters": {}
      }
    }
  }
}
'
{
  "id": "RXZhbHVhdG9yOjEyOmFCY0Q=",
  "name": "Hallucination Eval",
  "description": "Detects hallucinated content in LLM responses",
  "type": "template",
  "space_id": "U3BhY2U6NDkzOkJaSkc=",
  "created_at": "2026-02-16T22:05:47.900Z",
  "updated_at": "2026-02-16T22:05:48.150Z",
  "created_by_user_id": "VXNlcjoxOm5OYkM=",
  "version": {
    "id": "RXZhbHVhdG9yVmVyc2lvbjoxMDpYeVp3",
    "evaluator_id": "RXZhbHVhdG9yOjEyOmFCY0Q=",
    "commit_hash": "a3b1c9e4f7d2a0518e6c3bb9217f87d1c4e810f2",
    "commit_message": "Initial version",
    "template_config": {
      "name": "hallucination",
      "template": "You are an evaluation assistant...",
      "include_explanations": true,
      "use_function_calling_if_available": true,
      "classification_choices": {
        "hallucinated": 0,
        "factual": 1
      },
      "direction": "maximize",
      "data_granularity": "span",
      "llm_config": {
        "ai_integration_id": "TGxtSW50ZWdyYXRpb246MTI6YUJjRA==",
        "model_name": "gpt-4o",
        "invocation_parameters": {
          "temperature": 0
        },
        "provider_parameters": {}
      }
    },
    "created_at": "2026-02-16T22:05:48.143Z",
    "created_by_user_id": "VXNlcjoxOm5OYkM="
  }
}

Authorizations

Authorization
string
header
required

Most Arize AI endpoints require authentication. For those endpoints that require authentication, include your API key in the request header using the format

Body

application/json

Body containing evaluator creation parameters with an initial version

space_id
string
required

Space global ID (base64)

name
string
required

Evaluator name (must be unique within the space)

type
enum<string>
required

Evaluator type. Only template is supported in this iteration.

Available options:
template,
code
version
object
required

The initial version for the evaluator

description
string

Evaluator description

Response

Returns the created evaluator with its initial version

An evaluator defines reusable evaluation logic that can be attached to evaluation tasks. The type field determines the kind of evaluation: template (LLM-based template evaluation) or code (custom code evaluation).

id
string
required

The unique identifier for the evaluator

name
string
required

The name of the evaluator

type
enum<string>
required

The evaluator type: template (LLM-based) or code (custom code)

Available options:
template,
code
space_id
string
required

The unique identifier for the space the evaluator belongs to

created_at
string<date-time>
required

When the evaluator was created

updated_at
string<date-time>
required

When the evaluator was last updated

created_by_user_id
string | null
required

The unique identifier for the user who created the evaluator

version
object
required

The resolved version of the evaluator

description
string | null

The description of the evaluator