Skip to main content
POST
Start Eval Route

Authorizations

X-API-Key
string
header
required

Organization API key

Path Parameters

bench_id
string
required

Body

application/json
model_slug
enum<string>
required
Available options:
Qwen/Qwen3.5-4B,
Qwen/Qwen3.5-397B-A17B,
Qwen/Qwen3.6-35B-A3B,
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16,
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16,
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16,
openai/gpt-5-mini,
openai/gpt-5.4-mini,
openai/gpt-5.5,
anthropic/claude-sonnet-4.6,
google/gemini-3.1-pro-preview
display_name
string | null

User-facing name for the evaluation run.

Required string length: 1 - 256
checkpoint_id
string | null

When set, evaluate this committed training checkpoint instead of the base model.

Response

Successful Response

bench_id
string
required

Benchmark evaluated by this run.

eval_run_id
string
required

Evaluation run created for this request.

pipeline_run_id
string
required

Pipeline run executing the evaluation.

display_name
string | null
required

User-facing name for the evaluation run.

execution_id
string
required

Flyte execution launched for the evaluation.

pipeline_name
string
required

Pipeline configuration used by the evaluation.

experiment_name
string
required

Experiment name assigned to the evaluation.