Skip to main content
POST
Start Task Diagnostics

Authorizations

X-API-Key
string
header
required

Organization API key

Body

application/json
bench_id
string
required
base_model_slug
enum<string>
default:nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16
Available options:
thinkingmachines/Inkling-Small,
Qwen/Qwen3.5-4B,
Qwen/Qwen3.5-397B-A17B,
Qwen/Qwen3.6-35B-A3B,
Qwen/Qwen3.8-27B,
nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-BF16,
nvidia/NVIDIA-Nemotron-3-Super-120B-A12B-BF16,
nvidia/NVIDIA-Nemotron-3.5-Lightning-30B-A3B-BF16,
nvidia/NVIDIA-Nemotron-3.5-Super-120B-A12B-BF16,
openai/gpt-6.1-sol,
openai/gpt-6-sol,
openai/gpt-6-astra,
openai/gpt-5.6-sol,
openai/gpt-5.6-luna,
anthropic/claude-opus-5.5,
anthropic/claude-sonnet-5.5,
openai/gpt-5-mini,
openai/gpt-5.4-mini,
openai/gpt-5.5,
anthropic/claude-sonnet-4.6,
google/gemini-3.1-pro-preview,
z-ai/glm-5.3,
z-ai/glm-5.3-flash,
moonshotai/kimi-k3
options
RunOptions · object | null

Evaluation settings, as for createEvalRun, such as reasoning_effort and max_output_tokens_per_turn; the diagnostic sets its own sample counts.

Response

Successful Response

benchmark_diagnostic_id
string
required
bench_id
string
required
status
string
required
Allowed value: "pending"