Skip to main content
POST
Ingest Task For Diagnostics

Authorizations

X-API-Key
string
header
required

Organization API key

Query Parameters

agent_id
string
required
Maximum string length: 64
Pattern: ^agt_[a-z0-9]+$
bench_id
string | null
Pattern: ^bm_[a-z0-9]+$

Body

application/json
name
string
required
run_command
string
required

For SDK evaluation and training, the command to run your agent in the sandbox, e.g. python /app/agent.py; include the executable, not only its arguments. Your script must call the model, run any tools, log a reward, and finalize the trajectory before exiting.

id
string | null
split
enum<string> | null
Available options:
train,
test
input_messages
BenchmarkMessage · object[]

Messages stored on the task. For SDK evaluation and training, your agent script must pass messages to the model; this field does not do that automatically.

reference_trajectory_id
string | null
image
null
runtime
RuntimeSpec · object | null
env_vars
Env Vars · object

Keys must match [A-Za-z_][A-Za-z0-9_]* and cannot start with TRAJECTORY_ or use MODEL_ENDPOINT_ID, MODEL_ENDPOINT_ACCESS_TOKEN, or MODEL_ENDPOINT_URL.

env_resources
EnvResources · object
spec
Spec · object
task_spec_uri
string | null
tags
string[]

Up to 20 distinct, non-empty task tags of at most 64 characters each.

Response

Successful Response

bench_id
string
required
name
string
required
task_count
integer
required
failed_tasks
BenchmarkTaskWriteFailure · object[]
warnings
string[]

Provider resource adjustments made before ingestion.