ReferenceSchemas

Experiment Schemas

Checkpoint selectors, patch operations, intervention specs, trial plans, validity gates, hypotheses, and arms.

CheckpointSelector

{ "kind": "first" }
{ "kind": "latest" }
{ "kind": "name", "value": "before-final" }

PatchOperation

Patch operations support JSON Patch operations plus mask_span and replace_text.

InterventionSpec

FieldType
kindintervention kind
targetrefs such as refId, eventId, eventType, toolName, modelCallId, artifactId, jsonPointer
operationspatch operation array
patchJSON payload
expectedBaseHashoptional stale-target guard
descriptionoptional string

TrialPlan

FieldValues
repetitionspositive integer, default 1
concurrencypositive integer, default 1
maxReplayspositive integer, default 20
seedPolicynone, fixed, indexed
stopRulenone, first_supported, first_invalid

ValidityGate

minimum_trials
max_fixture_dependency_rate
max_non_comparable_rate
requires_effect_size

Current Runner Note

The schema includes concurrency and stop-rule fields. wait=false runs through durable local worker jobs, but execution inside one experiment is still serial.

On this page