PolicyEngine

Grok 4.20

xAI · elicited April 2026 · average interval-width rank #22.3 of 29 across the canonical panel · $3.45 total elicitation cost.

grok-4.20

Canonical panel profile

One row per canonical quantity, each on its own scale: this model's pooled center and 90 percent interval, with the 29-model panel median as a gray tick.

Generation harness

From the paper's per-model disclosure (Appendix A16). The prompt and repeated-run design are identical across models; the output mechanism follows each provider's API surface.

Provider path
LiteLLM
Output mechanism
forced function call
Completion budget
1200
Sampling
temperature 1.0
Reasoning
reasoning variant
API identifier
xai/grok-4.20-reasoning (alias)

195 successful runs · elicited April and July 2026 · v4 prompts · 15 runs per model-quantity cell. Code · Raw responses · Paper (PDF)

Code and dataElicited April and July 2026 · 29 models · v4 prompts