MiniMax M2.1

Crowdsourced pairwise human preference rankings of LLM responses. Higher Elo means more frequently preferred by users.

Median output speed in tokens per second over the last 14 days on the model maker's own API, measured nightly with a fixed ~800-token prompt and ~250-token answer. Models not yet probed fall back to a dated manual figure. Higher is faster.

Median time from request to first streamed token in milliseconds over the last 14 days on the model maker's own API, using the same nightly probe prompt. Lower is snappier; reasoning models are penalised here because they think before talking.

Long-horizon shell-and-filesystem tasks executed in a sandboxed terminal, scored by whether the agent's final state matches a target state. Tests practical tool-using ability for everyday devops and data-wrangling work; one of the hardest agentic benchmarks today.

Share of nightly probe requests over the last 14 days that streamed a complete answer without an error, timeout or empty response. Needs at least five attempts before a figure is shown.