stealthmodels.

MODEL BENCHMARKS

Step 5 Preview

StepFun’s flagship agent model activates 27B of its 600B parameters per token and reads text, images and video across a million-token context.

BENCHMARK BY BENCHMARK

Step 5 Preview benchmark scores

StealthMark
39.0/100Overall rank 36/53
General Intelligence
37.1/100
Visual Intelligence
41.9/100

Step 5 PreviewOther modelsMedian

Reasoning efficiency

On every task, result quality and reasoning tokens are each compared with all measured models and weighed equally. Each dot is one model.

Single-step reasoningResult quality weighed against reasoning tokens on a single problemRank 14/51
Multi-step reasoningResult quality weighed against reasoning tokens across connected steps, as in agentic workflowsRank 22/49

DATASHEET

Step 5 Preview specs

A good fit forRepository-level software engineering, long tool-using agent runs and financial analysis across long documents, charts and screenshots.

Step 5 PreviewOther modelsMedian

Context windowTokens in one request
1,048,576Joint largest with 20 others
Developer
StepFun
Family
Step 5
Open model
Yes
Local model
No
Parameters
600B
Active parameters
27B
Input → output
Text, image, video → text
API model ID
step-5-preview
Architecture
Sparse mixture-of-experts; 92 layers (88 MoE), 352 routed experts with 8 selected per token plus a shared expert; grouped-query attention with 512-token sliding windows and full attention every fourth layer; 3 multi-token-prediction layers; vision tower for image and video input

Self-host Step 5 Preview

Hardware
Multi-GPU serverEstimated
Download size
177 GB (GGUF IQ3_KS mix (ik_llama.cpp)) to 1,215 GB (BF16)

Official FP8 weightsOfficial BF16 weightsOfficial NVFP4 weightsL-Alchemyst GGUF weights (ik_llama.cpp)

GAME BENCHMARKS

Watch Step 5 Preview play

Foresight

Anticipating threats and planning ahead

59.9/100Rank 42/49
1 of 3 played
Foresight: complete playing field
Level 122 ptsTurn 28 / 28

Points per level

  1. Level 1Second Thoughts22 ptsBest 27Survived
  2. Level 2Pressure PotPending
  3. Level 3Hide or FlightPending

Collect coins while avoiding ghosts. Ghosts move before the player each turn, and collisions cost a life. 3 levels in sequence, up to 66 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.

Latch

Cooperative planning and learning from experience

40.7/100Rank 28/50
Cleared 4 of 5
Latch: complete playing field
Level 515 ptsTurn 35 / 40

Points per level

  1. Level 1Hold the door5.2 ptsBest 5.2Cleared
  2. Level 2Crossfeed9 ptsBest 10.2Cleared
  3. Level 3Relay vault18.6 ptsBest 19.2Cleared
  4. Level 4Passing bay15.6 ptsBest 18.2ClearedFinished early · 3 beacons left
  5. Level 5Second thoughts15 ptsBest 20.6Finished early

Coordinate two robots to push numbered cores onto matching sockets. Pressure plates hold doors open; moving either robot uses one turn. 5 levels in sequence, up to 152 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.

Step 5 Preview benchmark results ↗

StealthMark score

StealthMark measures how well a model’s abilities carry over to original, demanding tasks it could not have trained for: physical and spatial reasoning, planning across many steps, and precise visual work. How StealthMark works explains every benchmark, what it tests and why it is hard.

General Intelligence

The ability to reason, plan, solve problems and understand how things relate and behave. A high score means it thinks hard problems through, from careful analysis to plans that span many steps.

Visual Intelligence

The ability to understand visual intent and turn ideas, descriptions and plans into coherent, effective visuals. A high score means design ideas come out the way you meant them, in illustrations, icons, diagrams or interface visuals.

Overall score

Overall shows how well a model’s abilities carry over to original, demanding tasks, weighting every benchmark into one score from 0 to 100. Estimated means the total includes an estimate for one missing scene.

Judging

Scores reflect how well each result meets the benchmark requirements. Game scores come from the recorded play: the points earned on each level and how each level ended. How StealthMark keeps scores honest.

Games

Each game is a sequence of levels, and earlier moves carry into later levels. A level that was not played is shown as not played and never counts as zero. Play every level of Latch or Foresight yourself to get a score calculated like the models’.

Reasoning efficiency

Good results with little thinking score high. On each task, a model’s result and reasoning tokens are compared with every other model and combined with the Balanced Integration Score (Liesefeld & Janczyk, 2019); 50 is average. Single step shows how much reasoning a model needs to understand and solve one problem, multi-step how efficiently it keeps working on a task by building on its earlier reasoning, as in agentic workflows. Not part of StealthMark.

BENCHMARK RESULTS

Compare results

This link opens the same results in the same order.

StealthMark benchmark results

Reset benchmark preferences?

Return to the default view, clear comparison selections and restore the advertisement.