stealthmodels.

MODEL BENCHMARKS

Iceman Contributor Benchmarks

Explore Iceman Contributor’s StealthMark scores, benchmark results and researcher observations. Read the Iceman Contributor model guide →

BENCHMARK BY BENCHMARK

Iceman Contributor benchmark scores

StealthMark
19.8/100Overall rank 47/53
General Intelligence
11.9/100
Visual Intelligence
32.2/100

Iceman ContributorOther modelsMedian

Reasoning efficiency

On every task, result quality and reasoning tokens are each compared with all measured models and weighed equally. Each dot is one model.

Single-step reasoningResult quality weighed against reasoning tokens on a single problemRank 49/51
Multi-step reasoningResult quality weighed against reasoning tokens across connected steps, as in agentic workflowsRank 25/47

DATASHEET

Iceman Contributor speed

Iceman ContributorOther modelsMedian

Output speedTokens per second, our measurement
46 tokens/sFaster than 1 of 50 others

GAME BENCHMARKS

Watch Iceman Contributor play

Foresight

Anticipating threats and planning ahead

3.2/100Rank 47/47
Survived 0 of 3
Foresight: complete playing field
Level 31 ptsTurn 7 / 20

Points per level

  1. Level 1Second Thoughts0 ptsBest 27Out of lives
  2. Level 2Pressure Pot3 ptsBest 13Out of lives
  3. Level 3Hide or Flight1 ptsBest 19Out of lives

Collect coins while avoiding ghosts. Ghosts move before the player each turn, and collisions cost a life. 3 levels in sequence, up to 66 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.

Latch

Cooperative planning and learning from experience

3.6/100Rank 44/48
Cleared 1 of 5
Latch: complete playing field
Level 55 ptsTurn 25 / 40

Points per level

  1. Level 1Hold the door5.2 ptsBest 5.2Cleared
  2. Level 2Crossfeed2.8 ptsBest 10.2Finished early
  3. Level 3Relay vault2.2 ptsBest 19.2Finished early
  4. Level 4Passing bay4 ptsBest 18.2Finished early
  5. Level 5Second thoughts5 ptsBest 20.6Finished early

Coordinate two robots to push numbered cores onto matching sockets. Pressure plates hold doors open; moving either robot uses one turn. 5 levels in sequence, up to 152 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.

Iceman Contributor benchmark results ↗

StealthMark score

StealthMark measures how well a model’s abilities carry over to original, demanding tasks it could not have trained for: physical and spatial reasoning, planning across many steps, and precise visual work. How StealthMark works explains every benchmark, what it tests and why it is hard.

General Intelligence

The ability to reason, plan, solve problems and understand how things relate and behave. A high score means it thinks hard problems through, from careful analysis to plans that span many steps.

Visual Intelligence

The ability to understand visual intent and turn ideas, descriptions and plans into coherent, effective visuals. A high score means design ideas come out the way you meant them, in illustrations, icons, diagrams or interface visuals.

Overall score

Overall shows how well a model’s abilities carry over to original, demanding tasks, weighting every benchmark into one score from 0 to 100. Estimated means the total includes an estimate for one missing scene.

Judging

Scores reflect how well each result meets the benchmark requirements. Game scores come from the recorded play: the points earned on each level and how each level ended. How StealthMark keeps scores honest.

Games

Each game is a sequence of levels, and earlier moves carry into later levels. A level that was not played is shown as not played and never counts as zero. Play every level of Latch or Foresight yourself to get a score calculated like the models’.

Reasoning efficiency

Good results with little thinking score high. On each task, a model’s result and reasoning tokens are compared with every other model and combined with the Balanced Integration Score (Liesefeld & Janczyk, 2019); 50 is average. Single step shows how much reasoning a model needs to understand and solve one problem, multi-step how efficiently it keeps working on a task by building on its earlier reasoning, as in agentic workflows. Not part of StealthMark.

BENCHMARK RESULTS

Compare results

This link opens the same results in the same order.

StealthMark benchmark results

Reset benchmark preferences?

Return to the default view, clear comparison selections and restore the advertisement.