Gemma 4 31B 30.2/100Rank 30/47

STEALTHMARK · HEAD TO HEAD
All comparisons ↗Muse Spark Open leads Gemma 4 31B by 18.3 points on StealthMark, 44.1 to 25.8. It leads on 7 of 9 benchmarks, including Latch, and Gemma 4 31B on 2, including Foresight. Muse Spark Open scores higher on Ground Truth.
See the difference ↘On every task, result quality and reasoning tokens are each compared with all measured models and weighed equally. Each dot is one model.
BENCHMARK BY BENCHMARK
DATASHEET
Gemma 4 31B is 11× cheaper per output token. Muse Spark Open scores higher on StealthMark, takes 4× more context and runs 3.1× faster in our speed test.
Full datasheets, every price and sourceGemma 4 31B ↗Muse Spark Open ↗
Anticipating threats and planning ahead. Collect coins while avoiding ghosts. Ghosts move before the player each turn, and collisions cost a life. 3 levels in sequence, up to 66 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.


Cooperative planning and learning from experience. Coordinate two robots to push numbered cores onto matching sockets. Pressure plates hold doors open; moving either robot uses one turn. 5 levels in sequence, up to 152 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.


Physics, perspective and recursive reflections, tested together. Explore the test ↗


Gemma 4 31B
The sphere's volume, separate airborne black blob and vertical color ordering are readable. The large, low sphere, plain surrounding planes and absent nested optical imagery leave the central geometric and reflection requirements unsupported. Paint contact and transport remain unresolved. Material credit recognizes the visible convex shading, highlights and distinct surface colors while retaining deductions for the schematic finish and oversized blobs.
Muse Spark Open
The airborne black blob and deformed paint support the broad contact sequence, although cyan attachment and wheel-directed transport remain partial. The sphere and black blob have substantial framing errors. The dominant limitation is the largely absent mirror system: faint wall circles and isolated highlights provide little evidence of recursive room geometry or curved nested reflections. Oversized compact paint features and diffuse material treatment further limit credit.
| Category | Gemma 4 31B | Muse Spark Open |
|---|---|---|
| State at 600 ms | 11.0/25 | 14.0/25 |
| Camera and placement | 3.0/15 | 6.0/15 |
| Reflections | 0.0/120 | 8.0/120 |
| Materials and scale | 5.5/10 | 3.5/10 |
| Floor-damage reward | 0.0/10 | 0.0/10 |
A spinning metal sphere and paint in a mirrored room test physical reasoning, perspective and consistency across repeated reflections.
Visual construction and creative interpretation.


Gemma 4 31B
A clean, appealing luminous mascot with coherent body continuity and a readable jar-hugging pose. Rounded highlights, smooth gradients and balanced framing work well. The teardrop silhouette, modest eyes and nearly even grin only partly satisfy the character brief; sparse jar construction and simple geometry limit sophistication.
Muse Spark Open
The rounded silhouette and asymmetric expression make an appealing baby elephant, supported by a quiet background and grounding shadow. The protective action remains difficult to read: forefeet cannot be confidently traced into a grip, and seed contact is crowded by fine lines. Controlled simple shapes provide charm, but limited anatomical clarity, shading and surface detail leave the execution uneven.
| Category | Gemma 4 31B | Muse Spark Open |
|---|---|---|
| Task & likeness | 6.0/10 | 5.0/10 |
| Anatomy & construction | 6.0/10 | 4.5/10 |
| Space & placement | 7.5/10 | 6.0/10 |
| Light & reflections | 6.5/10 | 5.0/10 |
| Purposeful detail | 5.5/10 | 6.0/10 |
| Artistry & character | 5.0/10 | 5.0/10 |
| Materials & effects | 6.5/10 | 5.0/10 |
| Visual integrity | 7.5/10 | 6.5/10 |
Gemma 4 31B
A small luminous creature proudly holding an empty glass jar tests expression, transparent materials and the balance of character and prop.
Muse Spark Open
A small elephant protecting a delicate seed tests expressive anatomy, physical contact and contrasting organic materials.
Precise visual recall and portrait reconstruction.


Gemma 4 31B
The portrait is recognizable through its silhouette, palette and smile, with clean execution of simple shapes. Replication remains weak: the face and pose differ markedly, hands become fingerless ovals, clothing lacks construction, and the landscape loses its atmospheric detail. Basic gradients provide limited volume.
Muse Spark Open
A recognizable, orderly interpretation with clean major contours, connected body forms and modest facial shading. Wide eyes, frontal symmetry and schematic hands limit likeness and expression. Layered scenery establishes basic depth, but shallow arm overlaps, flat clothing and sparse fine detail keep the execution basic and uneven.
| Category | Gemma 4 31B | Muse Spark Open |
|---|---|---|
| Task & likeness | 3.0/10 | 3.0/10 |
| Anatomy & construction | 4.0/10 | 3.0/10 |
| Space & placement | 4.0/10 | 5.0/10 |
| Light & reflections | 3.5/10 | 4.5/10 |
| Purposeful detail | 2.0/10 | 4.0/10 |
| Artistry & character | 3.5/10 | 3.0/10 |
| Materials & effects | 2.5/10 | 4.0/10 |
| Visual integrity | 5.5/10 | 6.0/10 |
An SVG interpretation of the Mona Lisa tests facial likeness, anatomy and the composition of a familiar portrait.
Creativity, perspective and visual beauty.


Gemma 4 31B
A coherent beach illustration with clean silhouettes, a sweeping shoreline and an effective sunset palette. Requested subjects are recognizable, but primitive animal construction, sparse detail, unsupported palm placement and schematic reflections limit drawing sophistication and physical credibility.
Muse Spark Open
A coherent sunset beach with readable activities, balanced framing and controlled colour transitions. Small accessories add interest, but schematic anatomy, limited surface detail, weak directional shadows and a geometric reflection constrain its finish. Most shapes and overlaps remain clean.
| Category | Gemma 4 31B | Muse Spark Open |
|---|---|---|
| Task & likeness | 5.0/10 | 8.0/10 |
| Anatomy & construction | 2.0/10 | 6.0/10 |
| Space & placement | 5.0/10 | 6.5/10 |
| Light & reflections | 2.5/10 | 5.5/10 |
| Purposeful detail | 2.0/10 | 6.5/10 |
| Artistry & character | 2.0/10 | 5.5/10 |
| Materials & effects | 2.0/10 | 6.0/10 |
| Visual integrity | 5.0/10 | 8.0/10 |
A busy shoreline at sunset tests scene composition, animal forms and the relationship between light and water reflections.
Physical reasoning, light and visual reconstruction.


Gemma 4 31B
This benchmark has not been assessed yet.
Muse Spark Open
This benchmark has not been assessed yet.
A plank, computer mouse and blueberry in a steel room test physical stability, spatial relationships, materials and lighting.
Scene composition and interacting subjects.


Gemma 4 31B
Clean, simple silhouettes communicate a raccoon riding on a dog. Limited animal specificity, absent steering controls and a flat platform weaken the requested scene. Small facial marks provide purposeful detail, while unresolved support, flat lighting and schematic water restrict physical coherence. Primitive but coherent construction supports basic drawing quality.
Muse Spark Open
Expressive faces, distinct accessories and clean color separation make the scene appealing and recognizable. Character detail is stronger than the functional construction: steering contact, limb overlaps and seating remain ambiguous. The readable hull and lively spray establish motion, while limited directional shading and simplified surfaces constrain depth and physical coherence.
| Category | Gemma 4 31B | Muse Spark Open |
|---|---|---|
| Task & likeness | 2.5/10 | 4.0/10 |
| Anatomy & construction | 3.0/10 | 3.0/10 |
| Space & placement | 4.0/10 | 6.0/10 |
| Light & reflections | 1.0/10 | 4.5/10 |
| Purposeful detail | 2.5/10 | 7.0/10 |
| Artistry & character | 2.5/10 | 3.5/10 |
| Materials & effects | 2.0/10 | 5.0/10 |
| Visual integrity | 7.0/10 | 5.0/10 |
A jet-ski scene pairs a canine driver with a raccoon passenger. It tests the placement and contact of interacting subjects, along with vehicle construction.
Subject construction and spatial relationships.


Gemma 4 31B
A clean, readable illustration with balanced placement and coherent basic geometry. The sky gradient and ground shadow establish diffuse illumination. Primitive shapes and sparse detail limit artistry, while unclear leg attachment, missing pedal contact and unresolved steering weaken the riding action.
Muse Spark Open
A controlled, appealing cartoon with a recognizable pelican, expressive face and clean curved forms. Feather lines, spokes and bill shading provide useful complexity. Aligned wheels and a ground shadow establish placement, but uncertain pedal contacts and obscured mechanical connections weaken support and riding action. Lighting remains loosely coordinated with the sun.
| Category | Gemma 4 31B | Muse Spark Open |
|---|---|---|
| Task & likeness | 4.0/10 | 7.5/10 |
| Anatomy & construction | 3.0/10 | 5.0/10 |
| Space & placement | 4.5/10 | 6.0/10 |
| Light & reflections | 5.0/10 | 5.0/10 |
| Purposeful detail | 3.0/10 | 6.5/10 |
| Artistry & character | 3.0/10 | 5.5/10 |
| Materials & effects | 4.0/10 | 6.0/10 |
| Visual integrity | 4.5/10 | 7.5/10 |
A cycling pelican tests anatomy, riding posture and contact between the bird and the bicycle.