STEALTHMARK · THREE-MODEL COMPARISON

All comparisons ↗

Qwen3.8-27B vs Gemma 4 31B vs Gemma 4 26B A4B

Qwen3.8-27B leads on StealthMark with 51.7, ahead of Gemma 4 31B (29.5) and Gemma 4 26B A4B (21.2). Of the 9 benchmarks compared, Qwen3.8-27B leads on 9. Qwen3.8-27B leads both games.

Overall StealthMark

51.7/100Overall rank 16/55
29.5/100Overall rank 45/55
21.2/100Overall rank 48/55

General Intelligence

46.2/100
24.2/100
11.6/100

Visual Intelligence

61.4/100
38.1/100
37.8/100

Reasoning efficiency

How many reasoning tokens a model needs for the quality it delivers.

Single-step reasoning How much it reasons to understand a task

Multi-step reasoning How much it keeps reasoning as a task goes on

  • Gemma 4 26B A4B

Cost efficiency

How much Performance you get for your money.

Open or local

Local modelOpen model · Apache-2.0
Local modelOpen model · Apache 2.0
Local modelOpen model · Apache 2.0

BENCHMARK BY BENCHMARK

Where each model leads

  • Qwen3.8-27B
  • Gemma 4 31B
  • Gemma 4 26B A4B
  • Other models
  • Median

DATASHEET

Specs and pricing

Qwen3.8-27B scores highest on StealthMark and takes the longest context. Gemma 4 31B runs fastest in our speed test. Gemma 4 26B A4B costs least per output token.

  • Qwen3.8-27B
  • Gemma 4 31B
  • Gemma 4 26B A4B
  • Other models
  • Median
PricePer 1M output tokens, input below
Qwen3.8-27B: $1.70$0.42 inputGemma 4 31B: $0.40$0.14 inputGemma 4 26B A4B: $0.3033% cheaper$0.09 input
Context windowTokens per request, max output below
Qwen3.8-27B: 1M3.8× larger128K max outputGemma 4 31B: 256KGemma 4 26B A4B: 256K
Output speedTokens per second, our measurement
Qwen3.8-27B: 78tokens/sGemma 4 31B: 11622% fastertokens/sGemma 4 26B A4B: 95tokens/s
SizeTotal and active parameters
Qwen3.8-27B: 27BAll activeEstimatedGemma 4 31B: 30.7BAll activeEstimatedGemma 4 26B A4B: 25.2B3.8B active
Developer
QwenGoogle DeepMindGoogle DeepMind
Released
14 Aug 20262 Apr 20262 Apr 2026
Origin
ChinaUnited StatesUnited States
Input → output
Text, image, video → textText, image → textText, image → text
Architecture
Dense causal language model with vision encoder; hybrid Gated DeltaNet and gated attention; MTP-trainedDense multimodal transformer with interleaved sliding-window and global attentionMixture-of-Experts multimodal transformer with interleaved sliding-window and global attention

Full datasheets, every price and sourceQwen3.8-27B ↗Gemma 4 31B ↗Gemma 4 26B A4B ↗

Anticipating threats and planning ahead. Collect coins while avoiding ghosts. Ghosts move before the player each turn, and collisions cost a life. 3 levels in sequence, up to 66 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.

Qwen3.8-27B 63.0/100Rank 7/51

Survived 1 of 3
Foresight: complete playing field
Level 311 ptsTurn 16 / 20

Gemma 4 31B 30.2/100Rank 31/51

Survived 0 of 3
Foresight: complete playing field
Level 38 ptsTurn 15 / 20

Gemma 4 26B A4B 4.1/100Rank 50/51

Survived 0 of 3
Foresight: complete playing field
Level 32 ptsTurn 9 / 20

Points per level

LevelQwen3.8-27BGemma 4 31BGemma 4 26B A4B
Level 1Second Thoughts
26 ptsSurvived
9 ptsOut of lives
3 ptsOut of lives
Level 2Pressure Pot
12 ptsOut of lives
6 ptsOut of lives
2 ptsOut of lives
Level 3Hide or Flight
11 ptsOut of lives
8 ptsOut of lives
2 ptsOut of lives

Cooperative planning and learning from experience. Coordinate two robots to push numbered cores onto matching sockets. Pressure plates hold doors open; moving either robot uses one turn. 5 levels in sequence, up to 152 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.

Qwen3.8-27B 38.6/100Rank 32/52

Cleared 2 of 5
Latch: complete playing field
Level 515.8 ptsTurn 31 / 40

Gemma 4 31B 26.6/100Rank 43/524 of 5 levels

4 of 5 played
Latch: complete playing field
Level 42.2 ptsTurn 39 / 40

Gemma 4 26B A4B 4.5/100Rank 45/52

Cleared 2 of 5
Latch: complete playing field
Level 53 ptsTurn 40 / 40

Points per level

LevelQwen3.8-27BGemma 4 31BGemma 4 26B A4B
Level 1Hold the door
5.2 ptsCleared
5.2 ptsCleared
3 ptsCleared1 beacon left
Level 2Crossfeed
9.8 ptsCleared
9 ptsCleared
6.2 ptsFinished early
Level 3Relay vault
11.2 ptsFinished early
13.2 ptsFinished early
15.2 ptsClearedFinished early · 3 beacons left
Level 4Passing bay
13.2 ptsFinished early
2.2 ptsFinished early
11.8 ptsFinished early
Level 5Second thoughts
15.8 ptsFinished early
Not played
3 ptsOut of turns

Newton's Mirror

Same task instructions

Physics, perspective and recursive reflections, tested together. Explore the test ↗

The judgment

Qwen3.8-27B

The room fills the complete 16:9 frame without visible borders or labels. Central placement fits the wider frame, and the paint colors follow the expected vertical order. Bilateral side images, diminishing echoes and an overlapping floor image provide limited mirror depth. Broad sphere surfaces lack ordered nested room imagery, while planar panel sequences and outer chains remain missing or unresolved. Soft highlights do not establish emitter mapping, while paint attachment and transport history are only partly supported.

Gemma 4 31B

The separate airborne black blob and simplified lower sphere image provide limited agreement. The enlarged, lowered main sphere, unsupported paint interaction histories and largely missing mirror-room structure remain major departures. No visible floor damage supports the separate reward. The retained base total is 29.5/170, and the combined total is 29.5/180.

Gemma 4 26B A4B

The candidate demonstrates a rounded sphere, deformed colored regions and separate airborne black paint. Its paint marks do not adequately establish the required contact and transport history. Enlarged framing and almost entirely missing mirror structure remain the dominant failures. The physical-state score is reduced because endpoint checks alone previously left too much credit for an unverified interaction history.

Score breakdown

CategoryQwen3.8-27BGemma 4 31BGemma 4 26B A4B
State at 600 ms23.0/2511.0/2514.0/25
Camera and placement13.0/154.5/154.0/15
Reflections24.0/1208.0/1202.0/120
Materials and scale6.5/106.0/105.0/10
Floor-damage reward0.0/100.0/100.0/10

Benchmark task

A spinning metal sphere and paint in a mirrored room test physical reasoning, perspective and consistency across repeated reflections.

Selfie

Different task instructions

Visual construction and creative interpretation.

The judgment

Qwen3.8-27B

A cohesive emerald-and-gold illustration with a gentle expression, flowing robes, luminous halo and three clearly ringed orbs. Limbs remain connected, and the asymmetric legs communicate floating. The rounded face reads somewhat bear-like; the raised palm faces outward rather than upward, and chest-hand fingers are crowded. Clean ornamentation exceeds the comparatively simple anatomical modeling and shading.

Gemma 4 31B

A clean, appealing luminous mascot with coherent body continuity and a readable jar-hugging pose. Rounded highlights, smooth gradients and balanced framing work well. The teardrop silhouette, modest eyes and nearly even grin only partly satisfy the character brief; sparse jar construction and simple geometry limit sophistication.

Gemma 4 26B A4B

A clean, appealing glowing creature with big upward eyes, uneven brows, rosy cheeks and the requested colour gradient. The body is a teardrop rather than a four-point diamond, and the jar is a flat rounded glass panel with no rim or opening. Loose oval hands and feet only suggest the hug and the stance, and the grin is drawn over the glass. Its construction is basic and primitive.

Score breakdown

CategoryQwen3.8-27BGemma 4 31BGemma 4 26B A4B
Task & likeness8.0/106.0/106.0/10
Anatomy & construction7.5/106.0/104.5/10
Space & placement8.0/107.5/105.5/10
Light & reflections7.5/106.5/106.0/10
Purposeful detail8.0/105.5/104.5/10
Artistry & character7.5/105.0/104.0/10
Materials & effects7.5/106.5/106.0/10
Visual integrity8.5/107.5/106.5/10

Benchmark task

Qwen3.8-27B

A floating capybara in ornate robes tests character anatomy, layered fabric and the placement of surrounding luminous forms.

Gemma 4 31B

A small luminous creature proudly holding an empty glass jar tests expression, transparent materials and the balance of character and prop.

Gemma 4 26B A4B

A small luminous creature proudly holding an empty glass jar tests expression, transparent materials and the balance of character and prop.

Mona Lisa

Different task instructions

Precise visual recall and portrait reconstruction.

The judgment

Qwen3.8-27B

The centered portrait, dark clothing and overlapping hands evoke the Mona Lisa, but replication is weak. The face is excessively elongated, the eyes stare broadly, and the hands reduce to rounded masses with shallow finger marks. Soft shading creates some volume, while the landscape remains indistinct. The precise gold frame is more resolved than the portrait.

Gemma 4 31B

A coherent but rudimentary interpretation. Dark hair, muted scenery and a slight smile establish recognition, while primitive facial features, frontal construction and an undivided hand shape leave the defining portrait relationships unresolved. Sparse detail and predominantly flat rendering limit volume and material character.

Gemma 4 26B A4B

Dark framing hair and a faint smile give limited recognition. The mask-like elongated face, the missing arms and crossed hands, and the absent landscape leave the painting barely replicated. A few coherent flat shapes form a centered bust, but the construction is very primitive and nearly free of detail, and soft gradients do not create convincing volume or finish.

Score breakdown

CategoryQwen3.8-27BGemma 4 31BGemma 4 26B A4B
Task & likeness4.0/102.0/102.0/10
Anatomy & construction4.5/102.5/103.5/10
Space & placement4.5/103.5/103.0/10
Light & reflections5.0/102.0/103.5/10
Purposeful detail5.0/102.0/101.5/10
Artistry & character5.0/102.0/103.0/10
Materials & effects5.0/102.5/102.5/10
Visual integrity5.0/105.0/106.0/10

Benchmark task

An SVG interpretation of the Mona Lisa tests facial likeness, anatomy and the composition of a familiar portrait.

Beach

Same task instructions

Creativity, perspective and visual beauty.

The judgment

Qwen3.8-27B

The sweeping palm, glowing sunset and purple-to-orange palette create an appealing beach composition. Birds, animals and reflections fulfill the brief, with clean silhouettes and readable small accents. Schematic anatomy, repetitive shoreline geometry and limited perspective integration constrain depth. Foreground lighting and uniform reflection bars provide atmosphere but little physical coherence.

Gemma 4 31B

A balanced beach sunset with a bright glowing sun and two framing palms. The palms have flower-like radial crowns, the crab is a small top-down symbol and the ball's panels do not line up. The three olive reflection ovals and bare sand and water make for a sparse scene with little drawing complexity, depth or material detail.

Gemma 4 26B A4B

A clean, coherent sunset with the sun resting on the horizon and a framing palm. The scene is very sparse: a tiny crab seen from above, a flat two-colour ball and three bird arcs carry all of the animals and fun. Grey-green reflection ovals, bare sand and water, and almost no attempted detail keep construction, light and artistry primitive.

Score breakdown

CategoryQwen3.8-27BGemma 4 31BGemma 4 26B A4B
Task & likeness8.5/106.0/106.0/10
Anatomy & construction6.5/104.0/104.0/10
Space & placement6.0/104.5/104.5/10
Light & reflections6.0/104.5/104.5/10
Purposeful detail7.0/103.5/103.0/10
Artistry & character7.0/103.5/103.5/10
Materials & effects6.5/103.5/103.5/10
Visual integrity7.0/105.5/106.0/10

Benchmark task

A busy shoreline at sunset tests scene composition, animal forms and the relationship between light and water reflections.

Ground Truth

Same task instructions

Physical reasoning, light and visual reconstruction.

The judgment

Qwen3.8-27B

This benchmark has not been assessed yet.

Gemma 4 31B

This benchmark has not been assessed yet.

Gemma 4 26B A4B

This benchmark has not been assessed yet.

Benchmark task

A plank, computer mouse and blueberry in a steel room test physical stability, spatial relationships, materials and lighting.

Raccoon

Same task instructions

Scene composition and interacting subjects.

The judgment

Qwen3.8-27B

The raccoon clearly rides on the dog's back, and the dog reaches the jet ski's steering grip. Cheerful expressions, a bright palette and sweeping wake make the action readable. Anatomy and machinery remain simplified, with overlapping paws and limited seat definition. Flat lighting, sparse surface detail and broad white splash shapes limit depth and finish. A clipped gray fragment interrupts the upper-left corner.

Gemma 4 31B

A very primitive cartoon: a grey raccoon blob with a mask and a banded tail rests on an oval dog with goggles, on a flat red parallelogram that barely suggests a jet ski. Limbs are stubs or absent, the long dark bar does not read as steering and the craft has no hull volume. Sky and water gradients and simple wake lines set the scene, but the construction stays kindergarten-level.

Gemma 4 26B A4B

A tidy but very primitive scene: an oval dog with a frontal face lies on a red trapezoid raft, with a grey raccoon blob on its back. The raccoon has cat-like ears and an unbanded tail, and neither animal has readable limbs. There is no seat, hull or attached steering, and the deck fades into a pale band above the horizon. Smooth sky and water gradients and a clear palette are the main strengths.

Score breakdown

CategoryQwen3.8-27BGemma 4 31BGemma 4 26B A4B
Task & likeness8.5/104.5/104.0/10
Anatomy & construction6.5/103.0/103.0/10
Space & placement7.0/104.5/104.5/10
Light & reflections5.5/103.0/104.0/10
Purposeful detail6.5/103.5/103.5/10
Artistry & character6.5/103.0/103.0/10
Materials & effects6.5/104.0/103.5/10
Visual integrity7.5/105.0/104.5/10

Benchmark task

A jet-ski scene pairs a canine driver with a raccoon passenger. It tests the placement and contact of interacting subjects, along with vehicle construction.

Pelican

Same task instructions

Subject construction and spatial relationships.

The judgment

Qwen3.8-27B

The pelican’s oversized bill, straw hat and flowing scarf create a distinctive focal character against a well-composed coastal sunset. Wheels and frame are readable, but the wings do not reach the steering, overlapping legs obscure separate pedal contacts, and the crank linkage is unclear. Clean vector shapes and restrained shading support an appealing illustration with limited physical depth.

Gemma 4 31B

A clean, cheerful pelican with a curved neck and bright bill sits on a simple red frame. The drawing is primitive: ellipse body, tube neck, flat fills and straight frame lines with no spokes, crank or pedals. Both legs end in footless stubs in mid-air, and neither wing reaches the handlebar, so the riding action is not demonstrated. A ground shadow gives basic anchoring; lighting and materials stay flat.

Gemma 4 26B A4B

A recognisable pelican with a long neck and bright pouched bill stands upright on a simple teal bicycle against gradient sky and grass. One straight, jointless leg reaches a pedal, but the wing does not touch the handlebar, so riding is only partly shown. The frame lacks seat stays, the crank is a stub and the wheels carry only crossbar spokes. Construction stays elementary, with flat fills and little modelling despite the visible sun.

Score breakdown

CategoryQwen3.8-27BGemma 4 31BGemma 4 26B A4B
Task & likeness8.0/105.5/106.0/10
Anatomy & construction5.5/104.0/104.0/10
Space & placement7.0/105.0/105.0/10
Light & reflections7.0/103.5/103.5/10
Purposeful detail7.5/103.0/103.5/10
Artistry & character7.5/104.0/104.0/10
Materials & effects6.5/103.5/103.5/10
Visual integrity8.0/105.0/106.0/10

Benchmark task

A cycling pelican tests anatomy, riding posture and contact between the bird and the bicycle.