STEALTHMARK · HEAD TO HEAD

All comparisons ↗

Gemma 4 31B vs Qwen3.8 27B

Qwen3.8 27B scores 24.2 points higher overall (50.1 vs 25.9). Qwen3.8 27B scores higher on Newton's Mirror, with its largest category advantage in reflections.

See the difference ↘
All results ↗
All results ↗

Overall StealthMark

25.9/100
50.1/100

General Intelligence

13.9/100
39.5/100

Visual Intelligence

40.1/100
62.8/100

Newton's Mirror

Same prompt

Physics, perspective and recursive reflections, tested together. Explore the test ↗

Gemma 4 31B15.4/100

Gemma 4 31B: Newton's Mirror SVG benchmark
Researcher observations

The sphere's volume, separate airborne black blob and vertical color ordering are readable. The large, low sphere, plain surrounding planes and absent nested optical imagery leave the central geometric and reflection requirements unsupported. Paint contact and transport remain unresolved. Material credit recognizes the visible convex shading, highlights and distinct surface colors while retaining deductions for the schematic finish and oversized blobs.

Benchmark task

A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.

Qwen3.8 27B37.6/100

Qwen3.8 27B: Newton's Mirror SVG benchmark
Researcher observations

The room fills the complete 16:9 frame without visible borders or labels. Central placement fits the wider frame, and the paint colors follow the expected vertical order. Bilateral side images, diminishing echoes and an overlapping floor image provide limited mirror depth. Broad sphere surfaces lack ordered nested room imagery, while planar panel sequences and outer chains remain missing or unresolved. Soft highlights do not establish emitter mapping, while paint attachment and transport history are only partly supported.

Benchmark task

A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.

Compare category scores
CategoryGemma 4 31BQwen3.8 27B
State at 600 ms8.0/2517.5/25
Camera and placement3.0/1513.0/15
Reflections0.0/12022.5/120
Materials and scale6.0/107.0/10
Floor-damage reward0.0/100.0/10

Selfie

Different prompts

Gemma 4 31B60.9/100

Gemma 4 31B: Selfie SVG benchmark
Researcher observations

A clean, appealing luminous mascot with coherent body continuity and a readable jar-hugging pose. Rounded highlights, smooth gradients and balanced framing work well. The teardrop silhouette, modest eyes and nearly even grin only partly satisfy the character brief; sparse jar construction and simple geometry limit sophistication.

Prompt withheld

Prompt withheld.

Qwen3.8 27B77.5/100

Qwen3.8 27B: Selfie SVG benchmark
Researcher observations

A cohesive emerald-and-gold illustration with a gentle expression, flowing robes, luminous halo and three clearly ringed orbs. Limbs remain connected, and the asymmetric legs communicate floating. The rounded face reads somewhat bear-like; the raised palm faces outward rather than upward, and chest-hand fingers are crowded. Clean ornamentation exceeds the comparatively simple anatomical modeling and shading.

Benchmark task

Draw a friendly capybara floating in ornate green and white robes. A glowing halo and small floating orbs surround it, giving it the feel of a gentle fantasy guide.

Compare category scores
CategoryGemma 4 31BQwen3.8 27B
Prompt & likeness6.0/108.0/10
Anatomy & construction6.0/107.5/10
Space & placement7.5/108.0/10
Light & reflections6.5/107.5/10
Purposeful detail5.5/108.0/10
Artistry & character5.0/107.5/10
Materials & effects6.5/107.5/10
Visual integrity7.5/108.5/10

Mona Lisa

Different prompts

Gemma 4 31B35.1/100

Gemma 4 31B: Mona Lisa SVG benchmark
Researcher observations

The portrait is recognizable through its silhouette, palette and smile, with clean execution of simple shapes. Replication remains weak: the face and pose differ markedly, hands become fingerless ovals, clothing lacks construction, and the landscape loses its atmospheric detail. Basic gradients provide limited volume.

Benchmark task

Replicate mona-lisa as SVG

Qwen3.8 27B47.2/100

Qwen3.8 27B: Mona Lisa SVG benchmark
Researcher observations

The centered portrait, dark clothing and overlapping hands evoke the Mona Lisa, but replication is weak. The face is excessively elongated, the eyes stare broadly, and the hands reduce to rounded masses with shallow finger marks. Soft shading creates some volume, while the landscape remains indistinct. The precise gold frame is more resolved than the portrait.

Benchmark task

Replicate mona-lisa as SVG

Compare category scores
CategoryGemma 4 31BQwen3.8 27B
Prompt & likeness3.0/104.0/10
Anatomy & construction4.0/104.5/10
Space & placement4.0/104.5/10
Light & reflections3.5/105.0/10
Purposeful detail2.0/105.0/10
Artistry & character3.5/105.0/10
Materials & effects2.5/105.0/10
Visual integrity5.5/105.0/10

Beach

Same prompt

Gemma 4 31B29.2/100

Gemma 4 31B: Beach SVG benchmark
Researcher observations

A coherent beach illustration with clean silhouettes, a sweeping shoreline and an effective sunset palette. Requested subjects are recognizable, but primitive animal construction, sparse detail, unsupported palm placement and schematic reflections limit drawing sophistication and physical credibility.

Benchmark task

Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections

Qwen3.8 27B69.3/100

Qwen3.8 27B: Beach SVG benchmark
Researcher observations

The sweeping palm, glowing sunset and purple-to-orange palette create an appealing beach composition. Birds, animals and reflections fulfill the brief, with clean silhouettes and readable small accents. Schematic anatomy, repetitive shoreline geometry and limited perspective integration constrain depth. Foreground lighting and uniform reflection bars provide atmosphere but little physical coherence.

Benchmark task

Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections

Compare category scores
CategoryGemma 4 31BQwen3.8 27B
Prompt & likeness5.0/108.5/10
Anatomy & construction2.0/106.5/10
Space & placement5.0/106.0/10
Light & reflections2.5/106.0/10
Purposeful detail2.0/107.0/10
Artistry & character2.0/107.0/10
Materials & effects2.0/106.5/10
Visual integrity5.0/107.5/10

Ground Truth

Same prompt

Gemma 4 31B12.0/100

Gemma 4 31B: Ground Truth SVG benchmark
Benchmark task

A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.

Qwen3.8 27B40.2/100

Qwen3.8 27B: Ground Truth SVG benchmark
Benchmark task

A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.

Raccoon

Same prompt

Gemma 4 31B38.2/100

Gemma 4 31B: Raccoon SVG benchmark
Researcher observations

Clean, simple silhouettes communicate a raccoon riding on a dog. Limited animal specificity, absent steering controls and a flat platform weaken the requested scene. Small facial marks provide purposeful detail, while unresolved support, flat lighting and schematic water restrict physical coherence. Primitive but coherent construction supports basic drawing quality.

Benchmark task

Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski

Qwen3.8 27B67.7/100

Qwen3.8 27B: Raccoon SVG benchmark
Researcher observations

The raccoon clearly rides on the dog's back, and the dog reaches the jet ski's steering grip. Cheerful expressions, a bright palette and sweeping wake make the action readable. Anatomy and machinery remain simplified, with overlapping paws and limited seat definition. Flat lighting, sparse surface detail and broad white splash shapes limit depth and finish. A clipped gray fragment interrupts the upper-left corner.

Benchmark task

Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski

Compare category scores
CategoryGemma 4 31BQwen3.8 27B
Prompt & likeness4.5/108.5/10
Anatomy & construction4.0/106.5/10
Space & placement4.0/107.0/10
Light & reflections1.0/105.5/10
Purposeful detail3.0/106.5/10
Artistry & character4.0/106.5/10
Materials & effects2.0/106.5/10
Visual integrity8.0/107.5/10

Pelican

Same prompt

Gemma 4 31B50.5/100

Gemma 4 31B: Pelican SVG benchmark
Researcher observations

A clean, readable illustration with balanced placement and coherent basic geometry. The sky gradient and ground shadow establish diffuse illumination. Primitive shapes and sparse detail limit artistry, while unclear leg attachment, missing pedal contact and unresolved steering weaken the riding action.

Benchmark task

Generate an SVG of a pelican riding a bicycle

Qwen3.8 27B70.5/100

Qwen3.8 27B: Pelican SVG benchmark
Researcher observations

The pelican’s oversized bill, straw hat and flowing scarf create a distinctive focal character against a well-composed coastal sunset. Wheels and frame are readable, but the wings do not reach the steering, overlapping legs obscure separate pedal contacts, and the crank linkage is unclear. Clean vector shapes and restrained shading support an appealing illustration with limited physical depth.

Benchmark task

Generate an SVG of a pelican riding a bicycle

Compare category scores
CategoryGemma 4 31BQwen3.8 27B
Prompt & likeness6.0/108.0/10
Anatomy & construction4.0/105.5/10
Space & placement6.0/107.0/10
Light & reflections5.0/107.0/10
Purposeful detail3.5/107.5/10
Artistry & character4.0/107.5/10
Materials & effects4.0/106.5/10
Visual integrity8.0/108.0/10