STEALTHMARK · HEAD TO HEAD

All comparisons ↗

Claude Haiku 5.5 vs Gemma 4 26B A4B

Claude Haiku 5.5 scores 26.0 points higher overall (46.5 vs 20.5). Claude Haiku 5.5 scores higher on Newton's Mirror, with its largest category advantage in reflections.

See the difference ↘
All results ↗
All results ↗

Overall StealthMark

46.5/100
20.5/100

General Intelligence

40.8/100
12.2/100

Visual Intelligence

53.3/100
30.5/100

Newton's Mirror

Same prompt

Physics, perspective and recursive reflections, tested together. Explore the test ↗

Claude Haiku 5.540.0/100

Claude Haiku 5.5: Newton's Mirror SVG benchmark
Researcher observations

The centered sphere, compact airborne black blob and differentiated cyan/crimson interaction support substantial state and placement credit. The few recognizable sphere and panel images establish limited optical relationships, but most of the required mirror system is missing. Rounded volume and localized paint warrant substantial material credit despite the soft, illustrative finish.

Benchmark task

A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.

Gemma 4 26B A4B8.2/100

Gemma 4 26B A4B: Newton's Mirror SVG benchmark
Researcher observations

Separate airborne black and contact-compatible paint flattening earn partial state credit. Settlement, adhesion and differentiated paint transport remain unresolved. The enlarged, low sphere and thin lamp strip substantially depart from the required camera, while the defining mirror structure is missing. Weak material appearance and oversized black paint limit material credit. The retained base total is 18/170; the floor-damage reward is 0, giving 18/180.

Benchmark task

A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.

Compare category scores
CategoryClaude Haiku 5.5Gemma 4 26B A4B
State at 600 ms23.5/258.0/25
Camera and placement8.0/152.0/15
Reflections24.5/1200.0/120
Materials and scale7.5/102.0/10
Floor-damage reward0.0/100.0/10

Selfie

Different prompts

Claude Haiku 5.546.3/100

Claude Haiku 5.5: Selfie SVG benchmark
Researcher observations

A coherent coral squid emblem with a compact mantle, restrained face and clean centered presentation. Its radial silhouette and floating placement work, but sharp arm tips, crowded roots and sparse surface modeling limit softness, construction and finish.

Benchmark task

Draw a calm coral-red squid with eight thick arms spreading around it like flower petals. Keep the shape balanced and simple, with soft shading and a friendly face.

Gemma 4 26B A4B52.8/100

Gemma 4 26B A4B: Selfie SVG benchmark
Researcher observations

An appealing, readable sparkle-creature with luminous colour and expressive eyes. Simple geometric construction limits sophistication, while sharp body points, ambiguous hand contact and a minimally resolved jar weaken the requested soft, plump character and treasure-presenting pose.

Prompt withheld

Prompt withheld.

Compare category scores
CategoryClaude Haiku 5.5Gemma 4 26B A4B
Prompt & likeness6.5/105.5/10
Anatomy & construction4.0/104.5/10
Space & placement6.5/106.0/10
Light & reflections4.0/106.0/10
Purposeful detail3.5/105.5/10
Artistry & character3.5/104.0/10
Materials & effects4.5/106.0/10
Visual integrity7.0/107.0/10

Mona Lisa

Different prompts

Claude Haiku 5.538.6/100

Claude Haiku 5.5: Mona Lisa SVG benchmark
Researcher observations

A recognizable but basic Mona Lisa reinterpretation. Clean contours and smooth facial lighting provide coherence and volume. Replication remains limited by the frontal pose, elongated neck, schematic expression, unresolved crossed hands and sparse landscape. Lighting is more successful than anatomical construction and purposeful detail.

Benchmark task

Replicate mona-lisa as SVG

Gemma 4 26B A4B17.8/100

Gemma 4 26B A4B: Mona Lisa SVG benchmark
Researcher observations

The centered dark-haired portrait provides a loose reference cue, but its elongated, nearly featureless face and undifferentiated torso fall far short of replication. Crossed hands, the subtle smile, clothing structure and landscape are unresolved. Clean silhouettes and soft gradients provide limited coherence.

Benchmark task

Replicate mona-lisa as SVG

Compare category scores
CategoryClaude Haiku 5.5Gemma 4 26B A4B
Prompt & likeness3.0/100.5/10
Anatomy & construction4.0/102.0/10
Space & placement4.0/101.0/10
Light & reflections5.5/102.0/10
Purposeful detail2.5/101.0/10
Artistry & character3.5/102.0/10
Materials & effects2.5/101.0/10
Visual integrity5.5/104.5/10

Beach

Same prompt

Claude Haiku 5.571.9/100

Claude Haiku 5.5: Beach SVG benchmark
Researcher observations

A cheerful, coherent beach illustration with attractive sunset colors, readable accessories and clean silhouettes. Its sun and sailboat reflections establish useful physical relationships. Simple animal construction, flattened foreground placement, sparse directional shadows and minimally differentiated surfaces limit its drawing refinement.

Benchmark task

Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections

Gemma 4 26B A4B28.5/100

Gemma 4 26B A4B: Beach SVG benchmark
Researcher observations

A clean, balanced sunset scene demonstrates the beach, birds and a centered reflection. Animals and play receive only minimal treatment. Coherent layers and controlled gradients support readability, but unresolved aquatic anatomy, sparse details and weak surface modeling keep the drawing basic.

Benchmark task

Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections

Compare category scores
CategoryClaude Haiku 5.5Gemma 4 26B A4B
Prompt & likeness8.5/103.5/10
Anatomy & construction6.5/102.0/10
Space & placement7.0/103.5/10
Light & reflections7.0/105.0/10
Purposeful detail7.0/101.0/10
Artistry & character7.0/101.5/10
Materials & effects6.0/102.0/10
Visual integrity8.5/106.0/10

Ground Truth

Same prompt

Claude Haiku 5.547.4/100

Claude Haiku 5.5: Ground Truth SVG benchmark
Benchmark task

A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.

Gemma 4 26B A4B12.4/100

Gemma 4 26B A4B: Ground Truth SVG benchmark
Benchmark task

A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.

Raccoon

Same prompt

Claude Haiku 5.547.3/100

Claude Haiku 5.5: Raccoon SVG benchmark
Researcher observations

A tidy, appealing cartoon with recognizable animals and a pleasing sunset palette. Steering lacks visible controls, while schematic limbs and uncertain raccoon support weaken the requested interaction. Shallow vehicle construction, flat character lighting and modest displacement limit physical coherence. Clean shapes and readable identifying details remain strengths.

Benchmark task

Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski

Gemma 4 26B A4B40.3/100

Gemma 4 26B A4B: Raccoon SVG benchmark
Researcher observations

The animal stack is recognizable, and clean silhouettes support a basic illustration. Steering is not depicted, while the craft's construction and water contact remain unresolved. Sparse anatomical and material detail limit the finish. The sky gradient and glow provide atmospheric lighting, but the subjects lack corresponding modeling.

Benchmark task

Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski

Compare category scores
CategoryClaude Haiku 5.5Gemma 4 26B A4B
Prompt & likeness5.5/104.5/10
Anatomy & construction4.0/103.5/10
Space & placement5.5/104.0/10
Light & reflections4.0/104.5/10
Purposeful detail5.5/102.5/10
Artistry & character4.5/104.0/10
Materials & effects5.5/102.5/10
Visual integrity5.0/107.0/10

Pelican

Same prompt

Claude Haiku 5.561.8/100

Claude Haiku 5.5: Pelican SVG benchmark
Researcher observations

A cheerful, recognizable illustration with clean contours and a balanced warm palette. Aligned wheels and readable frame geometry establish the bicycle, but shoulder construction, feet and steering contact remain imprecise. Sparse drivetrain detail, flat materials and absent grounding shadows limit anatomical and spatial conviction.

Benchmark task

Generate an SVG of a pelican riding a bicycle

Gemma 4 26B A4B48.5/100

Gemma 4 26B A4B: Pelican SVG benchmark
Researcher observations

A clean, balanced icon suggests a pelican riding a bicycle. Continuous contours and restrained colors support its finish, but the abbreviated bill, undifferentiated body, unresolved riding contacts and incomplete bicycle mechanism limit likeness and construction. Sparse detail and flat lighting keep the drawing basic despite its clarity.

Benchmark task

Generate an SVG of a pelican riding a bicycle

Compare category scores
CategoryClaude Haiku 5.5Gemma 4 26B A4B
Prompt & likeness8.0/105.5/10
Anatomy & construction5.5/103.5/10
Space & placement6.5/106.0/10
Light & reflections5.0/104.0/10
Purposeful detail6.0/103.0/10
Artistry & character5.0/104.5/10
Materials & effects5.0/104.0/10
Visual integrity8.0/108.5/10