STEALTHMARK · HEAD TO HEAD

All comparisons ↗

Claude Haiku 5.5 vs Qwen3.8 27B

Qwen3.8 27B scores 3.6 points higher overall (50.1 vs 46.5). Claude Haiku 5.5 leads General Intelligence; Qwen3.8 27B leads Visual Intelligence. Qwen3.8 27B scores higher on Raccoon, with its largest category advantage in anatomy & construction.

See the difference ↘
All results ↗
All results ↗

Overall StealthMark

46.5/100
50.1/100

General Intelligence

40.7/100
39.5/100

Visual Intelligence

53.3/100
62.8/100

Newton's Mirror

Same prompt

Physics, perspective and recursive reflections, tested together. Explore the test ↗

Claude Haiku 5.540.0/100

Claude Haiku 5.5: Newton's Mirror SVG benchmark
Researcher observations

The centered sphere, compact airborne black blob and differentiated cyan/crimson interaction support substantial state and placement credit. The few recognizable sphere and panel images establish limited optical relationships, but most of the required mirror system is missing. Rounded volume and localized paint warrant substantial material credit despite the soft, illustrative finish.

Simplified prompt

A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.

The exact prompt is held back to prevent benchmaxxing.

Qwen3.8 27B37.6/100

Qwen3.8 27B: Newton's Mirror SVG benchmark
Researcher observations

The room fills the complete 16:9 frame without visible borders or labels. Central placement fits the wider frame, and the paint colors follow the expected vertical order. Bilateral side images, diminishing echoes and an overlapping floor image provide limited mirror depth. Broad sphere surfaces lack ordered nested room imagery, while planar panel sequences and outer chains remain missing or unresolved. Soft highlights do not establish emitter mapping, while paint attachment and transport history are only partly supported.

Simplified prompt

A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.

The exact prompt is held back to prevent benchmaxxing.

Compare category scores
CategoryClaude Haiku 5.5Qwen3.8 27B
State at 600 ms23.5/2517.5/25
Camera and placement8.0/1513.0/15
Reflections24.5/12022.5/120
Materials and scale7.5/107.0/10
Floor-damage reward0.0/100.0/10

Selfie

Different prompts

Claude Haiku 5.546.4/100

Claude Haiku 5.5: Selfie SVG benchmark
Researcher observations

A coherent coral squid emblem with a compact mantle, restrained face and clean centered presentation. Its radial silhouette and floating placement work, but sharp arm tips, crowded roots and sparse surface modeling limit softness, construction and finish.

Simplified prompt

Draw a calm coral-red squid with eight thick arms spreading around it like flower petals. Keep the shape balanced and simple, with soft shading and a friendly face.

The exact prompt is held back to prevent benchmaxxing.

Qwen3.8 27B77.5/100

Qwen3.8 27B: Selfie SVG benchmark
Researcher observations

A cohesive emerald-and-gold illustration with a gentle expression, flowing robes, luminous halo and three clearly ringed orbs. Limbs remain connected, and the asymmetric legs communicate floating. The rounded face reads somewhat bear-like; the raised palm faces outward rather than upward, and chest-hand fingers are crowded. Clean ornamentation exceeds the comparatively simple anatomical modeling and shading.

Simplified prompt

Draw a friendly capybara floating in ornate green and white robes. A glowing halo and small floating orbs surround it, giving it the feel of a gentle fantasy guide.

The exact prompt is held back to prevent benchmaxxing.

Compare category scores
CategoryClaude Haiku 5.5Qwen3.8 27B
Prompt & likeness6.5/108.0/10
Anatomy & construction4.0/107.5/10
Space & placement6.5/108.0/10
Light & reflections4.0/107.5/10
Purposeful detail3.5/108.0/10
Artistry & character3.0/107.5/10
Materials & effects4.5/107.5/10
Visual integrity8.0/108.5/10

Mona Lisa

Same prompt

Claude Haiku 5.538.6/100

Claude Haiku 5.5: Mona Lisa SVG benchmark
Researcher observations

A recognizable but basic Mona Lisa reinterpretation. Clean contours and smooth facial lighting provide coherence and volume. Replication remains limited by the frontal pose, elongated neck, schematic expression, unresolved crossed hands and sparse landscape. Lighting is more successful than anatomical construction and purposeful detail.

Exact prompt

Replicate mona-lisa as SVG Make it a masterpiece, no tools allowed

Qwen3.8 27B47.2/100

Qwen3.8 27B: Mona Lisa SVG benchmark
Researcher observations

The centered portrait, dark clothing and overlapping hands evoke the Mona Lisa, but replication is weak. The face is excessively elongated, the eyes stare broadly, and the hands reduce to rounded masses with shallow finger marks. Soft shading creates some volume, while the landscape remains indistinct. The precise gold frame is more resolved than the portrait.

Exact prompt

Replicate mona-lisa as SVG Make it a masterpiece, no tools allowed

Compare category scores
CategoryClaude Haiku 5.5Qwen3.8 27B
Prompt & likeness3.0/104.0/10
Anatomy & construction4.0/104.5/10
Space & placement4.0/104.5/10
Light & reflections5.5/105.0/10
Purposeful detail2.5/105.0/10
Artistry & character3.5/105.0/10
Materials & effects2.5/105.0/10
Visual integrity5.5/105.0/10

Beach

Same prompt

Claude Haiku 5.571.9/100

Claude Haiku 5.5: Beach SVG benchmark
Researcher observations

A cheerful, coherent beach illustration with attractive sunset colors, readable accessories and clean silhouettes. Its sun and sailboat reflections establish useful physical relationships. Simple animal construction, flattened foreground placement, sparse directional shadows and minimally differentiated surfaces limit its drawing refinement.

Exact prompt

Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections Make it a masterpiece, no tools allowed

Qwen3.8 27B69.3/100

Qwen3.8 27B: Beach SVG benchmark
Researcher observations

The sweeping palm, glowing sunset and purple-to-orange palette create an appealing beach composition. Birds, animals and reflections fulfill the brief, with clean silhouettes and readable small accents. Schematic anatomy, repetitive shoreline geometry and limited perspective integration constrain depth. Foreground lighting and uniform reflection bars provide atmosphere but little physical coherence.

Exact prompt

Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections Make it a masterpiece, no tools allowed

Compare category scores
CategoryClaude Haiku 5.5Qwen3.8 27B
Prompt & likeness8.5/108.5/10
Anatomy & construction6.5/106.5/10
Space & placement7.0/106.0/10
Light & reflections7.0/106.0/10
Purposeful detail7.0/107.0/10
Artistry & character7.0/107.0/10
Materials & effects6.0/106.5/10
Visual integrity8.5/107.5/10

Ground Truth

Same prompt

Claude Haiku 5.547.4/100

Claude Haiku 5.5: Ground Truth SVG benchmark
Simplified prompt

A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.

The exact prompt is held back to prevent benchmaxxing.

Qwen3.8 27B40.2/100

Qwen3.8 27B: Ground Truth SVG benchmark
Simplified prompt

A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.

The exact prompt is held back to prevent benchmaxxing.

Raccoon

Same prompt

Claude Haiku 5.547.3/100

Claude Haiku 5.5: Raccoon SVG benchmark
Researcher observations

A tidy, appealing cartoon with recognizable animals and a pleasing sunset palette. Steering lacks visible controls, while schematic limbs and uncertain raccoon support weaken the requested interaction. Shallow vehicle construction, flat character lighting and modest displacement limit physical coherence. Clean shapes and readable identifying details remain strengths.

Exact prompt

Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski Make it a masterpiece, no tools allowed

Qwen3.8 27B67.7/100

Qwen3.8 27B: Raccoon SVG benchmark
Researcher observations

The raccoon clearly rides on the dog's back, and the dog reaches the jet ski's steering grip. Cheerful expressions, a bright palette and sweeping wake make the action readable. Anatomy and machinery remain simplified, with overlapping paws and limited seat definition. Flat lighting, sparse surface detail and broad white splash shapes limit depth and finish. A clipped gray fragment interrupts the upper-left corner.

Exact prompt

Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski Make it a masterpiece, no tools allowed

Compare category scores
CategoryClaude Haiku 5.5Qwen3.8 27B
Prompt & likeness5.5/108.5/10
Anatomy & construction4.0/106.5/10
Space & placement5.5/107.0/10
Light & reflections4.0/105.5/10
Purposeful detail5.5/106.5/10
Artistry & character4.5/106.5/10
Materials & effects5.5/106.5/10
Visual integrity5.0/107.5/10

Pelican

Benchmax control

Outside General and Visual Intelligence. Excluded from the overall score for Claude Haiku 5.5 and Qwen3.8 27B.

Claude Haiku 5.564.0/100

Claude Haiku 5.5: Pelican SVG benchmark
Researcher observations

A cheerful, recognizable illustration with clean contours and a balanced warm palette. Aligned wheels and readable frame geometry establish the bicycle, but shoulder construction, feet and steering contact remain imprecise. Sparse drivetrain detail, flat materials and absent grounding shadows limit anatomical and spatial conviction.

Exact prompt

Generate an SVG of a pelican riding a bicycle Make it a masterpiece, no tools allowed

Qwen3.8 27B71.3/100

Qwen3.8 27B: Pelican SVG benchmark
Researcher observations

The pelican’s oversized bill, straw hat and flowing scarf create a distinctive focal character against a well-composed coastal sunset. Wheels and frame are readable, but the wings do not reach the steering, overlapping legs obscure separate pedal contacts, and the crank linkage is unclear. Clean vector shapes and restrained shading support an appealing illustration with limited physical depth.

Exact prompt

Generate an SVG of a pelican riding a bicycle Make it a masterpiece, no tools allowed

Compare category scores
CategoryClaude Haiku 5.5Qwen3.8 27B
Prompt & likeness8.0/108.0/10
Anatomy & construction5.5/105.5/10
Space & placement6.5/107.0/10
Light & reflections5.0/107.0/10
Purposeful detail6.0/107.5/10
Artistry & character6.5/108.0/10
Materials & effects5.0/106.5/10
Visual integrity8.0/108.0/10