STEALTHMARK · HEAD TO HEAD

All comparisons ↗

Gemma 4 31B vs Hy4 Preview

Hy4 Preview scores 14.0 points higher overall (39.9 vs 25.9). Hy4 Preview scores higher on Newton's Mirror, with its largest category advantage in state at 600 ms.

See the difference ↘
All results ↗
All results ↗

Overall StealthMark

25.9/100
39.9/100

General Intelligence

13.9/100
31.8/100

Visual Intelligence

40.1/100
49.4/100

Newton's Mirror

Same prompt

Physics, perspective and recursive reflections, tested together. Explore the test ↗

Gemma 4 31B15.4/100

Gemma 4 31B: Newton's Mirror SVG benchmark
Researcher observations

The sphere's volume, separate airborne black blob and vertical color ordering are readable. The large, low sphere, plain surrounding planes and absent nested optical imagery leave the central geometric and reflection requirements unsupported. Paint contact and transport remain unresolved. Material credit recognizes the visible convex shading, highlights and distinct surface colors while retaining deductions for the schematic finish and oversized blobs.

Benchmark task

A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.

Hy4 Preview28.4/100

Hy4 Preview: Newton's Mirror SVG benchmark
Researcher observations

The central sphere, compact airborne black bead and broad paint ordering are supported. Contact and transport history remain partly unresolved. The optical system provides only isolated first images and light patches, with little evidence of the extensive ordered reflection structure. Rounded metal and paint gloss are more successful than the reflected contents.

Benchmark task

A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.

Compare category scores
CategoryGemma 4 31BHy4 Preview
State at 600 ms8.0/2516.0/25
Camera and placement3.0/1510.0/15
Reflections0.0/1206.5/120
Materials and scale6.0/107.5/10
Floor-damage reward0.0/100.0/10

Selfie

Different prompts

Gemma 4 31B60.9/100

Gemma 4 31B: Selfie SVG benchmark
Researcher observations

A clean, appealing luminous mascot with coherent body continuity and a readable jar-hugging pose. Rounded highlights, smooth gradients and balanced framing work well. The teardrop silhouette, modest eyes and nearly even grin only partly satisfy the character brief; sparse jar construction and simple geometry limit sophistication.

Prompt withheld

Prompt withheld.

Hy4 Preview60.2/100

Hy4 Preview: Selfie SVG benchmark
Researcher observations

A cohesive, appealing illustration with a serene face, luminous palette and complete framing. The separated head and torso weaken anatomical coherence, while crowded wing attachments and angular sash folds limit the requested suppleness. Clean execution and decorative detail exceed the clarity of the underlying construction.

Prompt withheld

Prompt withheld.

Compare category scores
CategoryGemma 4 31BHy4 Preview
Prompt & likeness6.0/106.0/10
Anatomy & construction6.0/105.5/10
Space & placement7.5/107.5/10
Light & reflections6.5/107.0/10
Purposeful detail5.5/106.5/10
Artistry & character5.0/105.0/10
Materials & effects6.5/107.0/10
Visual integrity7.5/105.5/10

Mona Lisa

Different prompts

Gemma 4 31B35.1/100

Gemma 4 31B: Mona Lisa SVG benchmark
Researcher observations

The portrait is recognizable through its silhouette, palette and smile, with clean execution of simple shapes. Replication remains weak: the face and pose differ markedly, hands become fingerless ovals, clothing lacks construction, and the landscape loses its atmospheric detail. Basic gradients provide limited volume.

Benchmark task

Replicate mona-lisa as SVG

Hy4 Preview23.4/100

Hy4 Preview: Mona Lisa SVG benchmark
Researcher observations

A recognizable but basic Mona Lisa interpretation with a cohesive earthy palette and atmospheric hills. The rigid neck, generic face and unresolved folded-hand pose limit replication and anatomy. Large silhouettes and layer boundaries are comparatively clear, warranting stronger integrity credit than the sparse detail and simplified construction.

Benchmark task

Replicate mona-lisa as SVG

Compare category scores
CategoryGemma 4 31BHy4 Preview
Prompt & likeness3.0/102.5/10
Anatomy & construction4.0/102.5/10
Space & placement4.0/102.5/10
Light & reflections3.5/101.5/10
Purposeful detail2.0/102.5/10
Artistry & character3.5/101.5/10
Materials & effects2.5/102.5/10
Visual integrity5.5/104.0/10

Beach

Same prompt

Gemma 4 31B29.2/100

Gemma 4 31B: Beach SVG benchmark
Researcher observations

A coherent beach illustration with clean silhouettes, a sweeping shoreline and an effective sunset palette. Requested subjects are recognizable, but primitive animal construction, sparse detail, unsupported palm placement and schematic reflections limit drawing sophistication and physical credibility.

Benchmark task

Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections

Hy4 Preview60.8/100

Hy4 Preview: Beach SVG benchmark
Researcher observations

A cheerful beach illustration fulfills the visible subject requirements with coherent foreground construction and a harmonious sunset palette. Shallow depth, schematic reflections, ambiguous blue airborne forms and exposed geometry beneath the sunset limit its finish. Small accessories are readable, but materials and surface detail remain simplified.

Benchmark task

Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections

Compare category scores
CategoryGemma 4 31BHy4 Preview
Prompt & likeness5.0/108.5/10
Anatomy & construction2.0/105.5/10
Space & placement5.0/106.5/10
Light & reflections2.5/105.0/10
Purposeful detail2.0/106.0/10
Artistry & character2.0/106.0/10
Materials & effects2.0/105.0/10
Visual integrity5.0/106.0/10

Ground Truth

Same prompt

Gemma 4 31B12.0/100

Gemma 4 31B: Ground Truth SVG benchmark
Benchmark task

A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.

Hy4 Preview40.1/100

Hy4 Preview: Ground Truth SVG benchmark
Benchmark task

A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.

Raccoon

Same prompt

Gemma 4 31B38.2/100

Gemma 4 31B: Raccoon SVG benchmark
Researcher observations

Clean, simple silhouettes communicate a raccoon riding on a dog. Limited animal specificity, absent steering controls and a flat platform weaken the requested scene. Small facial marks provide purposeful detail, while unresolved support, flat lighting and schematic water restrict physical coherence. Primitive but coherent construction supports basic drawing quality.

Benchmark task

Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski

Hy4 Preview55.9/100

Hy4 Preview: Raccoon SVG benchmark
Researcher observations

A lively cartoon communicates the animal pair traveling across water. Curving waves, rising spray and locally modeled gray forms strengthen motion and volume. Ambiguous seating, simplified joints and unclear control routing limit construction. Competing focal elements, decorative foam and inconsistent illumination leave the finish uneven.

Benchmark task

Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski

Compare category scores
CategoryGemma 4 31BHy4 Preview
Prompt & likeness4.5/107.0/10
Anatomy & construction4.0/104.5/10
Space & placement4.0/106.0/10
Light & reflections1.0/106.0/10
Purposeful detail3.0/105.5/10
Artistry & character4.0/104.5/10
Materials & effects2.0/106.5/10
Visual integrity8.0/107.0/10

Pelican

Same prompt

Gemma 4 31B50.5/100

Gemma 4 31B: Pelican SVG benchmark
Researcher observations

A clean, readable illustration with balanced placement and coherent basic geometry. The sky gradient and ground shadow establish diffuse illumination. Primitive shapes and sparse detail limit artistry, while unclear leg attachment, missing pedal contact and unresolved steering weaken the riding action.

Benchmark task

Generate an SVG of a pelican riding a bicycle

Hy4 Preview60.0/100

Hy4 Preview: Pelican SVG benchmark
Researcher observations

A recognizable, playful pelican cyclist with readable wheels, accessories and landscape layers. Form shading and ground shadows provide competent depth. Angular legs, uncertain pedal engagement and absent steering contact limit the riding construction; crowded overlaps and simple surfaces constrain refinement.

Benchmark task

Generate an SVG of a pelican riding a bicycle

Compare category scores
CategoryGemma 4 31BHy4 Preview
Prompt & likeness6.0/107.5/10
Anatomy & construction4.0/104.5/10
Space & placement6.0/106.5/10
Light & reflections5.0/107.0/10
Purposeful detail3.5/106.0/10
Artistry & character4.0/105.0/10
Materials & effects4.0/105.0/10
Visual integrity8.0/107.0/10