Claude Haiku 5.5 scores 20.6 points higher overall (46.5 vs 25.9). Claude Haiku 5.5 scores higher on Newton's Mirror, with its largest category advantage in reflections.
The centered sphere, compact airborne black blob and differentiated cyan/crimson interaction support substantial state and placement credit. The few recognizable sphere and panel images establish limited optical relationships, but most of the required mirror system is missing. Rounded volume and localized paint warrant substantial material credit despite the soft, illustrative finish.
Benchmark task
A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.
The sphere's volume, separate airborne black blob and vertical color ordering are readable. The large, low sphere, plain surrounding planes and absent nested optical imagery leave the central geometric and reflection requirements unsupported. Paint contact and transport remain unresolved. Material credit recognizes the visible convex shading, highlights and distinct surface colors while retaining deductions for the schematic finish and oversized blobs.
Benchmark task
A shiny steel ball spins in a room with mirrored walls and a mirrored floor. Red, cyan and black paint float above it. Gravity suddenly switches on. Draw the scene a moment later, as the ball drops and paint begins landing on its spinning surface. Show the reflections repeating through the room.
A coherent coral squid emblem with a compact mantle, restrained face and clean centered presentation. Its radial silhouette and floating placement work, but sharp arm tips, crowded roots and sparse surface modeling limit softness, construction and finish.
Benchmark task
Draw a calm coral-red squid with eight thick arms spreading around it like flower petals. Keep the shape balanced and simple, with soft shading and a friendly face.
A clean, appealing luminous mascot with coherent body continuity and a readable jar-hugging pose. Rounded highlights, smooth gradients and balanced framing work well. The teardrop silhouette, modest eyes and nearly even grin only partly satisfy the character brief; sparse jar construction and simple geometry limit sophistication.
A recognizable but basic Mona Lisa reinterpretation. Clean contours and smooth facial lighting provide coherence and volume. Replication remains limited by the frontal pose, elongated neck, schematic expression, unresolved crossed hands and sparse landscape. Lighting is more successful than anatomical construction and purposeful detail.
The portrait is recognizable through its silhouette, palette and smile, with clean execution of simple shapes. Replication remains weak: the face and pose differ markedly, hands become fingerless ovals, clothing lacks construction, and the landscape loses its atmospheric detail. Basic gradients provide limited volume.
A cheerful, coherent beach illustration with attractive sunset colors, readable accessories and clean silhouettes. Its sun and sailboat reflections establish useful physical relationships. Simple animal construction, flattened foreground placement, sparse directional shadows and minimally differentiated surfaces limit its drawing refinement.
Benchmark task
Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections
A coherent beach illustration with clean silhouettes, a sweeping shoreline and an effective sunset palette. Requested subjects are recognizable, but primitive animal construction, sparse detail, unsupported palm placement and schematic reflections limit drawing sophistication and physical credibility.
Benchmark task
Create an SVG of a amazing beach scene. Sunset, animals, fun, birds, reflections
A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.
A dark steel room has four pillars and two warm ceiling lights. A wooden plank is placed over a computer mouse, with a blueberry on the plank above it. Draw the scene a few seconds later, showing how the objects settle and how the light, shadows and surfaces look.
A tidy, appealing cartoon with recognizable animals and a pleasing sunset palette. Steering lacks visible controls, while schematic limbs and uncertain raccoon support weaken the requested interaction. Shallow vehicle construction, flat character lighting and modest displacement limit physical coherence. Clean shapes and readable identifying details remain strengths.
Benchmark task
Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski
Clean, simple silhouettes communicate a raccoon riding on a dog. Limited animal specificity, absent steering controls and a flat platform weaken the requested scene. Small facial marks provide purposeful detail, while unresolved support, flat lighting and schematic water restrict physical coherence. Primitive but coherent construction supports basic drawing quality.
Benchmark task
Generate an SVG: A raccoon sits on a dog's back while the dog steers a jet ski
A cheerful, recognizable illustration with clean contours and a balanced warm palette. Aligned wheels and readable frame geometry establish the bicycle, but shoulder construction, feet and steering contact remain imprecise. Sparse drivetrain detail, flat materials and absent grounding shadows limit anatomical and spatial conviction.
A clean, readable illustration with balanced placement and coherent basic geometry. The sky gradient and ground shadow establish diffuse illumination. Primitive shapes and sparse detail limit artistry, while unclear leg attachment, missing pedal contact and unresolved steering weaken the riding action.
