Claude Haiku 5.5 scores 8.5 points higher overall (46.5 vs 38.0). Claude Haiku 5.5 scores higher on Newton's Mirror, with its largest category advantage in reflections.
The centered sphere, compact airborne black blob and differentiated cyan/crimson interaction support substantial state and placement credit. The few recognizable sphere and panel images establish limited optical relationships, but most of the required mirror system is missing. Rounded volume and localized paint warrant substantial material credit despite the soft, illustrative finish.
Benchmark task
A spinning metal sphere and paint in a mirrored room test physical reasoning, perspective and consistency across repeated reflections.
The centered sphere, separate airborne black blob and cyan-above-crimson ordering provide limited valid structure. The colored beads do not establish the required impact and transport histories. One dim floor image supports a small part of the optical system, while the defining wall repetitions, nested sphere imagery and emitter mappings are missing. Rounded volume and some gloss earn material credit, tempered by soft surface appearance and excessive paint-bead scale.
Benchmark task
A spinning metal sphere and paint in a mirrored room test physical reasoning, perspective and consistency across repeated reflections.
A coherent coral squid emblem with a compact mantle, restrained face and clean centered presentation. Its radial silhouette and floating placement work, but sharp arm tips, crowded roots and sparse surface modeling limit softness, construction and finish.
Benchmark task
A coral squid with spreading arms tests connected anatomy, balanced composition and soft surface shading.
An appealing purple character with a readable pleased expression and raised-moustache joke. Smooth shading and clean contours support the simple design, but indistinct mitten grips, minimally textured curls and an uncompressed strap weaken the requested physical interaction. The jelly suggests gloss more convincingly than translucency.
Benchmark task
A glossy purple jelly struggles with an oversized fake moustache at a playful checkpoint. The scene tests comic expression, physical contact and the appearance of a soft translucent body.
A recognizable but basic Mona Lisa reinterpretation. Clean contours and smooth facial lighting provide coherence and volume. Replication remains limited by the frontal pose, elongated neck, schematic expression, unresolved crossed hands and sparse landscape. Lighting is more successful than anatomical construction and purposeful detail.
Benchmark task
An SVG interpretation of the Mona Lisa tests facial likeness, anatomy and the composition of a familiar portrait.
Clean contours, connected body forms and gentle gradients support a basic, coherent portrait. Likeness remains weak: the face dominates the body, the seated angle is lost, and crossed hands become dark lobes without traceable wrists or fingers. Readable facial details add some drawing complexity, but clothing, landscape and material treatment remain sparse.
Benchmark task
An SVG interpretation of the Mona Lisa tests facial likeness, anatomy and the composition of a familiar portrait.
A cheerful, coherent beach illustration with attractive sunset colors, readable accessories and clean silhouettes. Its sun and sailboat reflections establish useful physical relationships. Simple animal construction, flattened foreground placement, sparse directional shadows and minimally differentiated surfaces limit its drawing refinement.
Benchmark task
A busy shoreline at sunset tests scene composition, animal forms and the relationship between light and water reflections.
A coherent sunset beach with clear requested subjects, balanced framing and clean shapes. The aligned solar reflection and warm gradients establish atmosphere. Primitive animal construction, ambiguous furniture, sparse depth cues and minimally developed surfaces limit its drawing complexity and physical richness.
Benchmark task
A busy shoreline at sunset tests scene composition, animal forms and the relationship between light and water reflections.
A tidy, appealing cartoon with recognizable animals and a pleasing sunset palette. Steering lacks visible controls, while schematic limbs and uncertain raccoon support weaken the requested interaction. Shallow vehicle construction, flat character lighting and modest displacement limit physical coherence. Clean shapes and readable identifying details remain strengths.
Benchmark task
A jet-ski scene pairs a canine driver with a raccoon passenger. It tests the placement and contact of interacting subjects, along with vehicle construction.
The requested interaction reads clearly through recognizable animals, expressive faces and a coherent hull-water relationship. Clean curves and readable accessories give the cartoon polish. Partly unresolved grips and supporting contacts limit physical construction; modest shape complexity, weak directional lighting and schematic water constrain its finish.
Benchmark task
A jet-ski scene pairs a canine driver with a raccoon passenger. It tests the placement and contact of interacting subjects, along with vehicle construction.
A cheerful, recognizable illustration with clean contours and a balanced warm palette. Aligned wheels and readable frame geometry establish the bicycle, but shoulder construction, feet and steering contact remain imprecise. Sparse drivetrain detail, flat materials and absent grounding shadows limit anatomical and spatial conviction.
Benchmark task
A cycling pelican tests anatomy, riding posture and contact between the bird and the bicycle.
A coherent, cheerful illustration with recognizable pelican features, balanced composition, clean contours and useful small details. Its controlled curves and layered wheels demonstrate competent drawing skill. Ambiguous pedal and steering contacts, sparse drivetrain construction and weak directional lighting limit the riding mechanics and finish.
Benchmark task
A cycling pelican tests anatomy, riding posture and contact between the bird and the bicycle.