Mistral Large 4 22.0/100Rank 39/47

STEALTHMARK · HEAD TO HEAD
All comparisons ↗Muse Spark Open leads Mistral Large 4 by 0.8 points on StealthMark, 44.1 to 43.3. Mistral Large 4 leads on 6 of 9 benchmarks and Muse Spark Open on 3, including both games. Mistral Large 4 scores higher on Raccoon, with its largest category advantage in anatomy & construction.
See the difference ↘On every task, result quality and reasoning tokens are each compared with all measured models and weighed equally. Each dot is one model.
BENCHMARK BY BENCHMARK
DATASHEET
Muse Spark Open scores higher on StealthMark and runs 2.4× faster in our speed test. Both take about 1M tokens of context.
Full datasheets, every price and sourceMistral Large 4 ↗Muse Spark Open ↗
Anticipating threats and planning ahead. Collect coins while avoiding ghosts. Ghosts move before the player each turn, and collisions cost a life. 3 levels in sequence, up to 66 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.


Cooperative planning and learning from experience. Coordinate two robots to push numbered cores onto matching sockets. Pressure plates hold doors open; moving either robot uses one turn. 5 levels in sequence, up to 152 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.


Physics, perspective and recursive reflections, tested together. Explore the test ↗


Mistral Large 4
The central sphere, airborne black and deformed crimson support substantial state and placement credit. Recent cyan contact and crimson transport remain uncertain. Sparse wall patches and glossy gradients provide little evidence of the required extensive mirror system, while the missing centerline lamp and bulky crimson remain visible weaknesses.
Muse Spark Open
The airborne black blob and deformed paint support the broad contact sequence, although cyan attachment and wheel-directed transport remain partial. The sphere and black blob have substantial framing errors. The dominant limitation is the largely absent mirror system: faint wall circles and isolated highlights provide little evidence of recursive room geometry or curved nested reflections. Oversized compact paint features and diffuse material treatment further limit credit.
| Category | Mistral Large 4 | Muse Spark Open |
|---|---|---|
| State at 600 ms | 17.0/25 | 14.0/25 |
| Camera and placement | 11.0/15 | 6.0/15 |
| Reflections | 12.0/120 | 8.0/120 |
| Materials and scale | 5.5/10 | 3.5/10 |
| Floor-damage reward | 0.0/10 | 0.0/10 |
A spinning metal sphere and paint in a mirrored room test physical reasoning, perspective and consistency across repeated reflections.
Visual construction and creative interpretation.


Mistral Large 4
An appealing, coherent illustration whose enormous rounded cat anchors the windblown composition. Warm shading and floating sketches communicate the brief well. Simplified paws, faint ear construction, inconsistent wind cues and limited material texture keep the execution below exceptional.
Muse Spark Open
The rounded silhouette and asymmetric expression make an appealing baby elephant, supported by a quiet background and grounding shadow. The protective action remains difficult to read: forefeet cannot be confidently traced into a grip, and seed contact is crowded by fine lines. Controlled simple shapes provide charm, but limited anatomical clarity, shading and surface detail leave the execution uneven.
| Category | Mistral Large 4 | Muse Spark Open |
|---|---|---|
| Task & likeness | 8.0/10 | 5.0/10 |
| Anatomy & construction | 7.0/10 | 4.5/10 |
| Space & placement | 7.5/10 | 6.0/10 |
| Light & reflections | 7.0/10 | 5.0/10 |
| Purposeful detail | 7.0/10 | 6.0/10 |
| Artistry & character | 7.0/10 | 5.0/10 |
| Materials & effects | 7.0/10 | 5.0/10 |
| Visual integrity | 8.0/10 | 6.5/10 |
Mistral Large 4
A heavy ginger cat stays planted on a terrace as wind carries papers around it. The scene tests weight, expression and the contrast between stable and moving forms.
Muse Spark Open
A small elephant protecting a delicate seed tests expressive anatomy, physical contact and contrasting organic materials.
Precise visual recall and portrait reconstruction.


Mistral Large 4
A recognizable, cleanly rendered interpretation with a restrained palette and some facial modeling. Its enlarged frontal head, simplified expression, compressed low hands and schematic landscape substantially limit likeness and construction. The smooth rendering does not reproduce the painting's nuanced anatomy, clothing or atmospheric depth.
Muse Spark Open
A recognizable, orderly interpretation with clean major contours, connected body forms and modest facial shading. Wide eyes, frontal symmetry and schematic hands limit likeness and expression. Layered scenery establishes basic depth, but shallow arm overlaps, flat clothing and sparse fine detail keep the execution basic and uneven.
| Category | Mistral Large 4 | Muse Spark Open |
|---|---|---|
| Task & likeness | 4.0/10 | 3.0/10 |
| Anatomy & construction | 3.5/10 | 3.0/10 |
| Space & placement | 5.0/10 | 5.0/10 |
| Light & reflections | 4.5/10 | 4.5/10 |
| Purposeful detail | 4.0/10 | 4.0/10 |
| Artistry & character | 4.0/10 | 3.0/10 |
| Materials & effects | 4.5/10 | 4.0/10 |
| Visual integrity | 5.5/10 | 6.0/10 |
An SVG interpretation of the Mona Lisa tests facial likeness, anatomy and the composition of a familiar portrait.
Creativity, perspective and visual beauty.


Mistral Large 4
A clean, appealing beach illustration with clear subject coverage, a cohesive sunset palette and expressive animal details. Bodies and accessories resolve basic construction coherently, although joints remain schematic. Layered shapes establish modest depth; generic oval shadows and flat surfaces limit physical richness. Repeated forms and sparse articulation leave room for more accomplished drawing.
Muse Spark Open
A coherent sunset beach with readable activities, balanced framing and controlled colour transitions. Small accessories add interest, but schematic anatomy, limited surface detail, weak directional shadows and a geometric reflection constrain its finish. Most shapes and overlaps remain clean.
| Category | Mistral Large 4 | Muse Spark Open |
|---|---|---|
| Task & likeness | 7.5/10 | 8.0/10 |
| Anatomy & construction | 6.0/10 | 6.0/10 |
| Space & placement | 7.0/10 | 6.5/10 |
| Light & reflections | 6.5/10 | 5.5/10 |
| Purposeful detail | 6.0/10 | 6.5/10 |
| Artistry & character | 6.0/10 | 5.5/10 |
| Materials & effects | 6.5/10 | 6.0/10 |
| Visual integrity | 8.0/10 | 8.0/10 |
A busy shoreline at sunset tests scene composition, animal forms and the relationship between light and water reflections.
Physical reasoning, light and visual reconstruction.


Mistral Large 4
This benchmark has not been assessed yet.
Muse Spark Open
This benchmark has not been assessed yet.
A plank, computer mouse and blueberry in a steel room test physical stability, spatial relationships, materials and lighting.
Scene composition and interacting subjects.


Mistral Large 4
The central interaction is clear, with recognizable animals, expressive faces and a coherent sunset composition. Clean contours and readable accessories give the cartoon polish. Simplified joints, uncertain steering attachment, shallow hull volume and limited directional lighting constrain its physical resolution.
Muse Spark Open
Expressive faces, distinct accessories and clean color separation make the scene appealing and recognizable. Character detail is stronger than the functional construction: steering contact, limb overlaps and seating remain ambiguous. The readable hull and lively spray establish motion, while limited directional shading and simplified surfaces constrain depth and physical coherence.
| Category | Mistral Large 4 | Muse Spark Open |
|---|---|---|
| Task & likeness | 8.5/10 | 4.0/10 |
| Anatomy & construction | 6.5/10 | 3.0/10 |
| Space & placement | 7.0/10 | 6.0/10 |
| Light & reflections | 5.5/10 | 4.5/10 |
| Purposeful detail | 7.5/10 | 7.0/10 |
| Artistry & character | 6.5/10 | 3.5/10 |
| Materials & effects | 6.5/10 | 5.0/10 |
| Visual integrity | 8.0/10 | 5.0/10 |
A jet-ski scene pairs a canine driver with a raccoon passenger. It tests the placement and contact of interacting subjects, along with vehicle construction.
Subject construction and spatial relationships.


Mistral Large 4
A coherent, appealing pelican illustration with a continuous body silhouette, readable bicycle and grounded wheels. Simplified legs and ambiguous steering and pedal connections limit construction. Clean shapes and expressive accessories succeed, while shallow depth, modest lighting and sparse material differentiation leave substantial room for refinement.
Muse Spark Open
A controlled, appealing cartoon with a recognizable pelican, expressive face and clean curved forms. Feather lines, spokes and bill shading provide useful complexity. Aligned wheels and a ground shadow establish placement, but uncertain pedal contacts and obscured mechanical connections weaken support and riding action. Lighting remains loosely coordinated with the sun.
| Category | Mistral Large 4 | Muse Spark Open |
|---|---|---|
| Task & likeness | 8.5/10 | 7.5/10 |
| Anatomy & construction | 6.0/10 | 5.0/10 |
| Space & placement | 7.0/10 | 6.0/10 |
| Light & reflections | 6.5/10 | 5.0/10 |
| Purposeful detail | 7.0/10 | 6.5/10 |
| Artistry & character | 7.0/10 | 5.5/10 |
| Materials & effects | 6.5/10 | 6.0/10 |
| Visual integrity | 8.0/10 | 7.5/10 |
A cycling pelican tests anatomy, riding posture and contact between the bird and the bicycle.