STEALTHMARK · HEAD TO HEAD

All comparisons ↗

DeepSeek-V4.1-Flash-1017 vs Nemotron 3 Ultra

DeepSeek-V4.1-Flash-1017 leads Nemotron 3 Ultra by 42.5 points on StealthMark, 59.2 to 16.7. It leads on all 9 benchmarks. DeepSeek-V4.1-Flash-1017 scores higher on Newton's Mirror, with its largest category advantage in reflections.

See the difference ↘
All results ↗
All results ↗

Overall StealthMark

59.2/100Overall rank 9/53
16.7/100Overall rank 49/53

General Intelligence

56.8/100
12.2/100

Visual Intelligence

63.5/100
26.5/100

Reasoning efficiency

On every task, result quality and reasoning tokens are each compared with all measured models and weighed equally. Each dot is one model.

Single-step reasoning Result quality weighed against reasoning tokens on a single problem

Multi-step reasoning Result quality weighed against reasoning tokens across connected steps, as in agentic workflows

Open or local

Open modelMIT

BENCHMARK BY BENCHMARK

Where each model leads

  • DeepSeek-V4.1-Flash-1017
  • Nemotron 3 Ultra
  • Other models
  • Median

DATASHEET

Specs and pricing

DeepSeek-V4.1-Flash-1017 scores higher on StealthMark, is 2× cheaper per output token and runs 2.2× faster in our speed test. Both take about 1M tokens of context.

  • DeepSeek-V4.1-Flash-1017
  • Nemotron 3 Ultra
  • Other models
  • Median
PricePer 1M output tokens, input below
DeepSeek-V4.1-Flash-1017: $1.202× cheaper$0.30 inputNemotron 3 Ultra: $2.40$0.60 input
Context windowTokens per request, max output below
DeepSeek-V4.1-Flash-1017: 1MTied384K max outputNemotron 3 Ultra: 1MTied
Output speedTokens per second, our measurement
DeepSeek-V4.1-Flash-1017: 3102.2× fastertokens/sNemotron 3 Ultra: 139tokens/s
SizeTotal and active parameters
DeepSeek-V4.1-Flash-1017: 763B16B activeEstimatedNemotron 3 Ultra: 550B55B active
Developer
DeepSeek-AINVIDIA
Released
17 Oct 20264 Jun 2026
Origin
ChinaUnited States
Input → output
Text, image → textText → text
Architecture
Sparse mixture-of-experts with a causal encoder-decoder design and native image understanding.LatentMoE: Mamba-2 + MoE + Attention hybrid with Multi-Token Prediction

Full datasheets, every price and sourceDeepSeek-V4.1-Flash-1017 ↗Nemotron 3 Ultra ↗

Anticipating threats and planning ahead. Collect coins while avoiding ghosts. Ghosts move before the player each turn, and collisions cost a life. 3 levels in sequence, up to 66 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.

DeepSeek-V4.1-Flash-1017 52.9/100Rank 15/47

Survived 1 of 3
Foresight: complete playing field
Level 310 ptsTurn 15 / 20

Nemotron 3 Ultra 16.9/100Rank 41/47

Survived 0 of 3
Foresight: complete playing field
Level 38 ptsTurn 17 / 20

Points per level

LevelDeepSeek-V4.1-Flash-1017Nemotron 3 Ultra
Level 1Second Thoughts
26 ptsSurvived
4 ptsOut of lives
Level 2Pressure Pot
7 ptsOut of lives
4 ptsOut of lives
Level 3Hide or Flight
10 ptsOut of lives
8 ptsOut of lives

Cooperative planning and learning from experience. Coordinate two robots to push numbered cores onto matching sockets. Pressure plates hold doors open; moving either robot uses one turn. 5 levels in sequence, up to 152 turns in total. Earlier moves and outcomes carry forward, testing learning across levels.

DeepSeek-V4.1-Flash-1017 73.9/100Rank 13/48

Cleared 5 of 5
Latch: complete playing field
Level 520 ptsTurn 30 / 40

Nemotron 3 Ultra 5.0/100Rank 42/484 of 5 levels

4 of 5 played
Latch: complete playing field
Level 413.8 ptsTurn 21 / 40

Points per level

LevelDeepSeek-V4.1-Flash-1017Nemotron 3 Ultra
Level 1Hold the door
5.2 ptsCleared
5.2 ptsCleared
Level 2Crossfeed
9.8 ptsCleared
3.2 ptsFinished early
Level 3Relay vault
19.2 ptsCleared
7.4 ptsFinished early
Level 4Passing bay
16.4 ptsClearedFinished early · 3 beacons left
13.8 ptsFinished early
Level 5Second thoughts
20 ptsCleared
Not played

Newton's Mirror

Same task instructions

Physics, perspective and recursive reflections, tested together. Explore the test ↗

The judgment

DeepSeek-V4.1-Flash-1017

Principal sphere and airborne-black placements are supported, and diminishing bilateral chains provide limited optical structure. Missing nested imagery, incomplete outer chains, distorted first images and sparse emitter recurrence remain the dominant weaknesses. Oversized paint bodies and unresolved cyan contact impose separate limitations.

Nemotron 3 Ultra

The candidate establishes a separate airborne black blob and partial crimson overlap, but leaves the paint interaction history and settled support unresolved. Its main silhouette, black placement and lamp projection depart substantially from the required camera geometry. A few faint reflection hints provide little support for the extensive mirror system, while the compact paint volumes are visibly disproportionate.

Score breakdown

CategoryDeepSeek-V4.1-Flash-1017Nemotron 3 Ultra
State at 600 ms23.0/252.0/25
Camera and placement13.5/153.5/15
Reflections34.0/1204.5/120
Materials and scale8.5/103.0/10
Floor-damage reward0.0/100.0/10

Benchmark task

A spinning metal sphere and paint in a mirrored room test physical reasoning, perspective and consistency across repeated reflections.

Selfie

Different task instructions

Visual construction and creative interpretation.

The judgment

DeepSeek-V4.1-Flash-1017

An expressive, intricately drawn storybook scene with a complete flowing silhouette and differentiated glossy materials. The supported main lens and continuous shrimp body make the central interaction readable, but reciprocal eye lines, facial magnification and the smaller lens grip remain ambiguous. Bright granular fringes and crowded accessory lines limit the finish.

Nemotron 3 Ultra

An endearing mechanical creature is clearly framed, with expressive amber eyes and readable segmented arms. The shell resembles layered green plates more than a deep coiled spiral. Detached-looking construction, absent working contacts and patchy rendering leave the central assembly action substantially unresolved.

Score breakdown

CategoryDeepSeek-V4.1-Flash-1017Nemotron 3 Ultra
Task & likeness7.5/104.0/10
Anatomy & construction7.5/104.0/10
Space & placement8.0/105.5/10
Light & reflections7.0/105.0/10
Purposeful detail7.5/104.0/10
Artistry & character8.0/103.0/10
Materials & effects7.5/104.0/10
Visual integrity6.5/104.5/10

Benchmark task

DeepSeek-V4.1-Flash-1017

A whale and a tiny shrimp examine one another through bubble lenses, with an octopus nearby. The scene tests interacting characters, differences in scale and transparent materials.

Nemotron 3 Ultra

A hovering mechanical nautilus tests spiral construction, connected mechanical forms and contrasting metal and illuminated surfaces.

Mona Lisa

Same task instructions

Precise visual recall and portrait reconstruction.

The judgment

DeepSeek-V4.1-Flash-1017

A coherent graphic interpretation with controlled contours, modeled facial volume and purposeful portrait details. Replication remains limited by the frontal pose, enlarged face, altered expression and ambiguous crossed hands. Landscape layering provides depth, while schematic fabric, smooth surfaces and tonal bands constrain the finish.

Nemotron 3 Ultra

The centered silhouette provides basic organization, but multicolored mottling and geometric overlays leave the portrait unresolved. No readable face, crossed hands, clothing or landscape establishes Mona Lisa replication. Texture and transparency offer limited visual effects without coherent anatomy, lighting or material distinctions.

Score breakdown

CategoryDeepSeek-V4.1-Flash-1017Nemotron 3 Ultra
Task & likeness5.0/100.5/10
Anatomy & construction5.0/100.0/10
Space & placement6.0/101.0/10
Light & reflections6.0/100.5/10
Purposeful detail5.5/100.5/10
Artistry & character5.5/101.5/10
Materials & effects5.5/100.0/10
Visual integrity6.0/100.5/10

Benchmark task

An SVG interpretation of the Mona Lisa tests facial likeness, anatomy and the composition of a familiar portrait.

Beach

Same task instructions

Creativity, perspective and visual beauty.

The judgment

DeepSeek-V4.1-Flash-1017

A coherent, colorful beach illustration with controlled curves, clean layering and varied readable accessories. Castle details and small animal features strengthen its finish. Schematic airborne animals, uncertain board support, shallow architectural depth and decorative reflections limit physical coherence and drawing sophistication.

Nemotron 3 Ultra

A recognizable beach illustration with appealing warm-cool contrast, readable layers and mostly clean shapes. Unresolved seat construction, schematic animals and broad geometric foliage give it an elementary finish. Weakly coordinated reflections and limited material differentiation further constrain depth and atmosphere.

Score breakdown

CategoryDeepSeek-V4.1-Flash-1017Nemotron 3 Ultra
Task & likeness7.0/106.5/10
Anatomy & construction5.5/103.0/10
Space & placement5.5/105.0/10
Light & reflections6.0/101.5/10
Purposeful detail6.5/104.5/10
Artistry & character5.0/103.0/10
Materials & effects5.5/102.5/10
Visual integrity4.5/106.5/10

Benchmark task

A busy shoreline at sunset tests scene composition, animal forms and the relationship between light and water reflections.

Ground Truth

Same task instructions

Physical reasoning, light and visual reconstruction.

The judgment

DeepSeek-V4.1-Flash-1017

This benchmark has not been assessed yet.

Nemotron 3 Ultra

This benchmark has not been assessed yet.

Benchmark task

A plank, computer mouse and blueberry in a steel room test physical stability, spatial relationships, materials and lighting.

Raccoon

Different task instructions

Scene composition and interacting subjects.

The judgment

DeepSeek-V4.1-Flash-1017

An appealing cartoon with recognizable riders, expressive faces and a cohesive twilight palette. Clean shapes support the composition, but ambiguous limb overlaps, weak seat contact and loosely resolved steering limit physical coherence. Lighting and water effects are decorative, with modest material differentiation and drawing complexity.

Nemotron 3 Ultra

The masked raccoon, dog and orange craft make the scene recognizable, with an appealing sunset palette. Overlapping bodies obscure the riding relationship, and the dog's connection to the controls remains unresolved. Weak water displacement, inconsistent shading and visible shape artifacts limit the finish. Ambiguous attachments do not establish detached limbs or inverted anatomy.

Score breakdown

CategoryDeepSeek-V4.1-Flash-1017Nemotron 3 Ultra
Task & likeness8.0/103.5/10
Anatomy & construction7.0/101.5/10
Space & placement7.0/104.5/10
Light & reflections6.5/102.0/10
Purposeful detail7.0/103.5/10
Artistry & character7.0/101.5/10
Materials & effects6.5/103.0/10
Visual integrity8.0/102.0/10

Benchmark task

A jet-ski scene pairs a canine driver with a raccoon passenger. It tests the placement and contact of interacting subjects, along with vehicle construction.

Pelican

Same task instructions

Subject construction and spatial relationships.

The judgment

DeepSeek-V4.1-Flash-1017

An expressive, controlled illustration with continuous body construction, substantial bicycle detail and effective landscape depth. Unclear foot-to-pedal and wing-to-handlebar contacts limit physical conviction and local readability. Purposeful detail and composition are stronger than directional lighting and material treatment.

Nemotron 3 Ultra

A recognizable, playful pelican dominates a readable bicycle scene. Its bill and silhouette succeed, but feet below the pedals and confused drivetrain connections weaken the riding action. Local material modeling adds interest; overlapping contours, repetitive detail and inconsistent shadows leave the illustration basic and uneven.

Score breakdown

CategoryDeepSeek-V4.1-Flash-1017Nemotron 3 Ultra
Task & likeness8.5/104.0/10
Anatomy & construction7.0/103.5/10
Space & placement7.5/103.5/10
Light & reflections6.5/104.0/10
Purposeful detail7.5/105.5/10
Artistry & character7.0/104.0/10
Materials & effects7.0/106.0/10
Visual integrity7.5/103.0/10

Benchmark task

A cycling pelican tests anatomy, riding posture and contact between the bird and the bicycle.