rkj dev

Inception Releases Mercury 3 Diffusion LLM at Inception's Self-Reported 1,068 Tokens per…

Inception AI's fourth-generation diffusion language model uses parallel refinement to hit over 1,000 tokens per second according to Inception's self-reported measurements, while expanding context to one million tokens.

Server hardware racks processing parallel text diffusion data in an illuminated facility
Illustration: Parallel diffusion models refine entire blocks of text simultaneously, bypassing traditional sequential generation limits.AI-generated illustration

In short

  • Inception released Mercury 3 on October 19, 2026, claiming generation throughput of 1,068 tokens per second on Nvidia GPUs.
  • The model relies on iterative parallel diffusion refinement rather than sequential, autoregressive token generation.
  • Mercury 3 features a 1 million token context window and a maximum completion limit of 131,072 tokens.
  • On Inception's vendor benchmarks, Mercury 3 led OpenAI's GPT-6 Luna and Anthropic's Claude Haiku 5.5 on eight of 12 tests, but trailed on deep coding and long-context recall.
  • Available via API starting at promotional rates of $0.10 per million input and $0.35 per million output tokens, with cached input discounted by 90%.

Redwood City-based artificial intelligence lab Inception AI Inc. launched its Mercury 3 diffusion LLM on October 19, 2026, pitching a diffusion-based language model designed to bypass the sequential bottlenecks of standard conversational architectures. According to Inception's announcement, the model generates up to 1,068 tokens per second during inference on Nvidia Corp. hardware. The release marks the startup's fourth iteration of its architecture, which Inception states scales the parameter count to more than 40 times the size of its initial Mercury 1 release while expanding its context window to 1 million tokens.

While the vast majority of production text generation relies on autoregressive models that predict one token at a time from left to right, Inception is wagering on text diffusion. In this paradigm, the system generates a noisy draft of an entire response block and refines every token simultaneously across a sequence of parallel passes. Chief Executive Stefano Ermon told The Deep View (as quoted by The Next Web) that Mercury 3 is comparable to Luna and Haiku but way faster, and The Next Web reported the 4x to 8x benchmark speedup based on Inception's figures.

Mercury 3 Diffusion LLM Architecture Versus Autoregressive Generation

Traditional autoregressive models must complete each token before computing the next, which inherently constrains execution throughput on parallel processor clusters. Mercury 3 eliminates that sequential dependency by applying continuous refinement passes across full blocks of text, akin to the techniques popularized by image diffusion models. As reported by Marktechpost, fewer sequential execution steps translate directly into higher output volume on equivalent server hardware.

A person using smart glasses for low-latency visual queries outdoors
Illustration: Fast token generation reduces latency for wearable devices like smart glasses.AI-generated illustration

Inception reported that Mercury 3 delivers three times the general intelligence of its initial release on standard benchmark evaluations while maintaining identical inference velocity. Ermon commented on scaling, as reported by SiliconANGLE, stating that internal progress refutes long-standing industry skepticism over whether diffusion architectures can scale to compete with mainstream language systems, arguing that performance limitations stem from available data and compute rather than structural algorithmic walls. To accelerate development, Inception used swarms of Mercury 3 agents to improve the model itself as recursive self-improvement, an approach Ermon stated yielded an extra 16% speed increase on top of manual optimizations.

Benchmark Scores Against GPT-6 Luna and Claude Haiku 5.5

On Inception's self-reported evaluations across 12 standard benchmarks conducted at medium reasoning effort, Mercury 3 outperformed rival low-latency models—OpenAI's GPT-6 Luna and Anthropic's Claude Haiku 5.5—in eight categories. According to data published by Marktechpost, Mercury 3 recorded a score of 51.08 on SWE-Bench Atlas, substantially higher than GPT-6 Luna's 33.33 and Claude Haiku 5.5's 32.26. The model also posted leads on IFBench with 76.84 against Luna's 61.82 and Haiku's 54.65, and reached 89.23 on GPQA Diamond.

The vendor data also highlights notable blind spots. Claude Haiku 5.5 outperformed Mercury 3 on the DeepSWE v1 coding benchmark, scoring 51.62 compared to Mercury 3's 46.31. Haiku 5.5 also led in long-context retrieval, logging 78.40 on MRCR v2 compared to Mercury 3's 75.50. Additionally, GPT-6 Luna edged out Mercury 3 by narrow fractions of a point on AA-Omniscience-Public (46.94 to 46.44) and AA-LCR v1.1 (78.30 to 77.67). Inception acknowledged that sustained long-context retrieval and longer coding tasks continue to present difficulties for the model.

Early Integrations and Hands-On Testing

To demonstrate real-world utility, Inception highlighted early production integrations with business partners operating latency-dependent products. Web-navigation startup TinyFish reported running Mercury 3 across 50 live Mind2Web browser tasks, completing 50% of assignments at parity in token counts and steps compared to frontier models, outperforming GPT-6.1-Sol. Smart-glasses search provider Octen AI measured a median generation latency of 0.9 seconds and an end-to-end response time of 2.2 seconds, where previous five-second delays hindered user interaction. Interactive education app RevisionDojo reported that hints and graded student submissions return in approximately one second.

A student reviewing interactive digital coursework on a tablet computer
Illustration: Near-instant model responses enable responsive interactive tutoring applications.AI-generated illustration

Independent workflow examinations confirmed noticeable responsiveness alongside clear technical boundaries. In a hands-on review published by MindStudio, Mercury 3 solved subtle real-world application bugs—such as locating an unflagged logic discrepancy in a donor registry compliance app without explicit error traces—and succeeded on physical reasoning and multilingual instruction tasks with minimal deliberation delay. However, on open-ended, extended creative coding challenges, including generating interactive vector-based applications, the model slowed significantly, encountered temporary execution loops, and exhibited weaker tool calling coordination.

Pricing, Architecture, and Enterprise Availability

Mercury 3 is offered strictly as an API service without downloadable weights. According to The Rundown University, the model supports an input context window of up to 1 million tokens and a maximum completion length of 131,072 tokens, which subsumes both internal reasoning tokens and visible output. The API exposes adjustable reasoning settings—Instant, Low, Medium, and High—and maintains complete compatibility with OpenAI's API standards to facilitate straightforward migration.

Inception set list pricing at $0.20 per million input tokens and $0.70 per million output tokens, accompanied by a 50% launch promotion dropping costs to $0.10 for inputs and $0.35 for outputs. Prompt caching provides a 90% discount on cached inputs, reducing that portion to $0.01 per million tokens during the promotion. New enterprise and developer accounts receive an allotment of 100 million free tokens. Access is currently hosted via Inception's proprietary portal as well as third-party aggregators OpenRouter, Baseten, and Vercel's AI Gateway. Alongside the main release, Inception introduced two specialized sister variants: Mercury Voice, configured to minimize time-to-first-token in conversational audio agents, and Mercury Decide, optimized for automated high-volume classification workflows.

Questions people ask

How does a diffusion language model differ from an autoregressive LLM?

Autoregressive models write text sequentially token by token from left to right, with each token depending on the preceding one. Mercury 3 uses text diffusion, drafting a block of text all at once and iteratively refining all tokens in parallel, which substantially increases generation speed on GPUs.

What is the token generation speed and context length of Mercury 3?

Inception reports an inference speed of 1,068 tokens per second on Nvidia GPUs, paired with a 1 million token context window and a maximum completion output of 131,072 tokens.

How much does Mercury 3 cost to use?

Standard list pricing is $0.20 per million input tokens and $0.70 per million output tokens. At launch, Inception offers a 50% promotional discount ($0.10 input, $0.35 output), with cached inputs discounted by 90% and 100 million free trial tokens for new accounts.

Are the model weights for Mercury 3 open source?

No. Mercury 3 is closed-source and available exclusively through API endpoints provided by Inception, Baseten, OpenRouter, and Vercel.

Sources

  1. Inception says its Mercury 3 model beats GPT-6 Luna and runs far fasterTNW | Artificial-intelligence, Oct 20, 2026
  2. Inception Releases Mercury 3 Diffusion LLM at 1,068 Tokens per Secondmarktechpost.com, Oct 19, 2026
  3. Inception says Mercury 3 beats GPT-6 Luna and Claude Haiku 5.5 at up to 8x the speedSiliconANGLE, Oct 20, 2026
  4. Diffusion at Scale: Introducing Mercury 3 – Inceptioninceptionlabs.ai, Oct 19, 2026
  5. Mercury 3 by Inception: A Hands-On Test of the Diffusion Language ModelMindStudio, Oct 20, 2026
  6. Mercury 3: How to Use Inception’s Fast AI ModelThe Rundown University, Oct 20, 2026

How this story was made: the newsroom picked it up from Hacker News, Techmeme and Google News, gathered the full text of the sources above, and drafted it with AI assistance. Every factual claim was then checked against those sources before publishing (49 claims checked). Illustrations marked as AI-generated are not photographs. Spotted an error? Tell us.

#Inception AI #Mercury 3 #Diffusion LLM #AI Hardware #LLM Benchmarks

Published October 21, 2026 at 02:21 UTC