rkj dev

NVIDIA Releases Nemotron 3.5 Super VL Open Multimodal Agent Model

The 120-billion-parameter open-weights mixture-of-experts model pairs vision and reasoning for continuous enterprise workflows, accompanied by two edge-focused Bolt models.

Digital visualization of server racks and glowing data streams representing multimodal artificial intelligence models.
Illustration: Conceptual depiction of high-efficiency multimodal agent architectures operating in enterprise server infrastructure.AI-generated illustration

In short

  • Nemotron 3.5 Super VL uses a 120B mixture-of-experts architecture activating 12B parameters per token for document intelligence, coding, and tool use.
  • NVIDIA reports the model achieves up to 5x higher throughput on agentic workloads than other open models in its size category.
  • NVIDIA also launched the local Nemotron 3.5 Bolt 74B-A9B model fitting in 24GB VRAM, with the smaller Bolt E4B arriving on October 23, 2026.
  • Weights, training recipes, and open datasets—including a 2.8-trillion-token Indic dataset across 22 languages—are released under the OpenMDW-1.1 license, with the model trained on roughly 26 trillion pretraining and continued pretraining tokens.

On October 15, 2026, NVIDIA released Nemotron 3.5 Super VL, an open 120-billion-parameter multimodal model designed to execute complex reasoning, visual inspection, and tool-calling workflows for enterprise software agents. Built in partnership with the Nemotron Coalition—an industry group that includes Mistral AI, Thinking Machines Lab, Perplexity, and Black Forest Labs—the release targets organizations seeking continuous, autonomous agents that can parse visual documents and take actions without routing data through proprietary third-party cloud services.

According to the NVIDIA Technical Blog, Nemotron 3.5 Super VL relies on a Mixture-of-Experts (MoE) architecture that activates only 12 billion parameters per token. This design combines text, document, chart, image, and video processing in a single system, eliminating the need to pass context back and forth between separate text and vision-language models.

An engineer reviewing complex document charts and code traces on multi-monitor displays.
Illustration: Visual document processing and code analysis performed by enterprise reasoning models.AI-generated illustration

Multimodal Architecture and Performance Metrics

NVIDIA reported in its official announcement blog that Nemotron 3.5 Super VL delivers accuracy comparable to its flagship Nemotron 3 Ultra reasoning model while running at approximately one-fifth the parameter footprint. NVIDIA distilled Super VL directly from Nemotron 3 Ultra using multi-teacher on-policy distillation (MOPD) alongside SkewReverse loss to retain coding proficiency.

On behavioral agent evaluations, Super VL scored 63.44% on Hermes Bench and 87.05% on LangChain evaluations, surpassing Nemotron 3 Ultra's marks of 56.33% and 84.3%, respectively. When tested on the CharXiv chart reasoning benchmark, the model scored 80.8%—rising to 84% when permitted to execute Python code interpretation—outperforming the 63% score set by Nemotron 3 Nano Omni. In software engineering tasks, NVIDIA noted the model outperforms Nemotron 3 Super across SWE-bench and Terminal-Bench.

For inference performance, testing on the Artificial Analysis Intelligence Index reported by VentureBeat showed Super VL reached roughly 625 tokens per second on four NVIDIA Blackwell B200 GPUs. NVIDIA claims this offers up to a 5x throughput advantage over comparable open models like Inkling Small. However, VentureBeat reported that on the composite Artificial Analysis index score, Super VL registered a score of 26, trailing other open alternatives such as GLM-5.3-Flash at 42 and Qwen3.8-Flash-Next at 40.

Edge Inference with Nemotron 3.5 Bolt

Alongside the data-center-scale Super VL model, NVIDIA launched the Bolt line of edge models intended for local deployment on workstations and personal computers, detailed on Hugging Face.

The Nemotron 3.5 Bolt 74B-A9B model compresses the architecture to 74 billion total parameters with 9 billion active parameters using Star Elastic, a router-guided architectural search. Using native 2-bit quantization (IQ2), the model fits within 24GB of memory, allowing it to run concurrently with local desktop applications on hardware such as NVIDIA DGX Spark, RTX PRO systems, and GeForce RTX PCs. Bolt supports popular inference frameworks including vLLM, llama.cpp, Ollama, and LM Studio, according to technical integration work logged on GitHub.

NVIDIA reported that Bolt 74B-A9B ranks first in its class on PinchBench and second on BrowseComp. A second local model, Bolt E4B, requires 4GB of memory for interactive voice assistants and embedded devices, with availability scheduled for October 23, 2026.

A compact desktop computing workstation processing automated digital agent workflows.
Illustration: Local edge hardware executing agentic tasks using quantized open models.AI-generated illustration

Customization and Enterprise Deployments

NVIDIA designed Super VL for post-training using NVIDIA NeMo, permitting organizations to customize the open weights on proprietary datasets using supervised fine-tuning (SFT) and low-rank adaptation (LoRA). As reported by The Decoder, several early adopters have deployed customized checkpoints for specialized internal workflows.

Scale AI fine-tuned Super VL for automated vendor credit processing at Skydance Corporation, with Skydance expecting a 40x drop in inference costs and a 5x latency reduction. Scale AI also developed an agent for Ernst & Young for merger-and-acquisition due diligence. Financial platform Ramp adapted the model to extract merchant names, dates, and amounts from receipt photographs into structured JSON, projecting 10x lower latency. In cybersecurity, AI21 and Alice reported a 41% accuracy gain after tuning Super VL for vulnerability remediation and threat intelligence. Additional partners incorporating the model include Salesforce for government workflow automation, CrowdStrike for enterprise defense, Perplexity for search tasks, Atlassian, and Dassault Systèmes.

VentureBeat pointed out that while post-trained Super VL variants showed task-specific gains of 9% to 44% over baseline models, these specialized gains reflect targeted fine-tuning rather than general zero-shot superiority across broad benchmarks.

Open Datasets, Licensing, and Hardware Optimization

Super VL underwent pretraining and continued pretraining across roughly 26 trillion tokens, followed by 3.8 million post-training samples and reinforcement learning across approximately 100 environments. To expand multilingual capability, NVIDIA partnered with IIT Madras and its AI4Bharat laboratory to add 10 billion Indic tokens during continued pretraining. As part of the release, NVIDIA published the complete 2.8-trillion-token dataset covering 22 Indian languages on Hugging Face.

For inference efficiency, the model implements multi-token prediction (MTP) and LiLiCorr, an open speculative decoding technique that evaluates draft candidates across entire token sequences, which NVIDIA reports delivers up to 2.3x faster token generation on DGX Spark. According to NVIDIA, under Dynamo distributed serving, request affinity routing and KV-cache offloading on 16 B200 GPUs served up to 8x more concurrent users while reducing time-to-first-token by 85%.

Nemotron 3.5 Super VL is available on Hugging Face, ModelScope, OpenRouter, and as an NVIDIA NIM microservice. Model weights and recipes are governed under the OpenMDW-1.1 license for commercial and research use. While free developer access is available via rate-limited endpoints, production deployments running via NVIDIA AI Enterprise NIM microservices carry a software licensing fee of $4,500 per GPU annually, excluding infrastructure and compute costs.

Questions people ask

What is the parameter count of Nemotron 3.5 Super VL?

Nemotron 3.5 Super VL is a 120-billion-parameter mixture-of-experts model that activates 12 billion parameters per token.

What are the Nemotron 3.5 Bolt models?

Nemotron 3.5 Bolt models are local variants designed for consumer and edge hardware. Bolt 74B-A9B uses 2-bit quantization to fit into 24GB of VRAM, while Bolt E4B is a 4GB model scheduled for release on October 23, 2026.

What license does Nemotron 3.5 Super VL use?

The model weights, datasets, and training recipes are licensed under the OpenMDW License Agreement, version 1.1, allowing both commercial and non-commercial deployment.

How does Nemotron 3.5 Super VL handle both vision and language?

The model incorporates a C-RADIO v4-H vision encoder connected to an MoE backbone, allowing it to parse images, PDFs, charts, tables, and video without requiring a secondary vision model.

Sources

  1. NVIDIA Nemotron 3.5 Super VL Powers Specialized Agents with Multimodal ReasoningNVIDIA Technical Blog, Oct 15, 2026, official source
  2. Open From Data Center to Desktop: NVIDIA Expands Nemotron Family With Highest Efficiency Super VL and Bolt ModelsNVIDIA Blog, Oct 15, 2026, official source
  3. nvidia/NVIDIA-Nemotron-3.5-Bolt-74B-A9B-24GBHugging Face, Oct 7, 2026, official source
  4. Add Nemotron Super 3.5 VL and Nemotron Bolt 74B A9B support by frozenblade1224 · Pull Request #30520 · ggml-org/llama.cppGitHub, official source
  5. nvidia/Nemotron-3.5-Rerank-8B-BF16Hugging Face, Oct 15, 2026, official source
  6. NVIDIA's new, open Nemotron 3.5 Super VL with post-training beats Claude Opus 5, GPT-6.1 Sol on specialized task benchmarksventurebeat.com, Oct 15, 2026
  7. Nvidia's Nemotron 3.5 Super VL is an open model built to run enterprise AI agents nonstopThe Decoder, Oct 15, 2026

How this story was made: the newsroom picked it up from developer.nvidia.com, Google News and blogs.nvidia.com, gathered the full text of the sources above, and drafted it with AI assistance. Every factual claim was then checked against those sources before publishing (27 claims checked). Illustrations marked as AI-generated are not photographs. Spotted an error? Tell us.

#NVIDIA #Nemotron #Multimodal AI #Open Weights #AI Agents

Published October 16, 2026 at 00:50 UTC