Mistral AI Releases Mistral Large 4 (Le Chonk): A 1.05T Parameter Multimodal MoE Model
Back to Home
ai

Mistral AI Releases Mistral Large 4 (Le Chonk): A 1.05T Parameter Multimodal MoE Model

October 6, 202678 views2 min read

Mistral AI has released Mistral Large 4, a 1.05 trillion parameter multimodal MoE model with native image input and a 1 million token context window. The API is live, with open weights to follow in October 2026.

Mistral AI has unveiled its latest breakthrough in multimodal artificial intelligence with the release of Mistral Large 4, a 1.05 trillion parameter model colloquially known as Le Chonk. This new iteration represents a significant leap forward in the company’s quest to build powerful, efficient, and scalable AI systems. The model features a Mixture of Experts (MoE) architecture, with 49 billion active parameters, and supports native image input, making it a versatile tool for handling both text and visual data.

Technical Highlights and Infrastructure

Trained on an impressive 3,800 NVIDIA Grace Blackwell GPUs, Mistral Large 4 is powered by Mistral's own European datacenters, reinforcing the company's commitment to data sovereignty and high-performance computing. The model boasts a context window of up to 1 million tokens, a feature that allows it to process and understand significantly longer inputs than many of its competitors. This makes it especially suitable for complex tasks such as long-form content generation, document analysis, and multi-step reasoning.

Open Access and Future Availability

The API for Mistral Large 4 is now live, enabling developers and enterprises to experiment with its capabilities. Meanwhile, the open weights of the model will be made available by the end of October 2026, aligning with Mistral AI's broader strategy of promoting open-source innovation. This move positions Mistral Large 4 as not only a powerful commercial product but also a valuable resource for researchers and developers in the AI community.

With its advanced architecture, extensive context window, and multimodal capabilities, Mistral Large 4 is poised to compete with leading models in the industry. As AI systems continue to evolve, Mistral AI's latest release underscores the ongoing trend toward larger, more efficient, and more accessible models that can handle increasingly complex tasks.

Source: MarkTechPost

Related Articles