Tag

#Sparse Attention

2 articles

Meituan Releases LongCat-2.0: A 1.6T-Parameter Open MoE Model with Native 1M Context and LongCat Sparse Attention

This article explains the advanced technical concepts behind Meituan's LongCat-2.0, a 1.6 trillion-parameter Mixture-of-Experts model with native 1-million-token context and LongCat Sparse Attention.

Jul 538

MiniMax Releases MiniMax M3 with MSA Architecture Supporting 1M-Token Context, Native Multimodality, and Agentic Coding

Learn how MiniMax M3, a new AI model, can process massive amounts of information and handle multiple types of data like text, images, and video.

Jun 164