Liquid AI Releases LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: Bidirectional Encoders That Stay Fast at 8K Context on CPU
Back to Home
ai

Liquid AI Releases LFM2.5-Encoder-230M and LFM2.5-Encoder-350M: Bidirectional Encoders That Stay Fast at 8K Context on CPU

July 29, 202640 views2 min read

Liquid AI has released two open-weight bidirectional encoders, LFM2.5-Encoder-230M and LFM2.5-Encoder-350M, which maintain fast performance at 8K context on CPU hardware.

Liquid AI has announced the release of two new open-weight bidirectional encoders, the LFM2.5-Encoder-230M and LFM2.5-Encoder-350M, designed to maintain high performance even at extended context lengths. Both models feature an 8,192-token context window and are built upon the LFM2 hybrid backbone, a framework that combines efficiency with scalability. These releases are particularly notable for their ability to operate effectively on CPU hardware, a significant advantage in environments where GPU resources are limited or unavailable.

Performance and Efficiency

The LFM2.5-Encoder-350M, with its 350 million parameters, ranks fourth among 14 models in a comprehensive evaluation across GLUE, SuperGLUE, and multilingual benchmarks. While it trails behind larger models, its performance is impressive for its size and context capacity. Meanwhile, the LFM2.5-Encoder-230M delivers a notable 8K-token forward pass on CPU in approximately 28 seconds, showcasing its speed and practicality for real-world deployment. This performance makes it a strong contender for applications where computational resources are constrained but long-context processing is essential.

Implications for AI Development

These new models represent a growing trend in the AI industry toward lightweight, efficient architectures that do not compromise on performance. As AI applications expand into edge computing and resource-constrained environments, models like these offer a compelling balance between capability and accessibility. Liquid AI’s approach to combining large context windows with CPU-friendly processing may influence how future models are developed, particularly for tasks involving long document analysis or conversational AI.

The open-weight nature of these models also encourages broader adoption and experimentation within the developer community, potentially accelerating innovation in natural language processing tasks.

Source: MarkTechPost

Related Articles