What is an on-device agentic AI model?
Imagine you have a smart assistant that can think, plan, and complete tasks all by itself — right on your phone or computer, without needing to connect to the internet. That's what Liquid AI's new LFM2.5-2.6B model does. It's a type of artificial intelligence (AI) that can work on-device, meaning it runs directly on your device rather than on powerful servers in data centers. This model is also agentic, which means it can plan its actions, use tools, and do complex tasks — all without needing to be connected to the internet.
What is it?
Let's break this down:
- On-device: The model runs on your device, like your laptop or phone. This means it can process information and make decisions without sending data to the cloud.
- Agentic: It's not just a simple AI that answers questions. It can plan steps, use tools (like a calculator or web browser), and complete multi-step tasks all by itself.
- 2.69 billion parameters: These are the model's 'learning knobs' — the numbers that help it understand and process information. The more parameters, the smarter it can be.
- 128K context: This means the model can understand and remember a lot of information at once — about 128,000 words, which is like reading a long book and remembering everything in it.
How does it work?
Think of this AI model like a very smart robot that works in your pocket. It's made up of layers of math that help it learn. These layers are like steps in a recipe. The model has 30 layers, and each one is a little different, helping it understand language, solve problems, and even call tools when needed.
Here’s a simple analogy: Imagine you're a chef, and you're making a complicated dish. You need to plan, gather ingredients, use different tools, and follow steps. This AI model does something similar. It looks at a task, thinks about how to do it, uses tools (like a calculator or search engine) if needed, and finishes the job — all on your device.
It also works very quickly. On a powerful laptop (called an M5 Max), it can process over 220 words per second, and it only needs about 2.5 gigabytes of memory — less than a typical movie!
Why does it matter?
This kind of AI is important for several reasons:
- Privacy: Because it runs on your device, your personal information never leaves your phone or computer, keeping your data private.
- Speed: It works quickly without needing to wait for internet connections or server responses.
- Autonomy: It can complete complex tasks on its own, like planning a trip or solving a math problem, without needing help from the internet.
- Open weights: This means that other developers and researchers can look at how it was built, learn from it, and even improve it — making the whole AI field more open and collaborative.
Key takeaways
- On-device AI models like LFM2.5-2.6B can run locally on your devices, without needing the internet.
- These models are agentic, meaning they can plan, use tools, and do complex tasks by themselves.
- They can handle a lot of information at once (up to 128,000 words) and work very quickly.
- They're memory-efficient and open-source, meaning anyone can study and improve them.
