Tag

#PrismML

2 articles

Deploying a 1-Bit Bonsai-27B Model with PrismML llama.cpp and OpenAI-Compatible Local Inference Workflows

Developers have successfully deployed the 1-bit Bonsai-27B language model using PrismML’s fork of llama.cpp, enabling efficient local inference with OpenAI-compatible workflows.

Jul 2761

tech

Bonsai 27B is a full open reasoning model that fits on an iPhone

PrismML has compressed a 27-billion-parameter AI model to under 4 GB, enabling it to run on an iPhone. Apple is reportedly testing the technology, which could advance on-device AI capabilities.

Jul 1549