#inference engine

Perplexity Open Sources Lily: A Rust + Metal Inference Engine for Qwen3.6-35B-A3B on Apple Silicon

This article explains how Perplexity's open-sourced Lily inference engine optimizes large language model execution on Apple Silicon using Rust and Metal, achieving significant performance gains over existing solutions.