#inference

Taalas is replacing programmable GPUs with hardwired AI chips to achieve 17,000 tokens per second for ubiquitous inference

Toronto startup Taalas is pioneering hardwired AI chips that can process 17,000 tokens per second, challenging the dominance of programmable GPUs in AI inference.