Tag

#memory optimization

4 articles

A startup says the AI bottleneck isn’t compute. It’s memory, and it ditched the GPU to prove it.

Majestic Labs, a startup founded by former Google and Meta engineers, introduces a memory-centric AI server that claims to outperform traditional GPU setups by addressing the real bottleneck in AI hardware.

Aug 346

tech

An End-to-End Coding Guide to NVIDIA KVPress for Long-Context LLM Inference, KV Cache Compression, and Memory-Efficient Generation

NVIDIA's KVPress offers a memory-efficient solution for long-context language model inference through advanced KV cache compression, enabling more scalable AI applications.

Apr 996

Paged Attention in Large Language Models LLMs

Paged Attention emerges as a key solution to the GPU memory bottleneck in large language models, enabling more efficient memory usage and higher concurrency in AI inference systems.

Mar 24135

tech

How to clear your iPhone cache (and why it's critical for faster performance)

This explainer article dives into the technical mechanisms of iPhone cache management and how clearing cache improves system performance through advanced memory management techniques.

Mar 20154