Tag

#latency reduction

3 articles

Netflix AI Team Cuts Wide-Partition Read Latency from Seconds to Milliseconds by Splitting Cassandra Partitions Per ID

Netflix engineers reduced Cassandra read latency from seconds to milliseconds by splitting wide partitions per TimeSeries ID, enhancing system scalability and performance.

Jul 89

Reduce friction and latency for long-running jobs with Webhooks in Gemini API

Google's Gemini API now supports webhooks to reduce latency and friction for long-running AI jobs. The feature eliminates the need for constant polling and improves efficiency for complex AI workloads.

May 947

Salesforce AI Research Releases VoiceAgentRAG: A Dual-Agent Memory Router that Cuts Voice RAG Retrieval Latency by 316x

Salesforce AI Research introduces VoiceAgentRAG, a dual-agent memory router that cuts voice RAG retrieval latency by 316 times, enhancing conversational AI responsiveness.

Mar 3091