Todays Top News
Scaling LLM-Based Ranking Systems for Latency-Critical Search & Recommendation Workloads
Sundara Raman Ramachandran discusses how LinkedIn productionizes LLM ranking under strict P99 latency SLAs, including model optimizations, context optimizations, and inference optimizations.