What actually matters in vector databases in 2025, why “modern search for AI” is different, and how to ship systems that don’t rot as context grows.| www.latent.space
How we can use AI for as a "partner in thought", losing faith in long context windows for improved reasoning, and why we should stop anthropomorphizing LLMs| www.latent.space
Scaling Llama3 beyond 1M context window with ~perfect utilization, the difference between ALiBi and RoPE, how to use GPT-4 to create synthetic data for your context extension finetunes, and more!| www.latent.space
5 recent Latent Space appearances for you to get your LS fix on all AI Engineering topics imaginable.| www.latent.space