We’re on a journey to advance and democratize artificial intelligence through open source and open science.| huggingface.co
Scaling Llama3 beyond 1M context window with ~perfect utilization, the difference between ALiBi and RoPE, how to use GPT-4 to create synthetic data for your context extension finetunes, and more!| www.latent.space
Why Google failed to make GPT-3, how Adept is the "most misunderstood company" in AI, why multimodal knowledge work models like Fuyu are the future of AGI, and why Adept is NOT a research lab| www.latent.space
Bard gets its most capable model yet, along with new and expanded features.| Google
Introducing Dolly, the first open-source, commercially viable instruction-tuned LLM, enabling accessible and cost-effective AI solutions.| Databricks
Back to foundations! The origins of RLHF, sociology's influence on it, the tension between human vs synthetic data, and emerging research in the field| www.latent.space
The Data Wars, The War of the GPU Rich/Poor, The Multimodality War, The RAG/Ops War. Also: our usual highest-signal recap of top items for the AI Engineer from Dec 2023!| www.latent.space
What are our LLMs actually trained on, and are we actually running out of data?| www.latent.space