A look at extending pre-trained representations with document retrieval to better solve downstream tasks.| machine learning musings
This post introduces techniques that probe the LLM’s internal confidence and knowledge boundaries. We explore prompt-based confidence detection, consistency-based uncertainty estimation, and internal state analysis approaches to determine when retrieval is truly necessary.| Sumit's Diary
This is based on the AQA unit of Homeostasis and Response. I used to be scared of teaching homeostasis. As someone who studied Biology, I struggled with how to best explain it without overwhelming my students, reducing the unit to a list of disparate facts, and somehow help them succeed at assessments. There is the […]| Memory, meaning and motivation
I used to think that success was about students doing well in a single lesson. If they could answer my questions correctly, I believed I had achieved what I set out to do. I now realise that this v…| Memory, meaning and motivation
Building on part 1’s exploration of naive RAG’s limitations, this post introduces adaptive retrieval frameworks and pre-generation retrieval decision-making methods that determine if retrieval is truly necessary.| Sumit's Diary
I was recently invited to debate the utility of “pre-testing” or pre-questions as an instructional strategy in a new webinar with my friends at InnerDrive (link here). I wish I had prepared and performed better, but it turned out to be good fun anyway. Below is the recording, as well as some lingering thoughts about … Continue reading Why I’m Skeptical About Pre-Testing| Education Rickshaw
Retrieval-Augmented Generation (RAG) isn’t a silver bullet. This post highlights the hidden costs associated with RAG and makes the case for a smarter, adaptive approach.| Sumit's Diary
The Why, Who, and How of Retrieval Editor’s Note: This essay is a lightly edited version of the keynote lecture delivered at the inaugural Camp AmRef. Six months ago, John Ehrett created quite the stir| American Reformer
PS: thanks for all the interest, here you are some discussions about VectorVFS as well: Hacker News: discussion thread Reddit: discussion thread When I released The post VectorVFS: your filesystem as a vector database first appeared on Terra Incognita.| Terra Incognita
When I was younger, I used to struggle with maths. I simply could not get a concept quickly enough, while nearly everyone around me seemed to pick things up straightaway. I would get homework that …| Memory, meaning and motivation
Interleaving practice can surpass blocked practice in improving learning outcomes. A study from 2022 provides an easy to understand and apply example for classroom implementation. The post Easy Application of Interleaving in the Classroom appeared first on The Effortful Educator.| The Effortful Educator
Homework has the power to elevate learning. This is the first line of my book, The Homework Conundum, and I stand by it. When done right, homework is a way for students to take ownership of their l…| Memory, meaning and motivation
Recently, I heard a teacher say how good they were at building relationships in their classroom. They suggested that their subject (PE) meant they found it easier to do so and that as a result the …| Dr C's Science Classroom
Retrieval Augmented Generation (RAG) is a simple yet powerful approach that can be used to improve the performance of LLMs on a wide range of tasks.| LLMStack Blog
