I recently wanted to learn about GGML, a tensor and machine learning library behind popular open source versions of LLaMA and Whisper. Trying to find good resources on GGML is hard, so I thought I’d write up some preliminary notes for anyone looking to get started. Before reading the rest of this, please consider the following resources, especially the first link – the examples in the GGML repository are a great starting point:
