After reading Kiran’s blog on self-hosting LLMs, I decided to try it out myself to see how viable they are for real-world tasks. Since I was already working on the Text-to-SQL problem with my colleagues, this seemed like the perfect use case to evaluate.
