Today I was reading OpenAI guide on model selection https://platform.openai.com/docs/guides/model-selection where they explained how to calculate a reaslistic accuracy target for LLM task by evaluating financial impact of model decisions. They gave an example of fake news classifier. This is a good way to find the accuracy you need for the task. Break-even accuracy is … Continue reading "Setting a realistic accuracy target for LLM tasks"
