Question: What’s the most powerful AI model you can train on a MacBook Pro in just five minutes? Short answer: The best I managed was a ~1.8M parameter GPT-style transformer, trained on ~20M TinyStories tokens. It reached a perplexity of ~9.6 on a held-out split. Example output (prompt in bold): Once upon a time, there was a little boy named Tim. Tim had a small box that he liked to play with. He would push the box to open. One day, he found a big red ball in his yard. Tim was so happy. He ...
