Recent large language models such as Llama 3 and GPT-4 are trained on gigantic amounts of text. Next generation models need 10x more. Will that be possible? To try to answer that, here’s an estimate of all the text that exists in the world. Firstly, here’s the size of some recent LLM training sets, with […]| Educating Silicon
Everyone wants Optimal Answers to their Questions. What is an _Optimal_ Answer? An Optimal Answer is| breckyunits.com
| Breck's Blog
Every time I see a school of fish, Im bewildered by the conformity. Every fish looks and swims the| breckyunits.com
| Breck's Blog
I just got back from the future where they had the most incredible device.| breckyunits.com
| Breck's Blog
People were surprised that AI has turned out to make information workers obsolete before laborers, b| breckyunits.com
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
I wish I spent more time moving atoms and less time moving symbols.| breckyunits.com
| Breck's Blog
| Breck's Blog
| Breck's Blog
The smallest improvements, compounded, have the biggest impact.| breckyunits.com
Nobody talks about how Bill Gates _actually_ made his billions.| breckyunits.com
| Breck's Blog
| Breck's Blog
| Breck's Blog
The market is a blob of decision making agents that speaks with money.| breckyunits.com
| Breck's Blog
| Breck's Blog
To understand something is to be able to mentally visualize it in motion in your head. Lets call th| breckyunits.com
Its more comfortable than it looks.| breckyunits.com
There is a job that is currently illegal in the United States, to the great detriment of our citizen| breckyunits.com
| Breck's Blog
| Breck's Blog
And our ancestors built a magnificent palace, over thousands of years, layer by layer, with space fo| breckyunits.com
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
May 31, 2024 — Yesterday, on a plane, I found an equation I sought for a decade.| breckyunits.com
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
| Breck's Blog
Patch is a tiny Javascript class (1k compressed) with zero dependencies that makes pretty deep links easy.| breckyunits.com
| Breck's Blog
| Breck's Blog
| Breck's Blog
All tabular knowledge can be stored in a single long plain text file.| breckyunits.com
Leibniz thought of Binary Notation; Lovelace of Computers; Darwin of Evolution; Marconi of the Wireless Telegraph; Einstein of Relativity; Watson & Crick of the Double Helix; Tim Berners-Lee of the Web; Linus of Git.| breckyunits.com
May 12, 2024 — The Four Seasons website says| breckyunits.com
I was walking in the woods and saw a path on my right. I had never seen this path before.| breckyunits.com
The girl lost the race.| breckyunits.com
April 2, 2024 — It has been over 3 years since I published the 2019 Tree Notation 'Annual' Report. An update is long overdue. This is the second and last report as I am officially concluding the Tree Notation project.| breckyunits.com
Given a box with side _S_, over a certain timespan _t_, with minimum voxel resolution _V_, how many| breckyunits.com
For decades I had a bet that worked in good times and bad: time you invest in word skills easily pay| breckyunits.com
I thought we could build AI experts by hand. I bet everything I had to make that happen. I placed my| breckyunits.com
There are tools of thought you can see: pen paper, mathematical notation, computer aided design ap| breckyunits.com
If you want to understand the mind, start with Marvin Minsky. There are many people that claim to be| breckyunits.com
April 26, 2021 — I invented a new word: Logeracy[1]. I define it as the ability to think in logarithms. It mirrors the word literacy.| breckyunits.com
March 2, 2020 — I expect the future of healthcare will be powered by consumer devices. Devices you wear. Devices you keep in your home. In the kitchen. In the bathroom. In the medicine cabinet.| breckyunits.com
