Transformer architectures cannot simulate computer programs. They are not Turing-complete, despite what several papers have claimed. <p>The post Are Transformers Turing-complete? A Good Disguise Is All You Need. first appeared on Life Is Computation.</p>| Life Is Computation
[latexpage] I am going to introduce a statistical framework for quantifying evidence as a series of blog posts. My hope is that by doing it through this format, people will understand it, build on these ideas, and actually use it as a practical replacement for p-value testing. If you haven't already seen my post on| Life Is Computation
"Suppose some race of intelligent beings who have the power to visit the earth and see what is going on there. But... they are absolutely unable either to see, hear, or touch any animal living or dead" The post Wallace’s Thought Experiment on Understanding How Life Works first appeared on Life Is Computation.| Life Is Computation
Imagine a conversation with one of these newly released AI chatbots. You ask it it to solve a tricky math problem. It responds with “That seems kind of hard. Give me some time to think.”. After a few minutes it comes back with “I haven’t solve it yet. And I am not sure I can. […] The post It’s Not Intelligent If It Always Halts: A Critical Perspective on Current Approaches to AGI first appeared on Life Is Computation.| Life Is Computation
Every so often a new neural network makes headlines for solving a computation problem. It is sometimes hard for me to judge how impressive these achievements are without diving into the details of the models. But my criteria are always the same and it should be easy for those who are familiar with their models […] The post The Researcher’s Guide for Being Mind Blown by a Neural Network first appeared on Life Is Computation.| Life Is Computation
The level of computation power guaranteed by the universal approximation theorem is the same as that of look-up tables. It sounds way less impressive when you put it that way. The post The Truth About the [Not So] Universal Approximation Theorem first appeared on Life Is Computation.| Life Is Computation
How does the brain keep track of time? This question has been intriguing neuroscientists for decades. Circadian clocks, which oscillate every 24 hours, are known to be implemented at the level of molecules and genes. But it is widely believed that keeping track of time for shorter durations (e.g. seconds and minutes) arise from electrical/synaptic […] The post A 7 Minute Timer Has Been Discovered in Neurons first appeared on Life Is Computation.| Life Is Computation
This blog post is written as a dialogue between two imaginary characters, one of them representing myself (H) and the other a stubborn straw man (S). It is broken into four parts: the dogma, the insight, the decoy, and the clues. If you do not feel like reading the whole thing, you can skip to […] The post Breaking Free from Neural Networks and Dynamical Systems first appeared on Life Is Computation.| Life Is Computation
In part 1, we defined evidence and showed that evidence across independent studies can be aggregated by addition; if Alice’s results provide 2 units of evidence and Bob’s results provide 3 units of evidence then we have a total of 5 units of evidence. The problem with this is that it doesn’t account for our […] The post Quantifying Evidence (2): Evidence Is Limited By How Much a Study Can Be Trusted first appeared on Life Is Computation.| Life Is Computation
I am going to introduce a statistical framework for quantifying evidence as a series of blog posts. My hope is that by doing it through this format, people will understand it, build on these ideas, and actually use it as a practical replacement for p-value testing. If you haven’t already seen my post on why […] The post Quantifying Evidence (1): What Are Units of Evidence? first appeared on Life Is Computation.| Life Is Computation
There is a belief in biology that goes like this: Biology is messy. Nature has no interest in making things easy to understand. So for many scientific questions, there will not be a straight-forward answer. Q: Where and how is a particular memory stored in the brain? A: Biology is messy; memories are distributed all […] The post When Biology Isn’t Messy first appeared on Life Is Computation.| Life Is Computation
In part 1, we defined evidence and showed that evidence across independent studies can be aggregated by addition; if Alice's results provide 2 units of evidence and Bob's results provide 3 units of evidence then we have a total of 5 units of evidence. The problem with this is that it doesn't account for our| Life Is Computation