The ability to handle situations (or tasks) that differ from from previously encountered situations - On the Measure of Intelligence
Transclude of grokking#^dab70c
Four levels of generalization
There are roughly four levels of generalization:
0: No generalization (e.g. a database)
1: Having memorized the answers for a static set of tasks and being able to interpolate between them. Most LLM capabilities are at that level.
2: Having encoded generalizable programs to robustly solve tasks within a static set of tasks. LLMs can do some of that, but as displayed below, they suck at it, and fitting programs via gradient descent is ridiculously data-inefficient.
3: Being able to synthesize new programs on the fly to solve never-seen-before tasks. This is general intelligence.
Breadth of training predicts breadth of transfer. That is, the more contexts in which something is learned, the more the learner creates abstract models, and the less they rely on any particular example. Learners become better at applying their knowledge to a situation they’ve never seen before, which is the essence of creativity. - David Epstein, Range: Why Generalists Triumph in a Specialized World.
Transclude of trotzki#^86b1ba
Link to originalIntelligence is skill-acquisition efficiency.
The size of the skill-space you can navigate within a given time / budget is the generality of the intelligence.
Joscha Bach calls this the ability to make models, which is the same thing. Being good at a single task is a skill. Having a model that allows you to pick up different skills is intelligence.
Link to originalgeneral intelligence is not a task specific skill, but the ability to quickly and sample-efficiently pick up any new task.
It is relatively easy to write an algorithm or train a model to solve a specifc task, even ARC, better than every human, especially if we just throw so much compute at it in order to model the entire distribution, i.e. brute-force it the deep-learning way, or spend a lot of compute doing discrete program search to solve it.
Transclude of LLM#^a43c70
References
On the Measure of Intelligence
https://x.com/_saurabh/status/1763626711407816930?s=20
https://x.com/fchollet/status/1763692655408779455?s=20
https://arxiv.org/abs/1911.01547
https://arxiv.org/abs/2402.19450