Very general definition: “Open-ended systems endlessly produce new and interesting things”
Link to originalExamples of open-ended systems
Autocatalytic systems, market economies, …
Circular transclusion detected: general/Open-Endedness-is-Essential-for-Artificial-Superhuman-Intelligence
Circular transclusion detected: general/Open-Endedness-is-Essential-for-Artificial-Superhuman-Intelligence
Circular transclusion detected: general/Open-Endedness-is-Essential-for-Artificial-Superhuman-Intelligence
Circular transclusion detected: general/Open-Endedness-is-Essential-for-Artificial-Superhuman-Intelligence
Link to originalOpen-ended exploration
The problem afflicting both classes of learning algorithms reduces to one of insufficient exploration: SL, largely trapped in the offline regime, fails to perform any exploration, while RL, limited to exploring the interior of a static simulation, largely ignores the greater expanse of possibilities that the simulation cannot express.
We require a more general kind of exploration, which searches beyond the confines of a static data generator, such as a finite dataset or static simulator. This generalized form of exploration must deliberately and continually seek out promising data to expand the learning agent’s repertoire of capabilities. Such expansion necessarily entails searching outside of what can be sampled from a static data generator.
This open-ended exploration process, summarized in figure 1, defines a new data-seeking outer-loop that continually expands the data generator used by the inner loop learning process, which itself may use more limited forms of exploration to optimally sample from this data generator. Within each inner loop, the data generator is static, but as a whole, this open-ended exploration process defines a dynamic, adaptive search process that generates the data necessary for training a likewise open-ended learner that, over time, may attain increasingly general capabilities.
Link to originalunboundedness of the universe
A place where anything can be expressed (universal computation) is a place where anything can happen
Computation is a metaphor for expression, but expression happens through a medium. In our universe the medium is physical reality.
Invention: When anything is possible, every end is a beginning.
The easiest way here again is code, inventing tools.
Current RL: immutable environments. Actions are about attached conditional things (mario jumps), but invention changes the outer environment and leaves behind a detached artifact (mario crafts a sword).
→ Endless possibility of detached conditional things (language is one of them).
The API of earth (particles in the ground) sucks.
→ Koding koding koding?