induction head

Circuits that copy prior-token patterns to predict future ones.

https://www.perfectlynormal.co.uk/blog-induction-heads-illustrateda
←
https://www.lesswrong.com/posts/TvrfY4c9eaGLeyDkE/induction-heads-illustrated