year: 2019/07
paper: https://arxiv.org/abs/1907.05242
website:
code: https://github.com/lucidrains/product-key-memory/tree/master
connections: product key memory
Great blog: https://www.pragmatic.ml/large-memory-layers-with-product-keys/
See also earlier notes on Mixture of A Million Experts which uses product keys.
