Blogmark

This post is a survey of several papers and techniques from 2012 to 2017 that were influential in the development of the modern Transformer Architecture. Which in turn is what is behind the rapid advancement in Large Language Models.

I like surveys like this because they give a high-level overview that can contextualize and point at both things I've already read about like Word2Vec as well as things that are new to me like Adam.