Elixir (1 blogmarks)

So, I decided to implement a very small model in Elixir, completely from scratch – no libraries allowed. I cut the vocabulary down to just 32 words, used a single block and head of attention. It comes in at just over 15k parameters and trains in about 75 seconds on my laptop and gets the noun verb agreement correct.