Absolutely crazy to me there is a whole generation of people who know what a transformer is but might not know what an RNN is (not meant to be a comment on Helen). Is this what getting old is like?
Helen Toner@hlntnr
Never forget @karpathy training a recurrent neural net (precursor to transformers) to imitate @paulg in 2015—a thing of syntactic and semantic beauty:
English
