
Emil Bogomolov
911 posts

Emil Bogomolov
@superdiscoholic
You can come and go and still be here







I'm calling it. AGI is already here – it's just not evenly distributed yet.




Hate to break it to you, but the first LLM was created by Andrey Markov in 1913. he tallied up 20,000 letters from a famous novel and computed p(vowel | vowel) p(consonant | vowel) p(vowel | consonant) p(consonant | consonant) basically 'training' a bigram by hand




Oh god are we really doing this? Jeff Dean trained an n-gram model on the entire internet in 2007. Jelinek coined the term "language model" in the '70s. It's called "Claude" because Claude Shannon was estimating the entropy rate of the English language in 1951!







We're releasing a technical report describing how Composer 2 was trained.










