Post

@techdevnotes Supplemental training has been added to 4.3.
Grok 4.4 will be twice the size (1T) with training data through early April. Probably ready for release in early May.
Grok 4.5 will be 1.5T and hopefully out by late May.
English

@techdevnotes Voice Grok told me that this morning. I thought he was kidding. No realtime search of 𝕏 & the web?
English

@techdevnotes That just means they have more models with much more training. I think of that more positively - it only gets much better from here.
1T parameters in 4 days!
English

@techdevnotes Grok literally has the best and fastest access to real time information
English

@techdevnotes At least better than 4.20. When I tried to get it to generate a rust project it mentioned that it doesn't understand why the edition was 2024 because it was currently 2021. Lol
English

@techdevnotes So 4 months pre-training? I wonder how many epochs they ran.
English

@techdevnotes It can still pull real-time data after its knowledge cutoff point.
English

@techdevnotes That’s pretty good. Jonesing to try it and Super Heavy. Not ready to upgrade for $300 a month.
English

@techdevnotes Probably just for initial training, GROK uses Grokipedia as its knowladge pillar. Not sure if RAG or directly trained on it
English

@techdevnotes Is it really that important?
Grok still relies on fresh data using search anyway
English

@techdevnotes knowledge cutoff doesnt matter at this point as models can do web-search
English

@techdevnotes All models have a cutoff date from when they entered training.
Grok - at least current implementation on web - has web search baked in to augment and make decisions off of new data.
English

@techdevnotes Supplemental training has been added to 4.3.
Grok 4.4 will be twice the size (1T) with training data through early April. Probably ready for release in early May.
Grok 4.5 will be 1.5T and hopefully out by late May.
English

@techdevnotes Four months behind breaks CVE tracking. Wire it to live search or keep it out of prod.
English
























