Greg Chatel retweetledi

Greg Chatel
299 posts

@rodgzilla
C.S. PhD, Lead R&D @ Disaitek, AI innovator @ Intel.



























Efficient mini-BERT models from Google Research, now available at huggingface.co/google thanks to @iuliaturc / @GoogleAI ! 24 sizes pre-trained directly with MLM loss and are competitive to more elaborate pre-training strategies involving distillation (arxiv.org/abs/1908.08962).



