
Supervised full self-driving now $99/month
Harry Man
795 posts

@manharry
Founding Partner @MatrixPartners China

Supervised full self-driving now $99/month













We live in such strange times. Apple, a company famous for its secrecy, published a paper with staggering amount of details on their multimodal foundation model. Those who are supposed to be open are now wayyy less than Apple. MM1 is a treasure trove of analysis. They discuss lots of architecture designs and even disclose that they train on GPT-4V-generated data. They provide exact scaling law coefficients (to 4 significant figures), MoE settings, and even optimal learning rate functions. I have not seen this level of details from a big tech's whitepaper for a very, very long time. Apple's so back!










