Mike Lin

San Francisco 2049.

Meet DBRX, a new sota open llm from @databricks. It's a 132B MoE with 36B active params trained from scratch on 12T tokens. It sets a new bar on all the standard benchmarks, and - as an MoE - inference is blazingly fast. Simply put, it's the model your data has been waiting for.

Probably the thing I’m most excited about with DBRX, it’s super fast! Easily 150 tokens/s for quality comparable to much slower closed models.

We're launching two comprehensive online courses on building and using Large Language Models! The first is on using LLMs in applications, covering topics like prompt engineering, embeddings, chains, and MLOps. The second teaches you to build your own LLMs. databricks.com/blog/enroll-ou…

MLflow just added first-class support for LLMs, including integrations with @huggingface transformers/pipelines, @OpenAI and @langchain! Open source #LLMOps is here. databricks.com/blog/2023/04/1…

@J_ Hope you still have all your trees!

Dinner on the camping stove tonight.

@J_ Some people have longer pain than others.

Sealing off my pain to put it away.

@kuveetha Wow! Congrats!

I'm an American now.

I’ve definitely had some quality coding sessions in some of those Twitter lounge chairs. Wouldn’t buy one though because of bad energy.

I just had some tasty Taiwan Grouper Fish last week. Throw some in your hot pot.

graphql

@aaghevli @feng That’s awesome. We also suffered through GDPR together but apart. Unity catalog is kind of similar to DAL, but in addition to an abstraction layer, it’s also the metastore and handles auth.

@mlin @feng Hello fellow Data Pipeliners! DAL and Eagle Eye are definitely still there. DAL became the backbone of much of our GDPR and data privacy story.

This kind of baked in data lineage is where I originally hoped to get to building EagleEye at twitter 10 years ago. cc @feng youtube.com/watch?v=8wGUnX…

@feng Yea! We were ahead of our time. Apparently it's still there. Or at least it was there.

@mlin wow finally, looking good! can't believe it's been 10 years now:-)

So… Be the person to ask the dumb question. Be the person who admits they don’t know the answer. Be the person who chooses to walk a path they suspect might lead to failure.

@cba 🫡 You are so twitter to me. No wonder you went back. Hope you can find another place fits you so well.

🫡💙 I didn't push the button

@l_if You have a freaking PhD!

@l_if What an amazing journey! I feel privileged to get to have seen the beginning.

This is unfortunately not an anomaly. The most unethical thing I was asked to do was shortly after becoming head of Vine. I haven’t spoken publicly about this out of embarrassment and fear of retribution, but probably better overall for the universe to air out these mistakes…

@dmarwick Strong effort. My approach is to say “if you don’t want it, I’ll eat it all” which is either completely effective or totally backfires.

@dmarwick Standing firm or appeasement. The constant dilemma.