Lot of mental backflips here by Dario Amodei to dismiss open source AI: - You can literally see what's happening inside the model. The weights are available (if you can make sense of them). - Fully open source models like Nemotron make the entire training dataset and recipe available (which Anthropic never does). - The same mechanistic interpretability techniques Anthropic uses to investigate the inner workings of its models are applicable to open-weight models, and the entire scientific community can work on them as opposed to the one lab that has access to the weights. - Anyone can fine-tune the model (given they have resources) - You might need to host them in the cloud, but you're in full control and you don't have to worry about Anthropic or OpenAI or some other AI lab monitoring your usage to create a competitor product. - And last but not least, since the model is being served transparently, you don't need to worry about the hosting service to nerf the model at peak demand, ban your account because it didn't like your prompts, or route you to another model because what you're requesting is too dangerous. You're in full control.

@bendee983 The interviewer is also underprepared by saying, "well, if it's free." Of course it's not free. Nothing is free. But it's a damn sight cheaper by at least 50 base points than the APIs coming out of the Frontier Labs. If Dario had his way @huggingface would be kaputs