
I finally had a few minutes to set up a Mastodon account. I was lazy about picking a server and went with the one built into my browser. rott3n@vivaldi.social
English
Rick Otten
912 posts

@rick_otten
Mastodon: [email protected]









📜🚨📜🚨 NN loss landscapes are full of permutation symmetries, ie. swap any 2 units in a hidden layer. What does this mean for SGD? Is this practically useful? For the past 5 yrs these Qs have fascinated me. Today, I am ready to announce "Git Re-Basin"! arxiv.org/abs/2209.04836



