Matthias Freiberger

Can vision transformers learn something useful when you randomly shuffle it's layers during training? Turns out they can! We present "LayerShuffle: Enhancing Robustness in Vision Transformers by Randomizing Layer Execution Order" 🧵 arxiv.org/abs/2407.04513

Ik was ervan overtuigd dat @mfreib en ik, met twee PhD-diploma's in huis, wel in staat zouden zijn onze peuter bij te staan met schoolvragen, maar... we zitten al vast bij deze kalender. Als elk symbool een woord voorstelt, voor welk woord staat het hartje op vrijdag dan? 🤔

Breitbarth, A., Farasyn, M., Ghyselen, A., Hellebaut, L., Lamsens, F., Depuydt, K., Does, J. de, Niestadt, J., Mertens, K. 2024. Gesproken Corpus van de zuidelijk-Nederlandse Dialecten. 1st release October 2024. Available at the Dutch Language Institute: hdl.handle.net/10032/tm-a2-z8.

🧵1/ Very proud to announce that we recently launched the GCND, the first parsed corpus of spoken Dutch dialects, an unprecedented resource for exploring historical Dutch dialects across Belgium, northern France, and the southern Netherlands.

Apparently if you don't subscribe to the orthodoxy of a bunch of SF AI bros who got into deep learning after 2020 and who think of it as a cult identity rather than an engineering field, you must be anti deep learning

@NachaGesquiere Haha, yeah, that was kind of a metaphor for collective intelligence.

@mfreib Curious what you share in the last slide. Do you see a whale in it too?

Not sure whether y'all have been curious what I spend my time with these days, but in case you are, check out these slides from a recent talk I gave on resilience and adaptability in learning systems: docs.google.com/presentation/d…

@timecaptales Research suggests that Butterflies act based upon experiences they had as a catarpillar despite their body turning into liquid during transformation. theconversation.com/curious-kids-d…

What mind-blowing (but simple) fact do you know that would satisfy a 7-year-old’s daily request for 1 fact before bedtime?

Nieuw project met @delagelanden_ bij @ugentlw 🎥 @FWOVlaanderen

Getting ready for the GCND Hackathon on ASR and linguistic annotation of non-standardized language varieties! #GCNDhackathon

Are LLMs able to exhibit traits usually associated with ALife approaches? How can ALife perspectives help improve the current limitations of LLMs? Read more in this review that examines LLMs from a different angle, featuring some nice graphics along the way!

Hard to believe we already came to this first anniversary. In Memoriam to our dear friend Philip Gosch and his wife Michaela Gosch, who tragically passed away a year ago on the 5th of September. Rest in peace, we will never forget you! gamedevgraz.at/remembering-ph…

@canalCCore2 Hi, that already is a thing, checkout e.g. this paper from 2016: arxiv.org/pdf/1610.02365 Or for a different flavor these from 2011 and 2014: nature.com/articles/ncomm… nature.com/articles/ncomm… Challenges are scale, controlling weights and finding good nonlinearities.

If we built a neural network where the weights were lenses instead of vectors, for instance, and the input was light-shaped, the inference cost would be zero.

📢 Only one week left to register! Join our GCND Hackathon: Automatic Linguistic Annotation and Speech Recognition of Dialects! Perfect for students and researchers in linguistics, digital humanities, social sciences and computer science #Linguistics #DataScience #Hackathon

2/5 Often, reviewers claim results aren't surprising to **them**. However, if no one has demonstrated or published these findings before, doesn't that inherently make them novel to the field?

Lol, Instagram thinks this photo is AI-generated when it's just the keen eye of @MelissaFarasyn working with perspective and light. A nice reminder that photographs too merely show what their creators want us to see.

@Plinz People without inner monologue exist, so mirror neurons as means of both emergence in social groups and procreation (just a wild guess though tbh)

Is language the first mind virus that spawned its ecosystem, or is consciousness a mind virus, too?

@JoachimWinther I tried to figure out real-time music generation with a controller till the demo but my brain apparently was too sleep-deprived

@mfreib Really fun to see and hear! Soon, the DJ rack will be switched out with an old Nintendo

This was a blast! Thanks for organizing it Claire and Elias! If you missed the link to the MarioRave collab yesterday, here it is again: colab.research.google.com/drive/1U5d-DNT…

@ciaran_regan_ (JK thanks to the great ALife volunteers and scrollbar staff everything worked in the end 🙂)

@ciaran_regan_ It was ok I guess, barely saved it by selling that interference pattern as a new kind of continous and analog CA we created 😅

How the setup at the hackathon demo is going? Great, why do you ask? #ALIFE2024