Mohit
24.2K posts

Mohit
@codewith55
Dev | Turning coffee into code
india Inscrit le Temmuz 2019
594 Abonnements1.1K Abonnés

the paper that created a trillion dollar industry
"ATTENTION IS ALL YOU NEED"
back in 2017, a few researchers inside Google Brain started questioning something almost everyone in AI believed was necessary.
at the time, language models read text one word at a time using something called recurrence.
that was just the standard way of doing things.
but it had problems:
slow training,
poor scaling,
and difficulty handling long context.
still, most people thought there was no alternative.
then researchers like ashish vaswani, noam shazeer, Illia polosukhin and lukasz kaiser asked a very simple question:
“what if the model doesn’t need recurrence at all?”
what if every word could directly look at every other word?
what if the model could just pay attention?
that idea became the Transformer architecture.
and honestly, almost nobody realized how important it would become.
In June 2017, they quietly released an 8-page paper called:
“Attention Is All You Need.”
just a research paper uploaded online.
but once people started experimenting with it, everything changed.
transformers trained faster than RNNs.
performed better.
scaled better.
and within a few years, they became the foundation of almost every major AI breakthrough.
that one paper eventually led to:
• BERT
• GPT
• ChatGPT
• Claude
• Gemini
basically the entire modern AI boom.
It’s kind of crazy to think that so much of today’s AI industry traces back to a small group of researchers asking one question in 2017:
“What if attention is all you need?”


English

@byteHumi these are my projects guys check it out if u like it do vote -
1. x.com/NehraWorkss/st…
2. x.com/NehraWorkss/st…
3. x.com/NehraWorkss/st…
4. x.com/NehraWorkss/st…
5. x.com/NehraWorkss/st…
Deep@NehraWorkss
Built MockAPI — an AI tool that generates instant mock REST APIs. Paste your idea and get: → Live API endpoints in seconds → Realistic fake data out of the box → Full CRUD support, zero config → Instant base URL, ready to hit → No backend? No problem. No more blocking your frontend on a backend that doesn't exist yet. Link - mock-api.runable.site Built with @runable_hq
English

thanks for participating in the weekend challenge
the submissions were pretty wild this time.. we crossed 300+ .. honestly lost count
this all started with a random thought, to make the weekends productive and it turns out to be this wild
be patient, I am reviewing all the projects( doing actually from yesterday night ) and there's a lot ..
Winners will be announced tonight ( if delay then tomorrow morning)
we have a two-system voting
> public voting ( just mention ur best project acc to you, can't vote ur own submission )
> Runable internal voting by internal team members
for keeping this fair we will avg out both so that there is no misjudgement
thanks to all the runclub members .. you guys are just awesome
English































