sajal

18.8K posts

sajal banner
sajal

sajal

@sajalshlan

ai. computers. notes to self.

Katılım Eylül 2021
258 Takip Edilen11.3K Takipçiler
Sabitlenmiş Tweet
sajal
sajal@sajalshlan·
want to work on the intersection of ai, mathematics, consciousness, dna, memory, hardware
English
1
1
4
255
sajal
sajal@sajalshlan·
Continuity (continuous functions) is the best language for the world we experience - therefore the foundation behind laws of physics, calculus, neural networks. Not necessarily the truth, but our most powerful approximation; universal approximation theorem.
English
0
1
1
112
sajal
sajal@sajalshlan·
me and claude locking in for the day
sajal tweet media
English
1
0
4
105
sajal
sajal@sajalshlan·
going from absolute measures to relative measures in anything is a form of greater intelligence i think
English
0
0
1
101
sajal
sajal@sajalshlan·
@NirbhikJangid reading, i guess stanford online courses on yt might be a good start
English
1
0
1
14
notNirbhik
notNirbhik@NirbhikJangid·
@sajalshlan like joining a college or reading articles/papers?
English
1
0
1
27
sajal
sajal@sajalshlan·
i want to study economics
English
1
0
3
261
sajal
sajal@sajalshlan·
Just started reading about Benchmarks and Evals for OCRs, LLMs, VLMs. Such a impactful space to be working at right now: - almost all benchmarks have ground truth errors - integrity of test eval sets of global benchmarks may have been compromised because many companies/models might use them while competing to do well on these benchmarks - goodhart's law - still doesn't cover every dimension possible to judge a language model's capability. most of the models can exploit the statistical distribution to get answers on multiple-choice questions that most of these benchmarks have. we need more unit tests or subjective dimensions to benchmark new language models.
English
0
0
2
65
sajal retweetledi
sajal
sajal@sajalshlan·
want to work on the intersection of ai, mathematics, consciousness, dna, memory, hardware
English
1
1
4
255
lakshay
lakshay@n4gpal·
21 years old. just bought a frooti without emi. it ain't parent's money. it ain't luck. it ain't consistency. it's discipline. firm grind everyday welcomes this lifestyle.
lakshay tweet media
English
4
2
14
228
shetty
shetty@thestoicccoder·
claude just killed Haldirams
shetty tweet media
English
118
226
4.3K
200.3K
sajal
sajal@sajalshlan·
The more I read about classical architectures (CNN, RNN, LSTM), the more I understand how we came to transformers and how, going from explicit hard-gated regex stuff to more hallucinative black-box stuff, we go towards a general intelligence. Kind of like we use our brain (hard-gated logic over experiences and rules) plus our real-time intuition(instinct, breaking the rules - hallucinating) in the real-world.
English
0
0
1
71
sajal retweetledi
Vinayak Gavariya
Vinayak Gavariya@VinayakGavariya·
The evaluation pipeline for Indian ASR is broken. At Sarvam, we kept seeing WER/CER penalize correct output. They fail on: • Code-switching • Script variation (kal vs कल) • Same meaning, different phrasing So you get misleading scores → wrong product decisions. We built better metrics: LLM-WER, LLM-CER, Intent, Entity Evaluate Indian ASR in right way using these two frameworks.
Sarvam@SarvamAI

We're open-sourcing two frameworks for evaluating Indian ASR, and a full guide on evaluation across 22 languages. WER (Word Error Rate) and CER (Character Error Rate) were built for languages like English. Indian languages behave differently. Formal and colloquial forms coexist. English words move fluidly between scripts. In this guide, we introduce four complementary metrics LLM-WER, LLM-CER, Intent Score, and Entity Preservation Score. In combination they capture a more complete view of Indian ASR system performance. Read more: sarvam.ai/blogs/evaluati… Both frameworks are available to use and build on for evaluating Indian ASR in real-world settings. Open-source frameworks: LLM-WER/CER: github.com/sarvamai/llm_w… Intent + Entity Score: github.com/sarvamai/llm_i…

English
0
1
4
351
sajal
sajal@sajalshlan·
you never know
sajal tweet mediasajal tweet media
English
0
1
9
412
arush
arush@arcinston·
life lately
arush tweet media
English
1
0
1
91