Ramesh Chitor

10.5K posts

Ramesh Chitor banner
Ramesh Chitor

Ramesh Chitor

@rameshchitor

Making #AI Safe & Trustworthy #FTTB Investor, Advisor @perplexity @trustmodelai @rubrikinc @jvccard #moolai @spacex

Katılım Nisan 2009
834 Takip Edilen1.3K Takipçiler
Ramesh Chitor
Ramesh Chitor@rameshchitor·
Claude is God
Mountain View, CA 🇺🇸 English
0
0
0
8
Ramesh Chitor
Ramesh Chitor@rameshchitor·
Word for the week "litellm" From RSA to Rasa
Fremont, CA 🇺🇸 English
0
0
2
21
Ramesh Chitor
Ramesh Chitor@rameshchitor·
Someone poisoned a Python package that gets 97 million downloads a month.. and a simple pip install was enough to steal everything on your machine
English
0
0
0
9
Andrej Karpathy
Andrej Karpathy@karpathy·
Software horror: litellm PyPI supply chain attack. Simple `pip install litellm` was enough to exfiltrate SSH keys, AWS/GCP/Azure creds, Kubernetes configs, git credentials, env vars (all your API keys), shell history, crypto wallets, SSL private keys, CI/CD secrets, database passwords. LiteLLM itself has 97 million downloads per month which is already terrible, but much worse, the contagion spreads to any project that depends on litellm. For example, if you did `pip install dspy` (which depended on litellm>=1.64.0), you'd also be pwnd. Same for any other large project that depended on litellm. Afaict the poisoned version was up for only less than ~1 hour. The attack had a bug which led to its discovery - Callum McMahon was using an MCP plugin inside Cursor that pulled in litellm as a transitive dependency. When litellm 1.82.8 installed, their machine ran out of RAM and crashed. So if the attacker didn't vibe code this attack it could have been undetected for many days or weeks. Supply chain attacks like this are basically the scariest thing imaginable in modern software. Every time you install any depedency you could be pulling in a poisoned package anywhere deep inside its entire depedency tree. This is especially risky with large projects that might have lots and lots of dependencies. The credentials that do get stolen in each attack can then be used to take over more accounts and compromise more packages. Classical software engineering would have you believe that dependencies are good (we're building pyramids from bricks), but imo this has to be re-evaluated, and it's why I've been so growingly averse to them, preferring to use LLMs to "yoink" functionality when it's simple enough and possible.
Daniel Hnyk@hnykda

LiteLLM HAS BEEN COMPROMISED, DO NOT UPDATE. We just discovered that LiteLLM pypi release 1.82.8. It has been compromised, it contains litellm_init.pth with base64 encoded instructions to send all the credentials it can find to remote server + self-replicate. link below

English
1.3K
5.2K
27.2K
61.4M
Andrej Karpathy
Andrej Karpathy@karpathy·
(I cycle through all LLMs over time and all of them seem to do this so it's not any particular implementation but something deeper, e.g. maybe during training, a lot of the information in the context window is relevant to the task, so the LLMs develop a bias to use what is given, then at test time overfit to anything that happens to RAG its way there via a memory feature (?))
English
103
30
1.3K
136.8K
Andrej Karpathy
Andrej Karpathy@karpathy·
One common issue with personalization in all LLMs is how distracting memory seems to be for the models. A single question from 2 months ago about some topic can keep coming up as some kind of a deep interest of mine with undue mentions in perpetuity. Some kind of trying too hard.
English
1.4K
818
16.5K
1.7M
Ramesh Chitor retweetledi
Andrej Karpathy
Andrej Karpathy@karpathy·
The hottest new programming language is English
English
1.8K
7.8K
61K
10.8M
Patrick Moorhead
Patrick Moorhead@PatrickMoorhead·
Did I really sign up for three events this week on different coasts? I’m so dumb.
English
9
0
21
3.2K
Ramesh Chitor retweetledi
odbms.org
odbms.org@odbmsorg·
Beyond the Benchmark: Reva Schwartz on Measuring AI’s Real-World Impact. 💡 Most AI evaluations measure what a model outputs. Almost none measure what people actually do with those outputs — and that gap is where the real risks live. #AI odbms.org/2026/03/beyond…
odbms.org tweet media
English
0
1
0
34
Ramesh Chitor
Ramesh Chitor@rameshchitor·
Claude can now point, click and navigate your Mac like a human #claude
Fremont, CA 🇺🇸 English
0
0
0
9
Ramesh Chitor retweetledi
Sam Altman
Sam Altman@sama·
absolute equivalence of brahman and atman
English
319
1.2K
6.7K
1.6M
Ramesh Chitor retweetledi
Director Michael Kratsios
Today, the @WhiteHouse released a commonsense National AI Policy Framework that ensures every American benefits from AI. As @POTUS has said — we need one federal AI policy, not a 50 state patchwork. This gets us there. Eager to work with Congress on this important legislation.
Director Michael Kratsios tweet media
English
344
809
2.6K
326.7K
Ramesh Chitor
Ramesh Chitor@rameshchitor·
We are in a very low income tax environment in the US compared to historic levels
Newark, CA 🇺🇸 English
0
0
1
8
Ramesh Chitor
Ramesh Chitor@rameshchitor·
It's all about Asset Protection
Newark, CA 🇺🇸 English
1
0
1
7
Ramesh Chitor
Ramesh Chitor@rameshchitor·
One Big Beautiful Bill Act (OBBBA) , we will hear a lot more about this in the days and months to come
Newark, CA 🇺🇸 English
1
0
1
18