Murali Subbarao

73 posts

Murali Subbarao

Murali Subbarao

@msubbarao

Saratoga, CA, USA Katılım Kasım 2008
47 Takip Edilen86 Takipçiler
Murali Subbarao
Murali Subbarao@msubbarao·
What’s at Knowledge 2026 that you can’t find anywhere else? Hands-on learning, interactive demos, and real examples of how your peers are putting AI to work—and getting ahead. Register early for $400 off. (Hurry! Offer ends 12/31) spr.ly/60177NCZS
Murali Subbarao tweet media
English
0
0
0
21
Murali Subbarao retweetledi
Jerry Liu
Jerry Liu@jerryjliu0·
The new 100k token model from @AnthropicAI is awesome: dump in giant docs/books into the prompt, do LLM tasks! 📚🛠️ It got me thinking about the relationship to fine-tuning and in-context learning - is it better than both, worse than both, or used in niche cases? 🧵 In the extreme, if context windows are infinite, then putting all the data into the prompt seems similar to “throw-away” fine-tuning 🤔 Pros ✅: - Similar to fine-tuning, you get benefits of explicitly giving this black-box model access to all your knowledge (just in the inputs instead of in the weights) - Less hand-engineered than retrieval-augmented generation (RAG) - You can more easily feed in new data than actually fine-tuning (which seems hard to use) Cons ❌: - You have to feed in this data for every inference call - As a result, marginal cost/latency go way up. 💵 Retrieval augmented generation is more limited in functionality (because inherently requires some hand-engineering and data pipelining), but on the other hand can reduce cost/latency. So is this approach of feeding everything into the input prompt a happy middle or worst of both worlds? Of course, going back to the context window of 100k: 100k tokens is a lot, but if you have gigabytes or terabytes of data, 100k tokens can’t fit everything (it can’t actually fit UBER SEC filings). So either way you will need to do some retrieval from your data, in the absence of fine-tuning. And then the question becomes whether you'll always want to maximize the context window, or you're ok with retrieving smaller chunks. Thoughts? Added some diagrams below to help clarify my thinking 🖼️
Jerry Liu tweet mediaJerry Liu tweet mediaJerry Liu tweet media
English
27
84
465
254.6K
Murali Subbarao
Murali Subbarao@msubbarao·
Exciting news! Join me this Saturday for the "Inspiring and Mentoring Women in STEM" event hosted by the Joy Thomas Foundation. Featuring keynote speaker Vidita Vaidya, a renowned neuroscientist and professor, and Tanishka Kabra, the recipient of the 2nd…lnkd.in/gJNpRG94
English
0
0
1
40
Murali Subbarao
Murali Subbarao@msubbarao·
Knowledge 2021 will feature more than 500 digital sessions across 12 channels. Familiarize yourself with our platform before you go. #Know21 spr.ly/6014HCchp
English
0
0
1
0
Murali Subbarao
Murali Subbarao@msubbarao·
Proud of the Parlo team for being featured in VentureBeat's 2017 Intelligent Assistance & Bot Landscape report!  #AIhubs.ly/H08ZCz00
English
0
0
0
0
Murali Subbarao
Murali Subbarao@msubbarao·
@CheggHelp charge must be for a free offer after text book buy. After 30d there was an auto charge. Want service cancelled charge reversed
English
0
0
0
0
Murali Subbarao
Murali Subbarao@msubbarao·
“Tommy Hilfiger Bot: Artificial Intelligence Gone Wrong” by @GetXpressBuy @Parlo/tommy-hilfiger-bot-artificial-intelligence-gone-wrong-90a545ac9a20#.afvncto85" target="_blank" rel="nofollow noopener">medium.com/@Parlo/tommy-h…
English
0
0
0
0
Murali Subbarao
Murali Subbarao@msubbarao·
@benjkeys Loved your article on 'Killer Feature'. @GetXpressBuy has a chatbot development platform. Would love to explore working together.
English
0
0
0
0