Rehan Ahmed, PhD

Where are theee

We’re expanding our partnership with @Accenture to help enterprises move from AI pilots to production. The Accenture Anthropic Business Group will include 30,000 professionals trained on Claude, and a product to help CIOs scale Claude Code. Read more: anthropic.com/news/anthropic…

Excited to share our survey "Adaptation of Agentic AI" (led by @patpcj & @jclin808) unifying the rapidly growing landscape of agent adaptation (tool-execution- vs. agent-output-signaled) & tool adaptation (agent-agnostic vs. agent-supervised)! Preprint: github.com/pat-jj/Awesome…

Hope

@xwang_lk @ucsbNLP Any Post-doc openings? Asking for a friend

We are hiring! Welcome to apply for PhD positions at @ucsbNLP to work on exciting research in AI, NLP, ML, Multimodality, and agents!

@ljyflores38 @Adobe Nice work. Any plans of releasing the benchmark?

🤔 How reliable are LLMs/LLM-based agents on industry related tasks? 👨‍💼This summer at @adobe, we tried using LLMs to help marketers with audience segmentation! This previously takes hours/days of manual work, since studying datasets with thousands of columns is tough 🧵Thread:

Great paper on how Google runs a commercial research lab, courtesy of Ankush Menat. Would love to read more like this particularly from young and actively growing companies (i.e. don't send me Oracle or Bell Labs).

Working from home.. 😅

Can AI really help with literature reviews? 🧐 Meet Ai2 ScholarQA, an experimental solution that allows you to ask questions that require multiple scientific papers to answer. It gives more in-depth, detailed, and contextual answers with table comparisons, expandable sections for subtopics, and citations with paper excerpts for verification 💡 Try Ai2 ScholarQA now: scholarqa.allen.ai More in 🧵

After Ethan's post, I went on a deep dive into this study! I could go on and on about the results but if I had to boil it down to my biggest takeaways...🧵

New randomized, controlled trial of students using GPT-4 as a tutor in Nigeria. 6 weeks of after-school AI tutoring = 2 years of typical learning gains, outperforming 80% of other educational interventions. And it helped all students, especially girls who were initially behind

This paper from DeepMind is blowing my mind: “Our findings reveal that models fine-tuned on weaker & cheaper generated data consistently outperform those trained on stronger & more-expensive generated data across multiple benchmarks…”

📢 Check out the lineup of papers our students will be showcasing at #EMNLP2024 in Miami next week! 🌴We'll be presenting new work on morphology, Q&A, and narratives.🔍

Why and when do preference annotators disagree? And how do reward models + LLM-as-Judge evaluators handle disagreements? We explore both these questions in a ✨new preprint✨ from my @allen_ai internship! [1/6]

There's a general feeling that AI-written text is repetitive. But this repetition goes beyond phrases like "delve into"! We can actually characterize repetition at a structural level using syntactic templates... 🧵 arxiv.org/abs/2407.00211

Hitchhiker's guide to rebranding: - Machine learning -> statistical mechanics - Loss function -> energy functional - Optimize the model -> minimize free energy - Trained model -> reached equilibrium distribution - KL divergence -> free energy difference - Gaussian noise -> random thermal fluctuations - Random step -> Brownian motion - SGD -> directional Brownian motion - GPU -> simulated particle accelerator - Diffusion models -> Langevin dynamics - Reinforcement learning -> control theory - Robotics -> physical computation - Audio learning -> 1D signal processing - Image learning -> 2D signal processing - Video learning -> 3D signal processing - Multimodal models -> multidimensional signal processing - Sora -> learned physics engine You're welcome

Doing good science is 90% finding a science buddy to constantly talk to about the project.