Lin Tan

238 posts

Lin Tan banner
Lin Tan

Lin Tan

@Lin0Tan

Professor @PurdueCS, Amazon Scholar @awscloud | Ex @Meta @UWaterloo @IllinoisCS @MSFTResearch @IBMResearch | #SE #LLM4Code #AI #Security

Katılım Ağustos 2024
253 Takip Edilen730 Takipçiler
Sabitlenmiş Tweet
Lin Tan
Lin Tan@Lin0Tan·
Can #LLMs replace developers? Introducing RepoCod-Lite 🐟 for faster evaluation to answer this: 200 of the toughest #RepoCod #code-generation tasks: - GPT-4o and other LLMs have < 10% accuracy/pass@1 on RepoCod-Lite tasks - Leaderboard lt-asset.github.io/REPOCOD/ - 67 repository-level, 67 file-level, and 66 self-contains tasks - Detailed problem descriptions (967 tokens) and long canonical solutions (918 tokens) - Dataset: huggingface.co/datasets/lt-as… Thanks to the great feedback from #swe-bench’s @OfirPress, here are some clarifications about #RepoCod (lt-asset.github.io/REPOCOD/): Compared to #SWE-Bench, RepoCod tasks are - General code generation tasks,  while SWE-Bench tasks resolve pull requests from GitHub issues - With 2.6X more tests per task (313.5 compared to SWE-Bench’s 120.8) Compared to #HumanEval, #MBPP, #CoderEval, and #ClassEval, RepoCod has 980 instances from 11 Python projects, with - Whole function generation - Repository-level context - Validation with test cases, and  - Real-world complex tasks: longest average canonical solution length (331.6 tokens) and the highest average cyclomatic complexity (9.00) #LLMs #LLM4Code #security #codegen
Lin Tan tweet media
Lin Tan@Lin0Tan

Can language models replace developers? RepoCod says “Not Yet”, because GPT-4o and other LLMs have <30% accuracy/pass@1 on real-world method-level code generation tasks. Leaderboard lt-asset.github.io/REPOCOD/ #LLM4code #LLM #CodeGeneration #Security @cerias @PurdueScience

English
4
14
77
33K
Lin Tan retweetledi
Jingbo Wang
Jingbo Wang@bobowang2014·
We encourage undergraduate, master’s, and early-stage PhD students interested in programming languages to apply for PLMW at PLDI 2026. It is a great opportunity to learn from researchers, build connections, and explore future directions in PL. Apply here: #Applications-and-Scholarships" target="_blank" rel="nofollow noopener">pldi26.sigplan.org/home/PLMW-PLDI…
English
3
72
398
30.8K
Lin Tan
Lin Tan@Lin0Tan·
🏅Grateful for our 2 Most Influential Paper (N-10) awards at #ICSE2026. 1️⃣ Most Influential Paper (#MIP) Award: Automatically Learning Semantic Features for Defect Prediction 2️⃣ Most Influential SEIP Paper (#MIPS) Award Retrospective: Online Defect Prediction for Imbalanced Data
Lin Tan tweet mediaLin Tan tweet mediaLin Tan tweet mediaLin Tan tweet media
English
3
0
15
397
Lin Tan
Lin Tan@Lin0Tan·
These two papers almost bookend a story. The 1st was among the earliest to show how #DeepLearning could be used for software defect prediction. The 2nd focused on the deployment in practice: imbalanced data and future-data leakage. #SoftwareEngineering #ICSE2026
English
0
0
2
127
Lin Tan retweetledi
Amazon Web Services
Amazon Web Services@awscloud·
AWS Security Agent is now generally available. Scale security testing across your application portfolio with on-demand penetration testing that matches your development velocity. By conducting tailored attack scenarios, AWS Security Agent identifies validated vulnerabilities with reproducible proof and actionable fixes.
English
20
20
393
6.5M
Lin Tan retweetledi
Chengpeng Wang
Chengpeng Wang@Chasen86341870·
Excited to share that I will join NUS (@NUSComputing) as an Assistant Professor this Aug! 🎉 I’m recruiting Ph.D./RAs/interns interested in Program Analysis, Code LLMs, and Agents. 🔥 Self-motivated students with strong backgrounds are especially welcome.
English
17
25
350
23.4K
Lin Tan retweetledi
ICSE
ICSE@ICSEconf·
From April 12–18, 2026, the world’s premier software engineering conference will bring together approximately 2,000 top researchers, practitioners, innovators, and students in Rio de Janeiro. Current sponsors and sponsorship opportunities at conf.researchr.org/info/icse-2026…
ICSE tweet mediaICSE tweet media
English
1
3
7
883
Lin Tan retweetledi
Bogdan Vasilescu
Bogdan Vasilescu@b_vasilescu·
We measured the effects of more AI coding agents, with the same conclusion: Development velocity (commits, lines added) increases, but it is short lived, and it comes at the cost of code quality and technical debt (static analysis warnings and code complexity go up substantially)
Bogdan Vasilescu tweet media
English
3
1
16
327
Lin Tan retweetledi
Thomas Zimmermann
Thomas Zimmermann@tomzimmermann·
Call for Papers: AI Models for Code Improvement. 🧠✨ 📅 Submit by 24 Oct 2025. Special issue of @ieeesoftware AI is revolutionizing code refactoring, bug fixing & software maintenance. We're seeking papers on how LLMs & other models are transforming dev workflows
English
0
3
10
812
Lin Tan retweetledi
FSE 2026
FSE 2026@FSEconf·
Missed presenting your ICSE/FSE/ASE paper due to various issues? FSE 2026 has a Re-routed Presentations track—bring your already-accepted research to Montreal (Jul 5–9). Submit the short HotCRP form by Feb 25 (AoE). #FSE2026 #SoftwareEngineering #ICSE
English
0
2
4
738
Lin Tan retweetledi
Purdue University
Purdue University@LifeAtPurdue·
On March 2, CEO and Chair of @AMD @LisaSu joins President Mung Chiang for “Strategic Circuits: How University and Industry Partnerships Will Power the AI Era,” a Presidential Lecture on the role high-performance computing plays in advancing innovation. purdue.university/46PVOuP
Purdue University tweet media
English
3
3
14
2K
Lin Tan
Lin Tan@Lin0Tan·
@swarat Congratulations, Swarat! Very well deserved!
English
0
0
2
120
Lin Tan retweetledi
TBPN
TBPN@tbpn·
Sequoia partner @sonyatweetybird says we're going from the age of product-led growth to the age of agent-led growth. "You see this most clearly if you're using Claude Code actively. It says, 'Hey, for a database, you should use Supabase. For hosting, use Vercel.' It's choosing for you, the stuff you should be using." "Product-led growth brought us closer to the vision of 'best product wins,' but ultimately people are still lazy. They can't read all the reviews, and they kind of default to what looks cool on the website." "Whereas your agent has infinite time to go and make these choices for you. It can go and read all the documentation, read all the user comments, and figure out [what you need] for your use case."
English
91
176
1.3K
1.2M
Lin Tan
Lin Tan@Lin0Tan·
🚀 Excited to share the preview launch of AWS Security Agent! A rewarding year working with amazing scientists and engineers to bring this from design to code to launch. Learn more 👇 tinyurl.com/AWSSecurityAge… #AWS #AI #Agents #Security #AWSSecurityAgent #reInvent
Amazon Web Services@awscloud

Security Gaps to Secure Apps. AWS Security Agent secures your applications proactively from design to deployment. Bridge the divide between speed & safety with automated security reviews & on-demand penetration testing.

English
1
0
8
369