ut-sysml

6 posts

ut-sysml banner
ut-sysml

ut-sysml

@UT_SysML

Systems and ML Research Group at UT Austin led by Neeraja Yadwadkar

UT Austin, Department of ECE Sumali Haziran 2023
7 Sinusundan36 Mga Tagasunod
ut-sysml
ut-sysml@UT_SysML·
@li_ruihao presenting our work on Oneiros at SoCC'25! KV cache drives multi-tenant LLM performance. Offloading it to the CPU is costly. Oneiros flips the script—repurposing parameter memory from inactive models into KV cache and exploiting today’s fast CPU–GPU bandwidth.
ut-sysml tweet media
English
0
0
0
28