Nyun AI

11 posts

Nyun AI banner
Nyun AI

Nyun AI

@Nyun_AI_

Making AI Efficient, Affordable and Fast

Bengaluru Katılım Ocak 2024
29 Takip Edilen41 Takipçiler
Nyun AI
Nyun AI@Nyun_AI_·
🔍 From tedious to streamlined! Nyun Zero's 'Nyun Kompress' module transforms model optimization with automated compression techniques that maintain performance. 🚀📊 #AIModel #TechNews #Efficiency Learn more at nyunai.com
English
0
1
1
200
Nyun AI
Nyun AI@Nyun_AI_·
We thoroughly benchmark LLAMA, LLAMA2 on an A100 GPU machine with multiple runtimes and compression methods. We believe that this work will help make informed decisions on LLM serving. We discuss possible novel methods to improve the latency and memory consumption of LLMs.
English
1
0
2
52
Nyun AI
Nyun AI@Nyun_AI_·
Our Team at @Nyun_AI_ recently compiled an experimental survey with a thorough codebase - Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward. We provide a comprehensive overview of multiple LLM compression methodologies along with system-level approaches.
Nyun AI tweet media
English
1
1
4
185
Nyun AI retweetledi
Rohan Paul
Rohan Paul@rohanpaul_ai·
Nice paper to help make informed decisions on LLM serving - improve the latency and memory consumption. Performance comparison of compressed variants of LLaMA2-7B using various inference engines, quantized for different predictions and across different hardwares, with multiple llm compression methodologies Paper - "Faster and Lighter LLMs: A Survey on Current Challenges and Way Forward"
Rohan Paul tweet media
English
1
9
39
2.2K
Nyun AI
Nyun AI@Nyun_AI_·
(1/2) At @Nyun_AI_, we believe efficient LLMs and LVMs of tomorrow will be made by growing smaller networks for desired hardwares rather than first building the large ones and then compressing them. Our paper accepted as notable oral at ICLR 2024 is the first step towards it.
English
1
0
3
47
Nyun AI
Nyun AI@Nyun_AI_·
Say hello to Nyun Zero 💡- where AI meets efficiency! Reduce inference costs, speed up training, and secure your data like never before. 🛡️ Join the revolution in AI productivity. #EfficientAI #DeepLearning 🚀 Sign up here ➡️ [forms.office.com/r/NxYwkmGypG]
English
0
3
6
646