Sabitlenmiş Tweet
i've started to learn about quantising llms, would be putting my findings in this thread. if you guys know any relevant resources, feel free to share
English
David Zachariah
277 posts
David Zachariah
@davezaxh
Computer & Electronics Enthusiast | Full Stack Developer in JS | Into Information Security | Wanna make the world a better place
Katılım Şubat 2019
145 Takip Edilen30 Takipçiler
@IronRedSandHive @Prajwxl it's actually pretty simple, let me know if you need any help
English
@huggingface for my calibration texts I compiled a bunch of snippets of python and javascript from popular github repos such as flask, nextjs and fastapi which was around 134kb in size
English
@huggingface this matrix is then used during quantization to prioritize important weights with higher precision, while less important ones are compressed further, preserving quality while shrinking the model
English
i've started to learn about quantising llms, would be putting my findings in this thread. if you guys know any relevant resources, feel free to share
English
@ayrusReT @huggingface Quality holds up way better than expected, didn’t see real degradation until Q3_K_M, mostly on longer multi step reasoning.
English
had an insightful event today at the @FOSSUnited meetup today, the most interesting part for me was learning about quantisation and its applications on mobile phones
English
@subhashchy I I like to plan architecture, user flow, and overall experience before vibe coding, using a series of well designed prompts to ensure the result doesn’t look like random AI fluff while also avoiding security holes. Check out my work at davezach.xyz.
English
hiring vibe coders.
3 positions. full stack. location HSR BLR.
comment or DM with what you have built.
English
nginx is like a swiss army knife, it's definitely worth learning for developers
English