Sabitlenmiş Tweet
Macneil Shonle
31.5K posts

Macneil Shonle
@macshonle
#AbolitionistVegan • #INTP • #ClarkU ‘00 • Sun Microsystems alum • GenX • I support open borders and free trade • He/Him
San Diego, CA Katılım Nisan 2009
281 Takip Edilen442 Takipçiler
Macneil Shonle retweetledi

Not sure why LLM compression is not discussed more often. Leveraging very large language models to build capable smaller LMs will be a huge win for everyone.
Companies like NVIDIA and Meta seem to be pushing hard on pruning and distillation for good reason. The compressed Llama 3.1 and NeMo models mentioned in this paper look very competitive.

English
Macneil Shonle retweetledi

@simonw Another thing to look for is HIPAA compliance! HIPAA is very strict about what information is stored and transmitted. If your provider is giving you a HIPAA compliant solution you even have isolation.
English

@DougJBalloon Nice, did your woke older sister help you tweet this? Tweetkondaforever
English

@DougJBalloon Your daughter and son have such different temperaments!
English

The Pushback Effects of Race, Ethnicity, Gender, and Age in Code Review cacm.acm.org/research/the-p…
English

@cristalopes They work until they don't. This was from 20 years ago, however, so maybe the technology has changed. Thr family dog at the time stayed in bounds but then got excited about something and straight into the street (but not traffic, thankfully) she ran.
English

@DAN_GLEASON @DougJBalloon Калашникова, oddly the feminine form of the inventor's last name

@DougJBalloon Easy. Same as the K in AK 47. And I don't what that K stands for either. 😄
English
Macneil Shonle retweetledi


@DougJBalloon Euell Gibbons: "Ever eat a pine tree? Many parts are edible."
English

@DougJBalloon Google has introduced Gemma, which uses a novel technique called Dynamic Sparse Attention (DSA) to reduce the memory and computation requirements of large-scale language models. Here's why that's bad news for Joe Biden.
English







