Aleksandr Drozd
1K posts

Aleksandr Drozd
@bkbrd
Building stuff. Writing about everything. AI and HPC among other things. Based in Japan for past 15y. Raising two mixed-race kids. にゃ ^_^
Tokyo-to, Japan Katılım Ağustos 2009
230 Takip Edilen211 Takipçiler
Aleksandr Drozd retweetledi

📢 #NLProc I'm hiring! 2x PhD students (apply by Nov 22) & postdoc (Nov 15). These positions are part of a large project on the problem of attribution for LLM outputs to the original data sources, on which LLMs were trained.
Job links on my website (in the bio)
/1

English

@rezendi I remember using these when I was kid. Like, being eco-friendly before eco-friendly was a thing. I suspect pet-bottles contribute a lot and we can totally reduce their usage. We have to.

English

"The researchers found that 24 of the brain samples, which were collected in early 2024, measured on average about 0.5% plastic by weight." theguardian.com/environment/ar…
English
Aleksandr Drozd retweetledi

Great news! Based on requests, the submission deadline for the LLMxHPC workshop (@ IEEE #Cluster) has been extended to June 29, 2024. Submit your novel research on using #HPC to advance #LLMs and using LLMs to improve the design/operation of HPC systems. llmhpc.github.io/2024/
English
Aleksandr Drozd retweetledi

arxiv.org/abs/2404.08676
🚨Introducing ALERT🚨 , a large-scale safety benchmark of > 45k instructions categorized using our new taxonomy.
✨Using prior work such as Bo Decoding Trust and our Aurora-m huggingface.co/datasets/auror…
and @jackclarkSF's awesome Anthropic-HH.
🙏

English

Workshop on Large Language Models and HPC will be in Kobe Sept 24 at @IEEECluster, still more than a month to submit a paper! Organized by @kevin_a_brown , Tanwi Mallick, Juliane Mueller and yours truly. Details at llmhpc.github.io/2024, 🔁 appreciated!
English

As I'm trying to teach my daughter a bit of programming, had to brush the dust off the pycontextfree library... Here's the code for this one: github.com/undertherain/p…

English
Aleksandr Drozd retweetledi

#hpcmyths 6: We Will Soon Run at Zettascale!
Read our discussion in @ProfMatsuoka et al. arxiv.org/abs/2301.02432 and discuss here at the #HPC twitter!
Will we reach zettaflop/s performance or will fp64
lose relevance before?
English
Aleksandr Drozd retweetledi

The 'Myths' paper is out: Satoshi Matsuoka, Jens Domke, Mohamed Wahib, Aleksandr Drozd, Torsten Hoefler. "Myths and Legends in High-Performance Computing" arxiv.org/abs/2301.02432" undergoing peer review. Hopefully the community will be engaged in yes/no discussions on Twitter!
English
Aleksandr Drozd retweetledi

📢 #NLPaperAlert: Outliers Dimensions that Disrupt Transformers Are Driven by Frequency
with @gpuccetti92 @bkbrd Felice Dell'Orletta
TLDR: remember how BERT over-relies on just 48 magic params? They're related to token frequency in training! /1
arxiv.org/abs/2205.11380
English

well, the #stablediffusion thing is indeed fun to play with. But feels rather then prompt engineering, might be better to shortcut directly to tuning the input vector.

English

@LilyInJapan @_shiopan yeah see it well now. Says "interact as you would with a foreigner". Like, you know, use simpler grammar, stuff like that. Or you mean, we should really go hard at little bastards, let them learn some proper language?
English









