Ben Frederickson

py-spy 0.4.0 has just been released - and adds support for Python 3.12/3.13: github.com/benfred/py-spy…

Want to speed up your Pandas code by 10-1000x? With no code change? The folks from @nvidia have created cuDF pandas accelerator mode. By using this line in Jupyter, you automatically leverage your GPU to run Pandas code: %load_ext cudf.pandas From command-line: python -m cudf.pandas yourscript.py (It also accelerates 3rd party libraries that leverage Pandas.) Check out this demo notebook: nvda.ws/3rNqETS I've had a chance to use the pre-release version and am very impressed!

Check out this (free) webinar. Especially relevant for users of Pandas. 🤯

I wrote a blog post about making a #Python library 100x faster with less than 100 lines of Rust @rustlang ohadravid.github.io/posts/2023-03-…

@scottedgar They installed one of these on the bike route near my house 3 weeks ago - and its already seriously beat up, looks like its been hit by cars multiple times. Better the barrier than a kid on a bike though, and I’m glad it’s there.

In #recsys you might want to predict different types of user events (click, like, share, purchase). In this post we introduce multi-task learning (MTL) for ranking models and how to easily build and train such models using #Merlin and #tensorflow. medium.com/nvidia-merlin/…

Love to see the new RAPIDS release 23.02 out now! Awesome improvements for anyone who wants their data science code to run faster in Python (medium.com/rapids-ai/rapi…). We also overhauled the rapids.ai site. Hopefully it's much easier to find things now!

Nice blog post showing how to use py-spy to diagnose a hanging python process : tomaugspurger.github.io/posts/azure-ba…

I'm moving to mastodon - link is in my bio / github

An in-depth comparison of using • Petastorm • TensorFlow • Merlin Dataloader for loading data on DataBricks! Merlin is 10x - 1000x faster 🙂 Thank you so much @Andompesta90 for this fascinating study! Read more here: andompesta.github.io/2022/11/13/eff…

I like to think of Python as an API for compiled languages.

For all my 🇺🇸 friends getting over their 🦃hangovers here's a black friday blog for you. Ever wanted to scale your recommender system to the Terabyte level. Check out this amazing work by Hao Wu and Deya Fu on the Merlin Distributed Embeddings library: developer.nvidia.com/blog/fast-tera…

これクッソ早かった。pytorchのdataloaderが200M件のデータのロードに3分かかったのに対し、merlin-dataloaderだとわずか500msだった。400倍の高速化。 github.com/NVIDIA-Merlin/…

Merlin Dataloader is 119x faster than my own PyTorch Dataset + Dataloader combo! This is revolutionary for tabular data 🥳 Let's take a closer look at what is going on.

@Sirupsen @jaywgraves Can you open a bug? py-spy should work out of the box for this

@jaywgraves Ya, but I should be able to just do `py-spy python -m pytest <file>,` but it didn't work. I just need to sink some more time into it, and I'm sure I can get it to work, but I expected this type of profiling to work out of the box in such a large community!

Was trying to figure out how to do some instrumentation of a large Python app's slow boot process. I've been a bit shocked with the Python perf tooling I've been able to dust up; almost none of it worked nicely of the box?

Great blog post by my colleague @radekosmulski :

Very interesting work & Q&A on parameter tuning. And a special shout to @benfrederickson for being a great session chair! #RecSys2022

Great thread on using py-spy to improve GPU utilization:

Before I start a new project or build a large feature I like to spend some time outlining the announcement blog post/talk abstract. This helps me figure out exactly which bits I'm excited to tell folks about so I can focus my efforts there! jacobtomlinson.dev/posts/2022/nar…

Just released a new version of py-spy - which adds support for python 3.11 : github.com/benfred/py-spy…