New DSL kernels in Python-Blosc2, being parallelizable and JIT-compiling capable, can accelerate code quite a bit 🚀
For example, linspace() has been rewritten to use DSL kernels, and performance boost is well beyond expectations.
English
Francesc Alted @[email protected]
2.6K posts
Francesc Alted @[email protected]
@FrancescAlted
Creator and BDFL of Blosc/@Blosc2. Co-founder and CEO of https://t.co/fi245VDWvZ. Love Python & C. https://t.co/yyWPV7377A
Castelló de la Plana Katılım Ocak 2012
225 Takip Edilen925 Takipçiler
A minor release, but a major step forward: numerical DSL kernels that can be JIT-compiled 🥳
Computing with compressed data is entering a completely new stage. ⚡️⚡️
Luke Shaw@lshaw_ironarray
📢Blosc2 4.1 Release! We've packed this minor release: optimised compression and funcs for unicode arrays; cumulative reductions; memory-map support for store containers like `DictStore` ; and a DSL kernel functionality for faster, compiled, user-defined funcs!👇
English
Super-efficient DSL kernels are coming with forthcoming Python-Blosc 4.1.
A DSL kernel is a function that takes ndarrays as input and returns a ndarray as output.
Performance with classic Mandelbrot is kind of mind-blowing.
See github.com/Blosc/python-b… for the full notebook.
English
The new engine in Python-Blosc2 4.0 delivers quite awesome performance results. Processing a 400 MB array can be up to 9.6x faster than NumPy 🤯
The best part? It supports NumPy's array and ufunc interfaces. High performance with zero friction! 🏎️💨
ironarray.io/blog/miniexpr-…
English
Python-Blosc2 just became a compute powerhouse for compressed data arrays⚡️
v4.0 integrates `miniexpr`: computing on cache-friendly blocks instead of RAM-heavy chunks.
🚀 Result? Massive speedups for memory-bound tasks.
See benchmarks:
ironarray.io/blog/miniexpr-…
Enjoy!
#HPC
English
🚀 Our #PyDataGlobal 2025 tutorial on modern #Blosc2 & #Caterva2 features is out!
Learn how compression boosts array performance & enables cloud computing without downloads. ☁️
Watch here: 👇
youtube.com/watch?v=tUvSI3…
#Python #HPC #DataScience #BigData
YouTube
English
Visualize data on your phone with Cat2Cloud! 📱✨
Create interactive plots in your mobile browser. No laptop needed!
Launch our demo, create graphs with Matplotlib/Plotly, customize, and render instantly. Register to save & share your work. 📈🎉
Try it: @public/examples/ironpill_nb.ipynb" target="_blank" rel="nofollow noopener">cat2.cloud/demo/static/ju…
English
Francesc Alted @[email protected] retweetledi
🤔 Can a library that computes on compressed data actually outperform performance heavyweights like NumPy and NumExpr?
Find some surprising answers 👉 blosc.org/posts/roofline…
During the walk, I'm also introducing a funny anecdote back when NumPy was a 👶
Enjoy!
#Blosc2 #HPC
English
It's Black Friday Week! 🛍️🖤
Don't miss out! Use the coupon code BLACKFRIDAY to get a generous 50% OFF your first order on Cat2Cloud. 💰
This offer is valid until Cyber Monday (Dec 1st), so don't delay! ⏳
Get it today! 👉 ironarray.io/pricing
#Cat2Cloud #BlackFriday
English
Unlock the power of your HDF5 data in the cloud! ☁️
Cat2Cloud now offers native, out-of-the-box support for HDF5 files.✨
Ready to see it in action? Try our online demo server today! 👉 cat2cloud.com/demo/
#HDF5 #CloudComputing #Visualization
English
I've built a demo Jupyter notebook that connects to a Cat2Cloud server from an Android phone and slices into an 8 TB dataset, downloading a 1 MB chunk in under 100 milliseconds. ⚡
Interact with big data right in your phone!
@public/large/slice-gaia-3d.ipynb?roots=%40public" target="_blank" rel="nofollow noopener">cat2.cloud/demo/roots/@pu…
#Cat2Cloud #Blosc2 #BigData
English
So excited to see this in production! 🥳
Luke Shaw@lshaw_ironarray
ironArray is on a roll 🚅! With Cat2Cloud released this week we continue our 💊ironPill series, showing you how to browse your cloud-hosted data ☁️ in the bespoke web client! Visualise and manage all kinds of data formats - from arrays to jpgs 🖼️, .md to PDFs 📄 !
English
Tired of downloading massive datasets? Cat2Cloud is now live! 🚀
Bring computation directly to your data. Host, run, and share workflows with incredible speed. ⚡
Read the announcement:
ironarray.io/blog/cat2cloud…
Enjoy Data!
#Cat2Cloud #BigData #DataScience #Python #HPC
English
Stop downloading. Start computing.
Everything changes on November 18, 2025.
#Cat2Cloud is coming.
English
From a programmer's virtue to a computational powerhouse: laziness transforms a developer's best practice into the engine of modern computing!
Luke Shaw@lshaw_ironarray
📢Blosc2 3.10.2 Released! 📢 Lazy evaluation for ALL Blosc2 functions in version 3.10! Blosc2 powers: - Zarr/HDF5 computations (see image and blosc.org/posts/tensordo…) - Server compuation via Cat2Cloud (demo site here cat2.cloud/demo/)! #Zarr #HDF5 #Python
English
Inspired by the ESA's Gaia Milky Way map!
At SciPy 2023, we showcased visualizing a massive 7.3 TB Gaia dataset on a standard laptop by compressing it to 1.8 GB using #Blosc2. Big data analysis for everyone! 🚀
Dataset: digistorage.es/links/6524030d…
Paper: blosc.org/docs/Exploring…
English
Francesc Alted @[email protected] retweetledi
🚨Blosc2 3.9.1🚨
• Array API standard compliance - 70 new functions
• Fast linalg: tensordot up to 12x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy for large arrays !
• Fast num calc: Funcs like hypot 10x 𝐅𝐀𝐒𝐓𝐄𝐑 than NumPy!
Blog: ironarray.io/blog/array-api
#Python
#linalg
#computation
English
The powerful SIMD capabilities in modern processors represent a huge, often untapped, potential for accelerating computations.
linkedin.com/feed/update/ur…
English
Exciting news! Python-Blosc2 is making huge strides towards array-api compliance. 🚀
You can now use it as a drop-in replacement for NumPy to operate efficiently on compressed data. 🗜️💪
There's more to come, but what a fantastic milestone! ✨
Luke Shaw@lshaw_ironarray
🗣️ Announcing Python-Blosc2 3.8.0 🚀 A step closer to compliance with the array-api standard: data-apis.org/array-api! The goal: your code works for all array libraries (e.g. for both blosc2 and NumPy) by simply changing the import statement below! #arrayapi #Blosc2
English