The HDF Group

HDF5 2.1.0 is officially on @condaforge! Jump to the 2.x series with the new ROS3 backed by Amazon's C S3 library, modern hardware datatype support (bfloat16), new defaults for cloud optimized HDF5, and improved performance overall! Check out the files: anaconda.org/conda-forge/hd…

New NISAR sample data products are live, showcasing how HDF5 enables seamless, high-performance access to massive Earth science datasets--and they're cloud-optimized from the start. Need help getting your data cloud optimized? Reach out to The HDF Group. earthdata.nasa.gov/news/nisar-sam…

We're thrilled to announce a major award from the U.S. National Science Foundation @NSF! This #SafeOSE award will fund critical efforts to enhance the safety, security, and privacy of the open-source HDF5 ecosystem. hdfgroup.org/2025/12/10/the…

The HDF Group's John Readey just returned from presenting at the Second Visualizing Offline and Live Data with AI (VOLDA) Workshop - 2025! Check out John's talk, "Data Streaming using HDF5 and HSDS" agenda.ciemat.es/event/4923/con… Full VOLDA Workshop agenda: agenda.ciemat.es/event/4923/con…

HDF5 2.0.0 is here! Learn more about what's packed into this new release in the newsletter: hdfgroup.org/2025/11/10/rel…

In Tuesday's Call the Doctor, we'll talk to Steven Varga creator of IEX2H5, a high-performance C++ utility that converts IEX Transport Protocol (IEX-TP) packet captures into structured HDF5 datasets. Join us! More info: forum.hdfgroup.org/t/13407

We've updated this post to talk about some of the features available in the next HDF5 library release 2.0: CMake presets, new ROS3 backend, and building the library with a faster DEFLATE compression filter. hdfgroup.org/2025/07/22/how…

We're excited to announce Scot Breitenfeld as our new Director of Engineering! hdfgroup.org/2025/04/16/app…

Please come and see how you can talk to @hdf5 data in natural language: forum.hdfgroup.org/t/bringing-ai-…

We're removing Autotools --> full details in this forum post: forum.hdfgroup.org/t/hdf5-shake-u…

If anyone is curious to see HSDS used with really large datasets (> 1TB), checkout this repo: forum.hdfgroup.org/t/nrel-example… You'll find some python notebooks, and this repo also supports github codespaces.

Would adding map support to the Highly Scalable Data Service (HSDS) be helpful? Check out this design document and let us know - what features would you look for? Do you have a funding available for us to add this or a proposal that might cover this work? forum.hdfgroup.org/t/hsds-map-obj…

Have a few minutes? Help us test. forum.hdfgroup.org/t/hdf5-1-14-5-…

Videos and slide decks for most presentations from #HUG24 have been posted: hdfgroup.org/hug/hug24/agen…

Today Engineering Director Dana Robinson participated in the 2024 CASS Community BOF Days. This event continues through the 13th--it's not too late to register for sessions happening Wednesday and Thursday! cass.community/bofs.html

Announcing fixes to CVE issues - these fixes are included in the HDF5 1.14.4 release that came out in April. Details on the blog: hdfgroup.org/2024/05/new-hd…

Webinar Announcement: h5rdmtoolbox – A Python Research Data Management Toolbox for HDF5 webinar will be this Friday (May 3) at 11:00 a.m. Central time (US/Canada) Join us--registration is required: us06web.zoom.us/meeting/regist…

Do you use non-IEEE reduced-precision floating point types in your machine learning workflows? We’re thinking of adding further support for additional types, like BFLOAT16 and FP8, to HDF5 1.14.5. Respond to this survey to help us prioritize: forum.hdfgroup.org/t/12250

The 2024 HDF5 User Group Meeting will be held August 5-7, 2024 in Chicago. We're currently soliciting talks and posters for this event! More info on the forum: forum.hdfgroup.org/t/2024-hdf5-us…

Here's a fun eclipse related post from The HDF Group's H. Joe Lee. forum.hdfgroup.org/t/solar-eclips…