Sep 23 – 27, 2024
ESRF Auditorium
Europe/Paris timezone

Crashproofing the HDF5 library

Sep 24, 2024, 4:30 PM
15m
Hybrid event (ESRF Auditorium)

Hybrid event

ESRF Auditorium

EPN Campus ESRF - ILL 71 Av. des Martyrs, 38000 Grenoble
Talk Data formats Data formats

Speaker

Dr Dana Robinson (The HDF Group)

Description

In this presentation, we review several approaches to crashproofing the HDF5 library. We describe an implementation based on a Write-Ahead Log (WAL) for metadata within the HDF5 library. In the event of a crash during the lifetime of an application using HDF5, this WAL can be used by the library or an external tool to restore the metadata within an HDF5 file to a self-consistent state, preventing file corruption and limiting the loss of application data with minimal I/O and memory overhead.

Abstract publication I agree that the abstract will be published on the web site

Primary authors

Dr Dana Robinson (The HDF Group) Mrs Glenn Song (The HDF Group) Mr Matt Larson (The HDF Group) Mr Neil Fortner (The HDF Group) Mrs Vailin Choi (The HDF Group)

Presentation materials