Hierarchical Data Format
From Wikipedia, the free encyclopedia
| Hierarchical Data Format | |
|---|---|
| File name extension | hdf, h4, hdf4, h5, hdf5, he4, he5 |
| Type of format | scientific data format |
| Website | http://www.hdfgroup.org |
Hierarchical Data Format, commonly abbreviated HDF, HDF4, or HDF5 is a library and multi-object file format for the transfer of graphical and numerical data between computers. It was created by the NCSA, but is currently maintained by The HDF Group. The freely available HDF distribution consists of the library, command-line utilities, test suite source, Java interface, and the Java-based HDF Viewer (HDFView).
HDF supports several different data models, including multidimensional arrays, raster images, and tables. Each defines a specific aggregate data type and provides an API for reading, writing, and organizing the data and metadata. New data models can be added by the HDF developers or users.
HDF is self-describing, allowing an application to interpret the structure and contents of a file without any outside information. One HDF file can hold a mixture of related objects which can be accessed as a group or as individual objects. Users can create their own grouping structures called "vgroups."
Contents |
[edit] Tools
- HDFView A browser and editor for HDF files
[edit] HDF5
The HDF5 format is designed to address some of the limitations of the HDF4 library, and to address current and anticipated requirements of modern systems and applications. In 2002 it won an R&D 100 award.[1] [2].
The next version of NetCDF, version 4, is based on HDF5.
Because it uses B-trees to index table objects, it works well for Time series data like stock market ticks or network monitoring data. The bulk of the data goes into straightforward arrays (the table objects) that can be accessed much more quickly than the rows of a SQL database. But you still have B-Tree access for non-array data. If you find yourself designing a Star schema to fit your data into SQL, then you might want to investigate HDF5 as a simpler, faster alternative storage mechanism.
[edit] Interfaces
[edit] Low-level APIs
[edit] High-level APIs
- HDF5 Lite (H5LT) – a light-weight interface for C
- HDF5 Image (H5IM) – a C interface for images or rasters
- HDF5 Table (H5TB) – a C interface for tables
- HDF5 Packet Table (H5PT) – interfaces for C and [C++] to handle "packet" data, accessed at high-speeds
- HDF5 Dimension Scale (H5DS) – allows dimension scales to be added to HDF5; to be introduced in the HDF5-1.8 release
[edit] See also
- Common Data Format (CDF)
- NetCDF
- FITS, a data format used in astronomy
- GRIB (GRIdded Binary), a data format used in meteorology
- Q5cost a FORTRAN API to use hdf5 in quantum chemistry
[edit] External links
- HDF home page
- HDF5 home page
- What is HDF5?
- "An Introduction to Distributed Visualization"; section 4.2 contains a comparison of CDF, HDF, and netCDF.
- A presentation on how to handle large datasets in Quantum Chemistry using hdf5
This article was originally based on material from the Free On-line Dictionary of Computing, which is licensed under the GFDL.
