Welcome to the HSI home page
The Hierarchical Storage Interface (HSI) is a friendly interface for users of the High Performance Storage System (HPSS). It It is intended to provide a familiar Unix-style environment for working within the HPSS environment, while automatically taking advantage of the power of HPSS (e.g. for high speed parallel file transfers) without requiring any special user interaction, where possible.
Features
- Familiar Unix-style command interface, with commands such as "LS", "CD", etc.
- Interactive "history" and command line editing
- Interactive, batch, or "one-liner" execution modes
- Ability to interactively pipe data into or out of HPSS, using filters such as "TAR"
- Recursive option is available for most commands; including the ability to copy an entire directory tree to or from HPSS with a single simple command
- Conditional put and get operations, including ability to update based on file timestamps
- Automatically uses HPSS parallel I/O features for file transfer operations
- Multi-threaded I/O within a single process space
- Command aliases and abbreviations
- Ability to generate and check md5 or crc checksums for files as they are saved or retrieved, and ability generate checksums for existing stored files
- 10 working directories
- Ability to read command input from a file, and write log or command output to a file.
- HSI runs on most major Unix-based platforms, including Cygwin on Windows, and 32 or 64-bit Linux and FreeBSD platforms
- Provides the ability to connect to multiple HPSS systems and perform 3rd-party copies between the systems, using a "virtual drive" path notation.
Caveats
Although HSI is freely available to the HPSS community, it is not supported by IBM.The other usual legal caveats apply - while testing is performed prior to each release, and HSI is believed to transfer data reliably without inadvertently corrupting files, no guarantees are made, and no liability is assumed for any problems or damages that may accrue as a result of using HSI.
Use HSI at your own risk!
Acknowledgments
Many of the early HSI improvements were funded by The National Energy Research Supercomputer Center (NERSC) and the PROBE project at Oak Ridge National Laboratory.