HSI

Welcome to the HSI home page

The Hierarchical Storage Interface (HSI) is a friendly interface for users of the High Performance Storage System (HPSS). It It is intended to provide a familiar Unix-style environment for working within the HPSS environment, while automatically taking advantage of the power of HPSS (e.g. for high speed parallel file transfers) without requiring any special user interaction, where possible.


Features


HSI's many features include:

  • Familiar Unix-style command interface, with commands such as "LS", "CD", etc.  Command aliases and abbreviations 
  • Ability to read command input from a file, and write log or command output to a file.
  • Interactive "history" and command line editing
  • Interactive, batch, or "one-liner" execution modes 
  • Ability to interactively pipe data into or out of HPSS, using filters such as "TAR" 
  • Recursive option is available for most commands; including the ability to copy an entire directory tree to or from HPSS with a single simple command 
  • Conditional put and get operations, including ability to update based on file timestamps 
  • Automatic optimization and background scheduling of tape mounts for file retrievals while transfers proceed in the foreground
  • Administrator functions such as recursive chown, chmod, su, sudo, change COS
  • Extensive listing options for "ls", with the ability to list tape volume and position for files, and all of the hierarchy information for files
  • Automatically uses HPSS parallel I/O features for file transfer operations 
  • Integrated with the HPSS Transfer Agent for high speed multinode transfers beween HPSS and cluster filesystems
  • Multi-threaded I/O within a single process space 
  •  
  • HSI runs on most major Unix-based platforms, including Cygwin on Windows, and 32 or 64-bit Linux and FreeBSD platforms 
  • Provides the ability to connect to multiple HPSS systems and perform 3rd-party copies between the systems, using a "virtual drive" path notation.


Caveats

Although HSI is freely available to the HPSS community, it is not supported by IBM


See the Support section of this web site for information on obtaining HSI and HTAR support from Gleicher Enterprises.


The other usual legal caveats apply - while testing is performed prior to each release, and HSI is believed to transfer data reliably without inadvertently corrupting files, no guarantees are made, and no liability is assumed for any problems or damages that may accrue as a result of using HSI.


Use HSI at your own risk!


Acknowledgments


 Many of the early HSI improvements were funded by the National Energy Reseach Supercomputer Center (NERSC) and the PROBE project at Oak Ridge National Laboratory.