Getting the "cube_5" data from NAS (NASA Ames)
==============================================

Due mostly to the latency of long-distance connections, its rather
inefficient to copy large files one at a time using a single "scp"
command [1].  In order to speed-up and automate the process of
transferring a large number of large files, a multi-threaded scp
command wrapper called "mt_scp" was written.  To build mt_scp, issue
the following commands

   export CVSROOT=':pserver:cvsanon@mitgcm.org:/u/gcmpack'
   cvs login
     <== "cvsanon"
   cvs co development/edhill/mt_scp
   cd development/edhill/mt_scp/
   ./configure 
   make

at which point the directory should contain an "mt_scp" executable.
Copy that executable to a suitable install location or wherever you
need to use it.

To use mt_scp, it is best to first setup so-called "password-less"
(public-key) SSH authentication between the two hosts.  The
configuration of public-key SSH authentication is described on many
helpful on-line sites [2] and takes only a few minutes.

To use mt_scp, some example commands are:

  #  Get a description of all the mt_scp options
  #
  ./mt_scp

  #  Copy all files matching the pattern "Stave.00*" at the 
  #  location lou.nas.nasa.gov:/ecco/menemenl/cube5/output 
  #  using 8 concurrent threads (note how the file pattern
  #  or "glob" has been escaped so that expansion only 
  #  on the "remote" side):
  #
  ./mt_scp -n 8 -p 'Stave\*' lou.nas.nasa.gov /ecco/menemenl/cube5/output


Please send questions about mt_scp to Ed Hill <eh3@mit.edu>.


References
==========

[1] Speedups of 10x--11.5x have been routinely observed:
      http://mitgcm.org/eh3/lou.nas.nasa.gov/
      http://mitgcm.org/eh3/lou.nas.nasa.gov/lou_data_xfer.png

[2] http://www-106.ibm.com/developerworks/library/l-keyc.html
    http://cfm.gs.washington.edu/security/ssh/client-pkauth/