NCSA Home
Contact Us | Intranet | Search

Data Transfer

Table of Contents

  1. Data Transfer Overview
    Data Transfer Protocols
    Data Transfer Clients
    NCSA-TeraGrid Data Transfer Resources
    NCSA Mass Storage System Transfers
    Data Transfer Software Installation
    Transfer Performance Considerations
    Data Transfer Examples

Data Transfer Clients

The following lists describe most of the data transfer–related tools that are installed on NCSA systems. Links to current man pages and/or other documentation are provided here as a convenience.

scp
Where to Use
  • Available on all NCSA systems.
  • Can be installed on all operating systems for external access.
Documentation
uberftp
Description
  • Command line or interactive FTP interface
  • Fully capable GridFTP enabled FTP client.
    • Can be used to pass FTP command directly to the server via the "quote " command
    • ls, rm, chmod and other utility function are available and some with recursive options.
  • Parallel streams and other GridFTP extensions can be enabled
  • GSI (grid-proxy) authentication available for TeraGrid users
  • Supports third-party transfers
Where to Use
  • Available on all NCSA systems.
  • Can be installed in conjunction with the Globus toolkit on Unix/Linux systems.
  • Move files between client location and any FTP or GridFTP installation.
  • Move files between any set of FTP or GridFTP servers (third party).
Documentation
mssftp/msscmd
Description
  • mssftp allows a password-less interactive FTP session to be initiated from any NCSA production machine
  • msscmd is a command line interface to send FTP commands to MSS and will retry transfers automatically.
Where to Use
  • Available only on NCSA systems
  • Move files to/from NCSA system and NCSA Mass Storage System (MSS).
Documentation
globus-url-copy
Description
  • A command line GridFTP client
  • Newer versions allow striped transfers across multiple servers
Where to Use
  • Available on all NCSA production systems.
  • CTSS component.
  • Move files between client location and any GridFTP installation.
  • Move files between any set of GridFTP servers (third party).
Documentation
tgcp
Where to Use
  • Available only on Teragrid CTSS locations.
  • Move files between client location and any GridFTP installation.
  • Move files between any set of GridFTP servers (third party).
Documentation