fts client¶
This page includes the basic commands to use the FTS (File Transfer Service). For an overview of storage clients, see Storage clients.
Contents
FTS¶
FTS3 is a file transfer service for reliable file transfers across sites or else, third party transfers. You cannot use it to transfer files from your local machine to dCache and vice-versa. FTS3 service has been running for years. It was developed by Cern for WLCG data transfers up to petabytes per month.
From the user perspective, it allows data movement, retrying if necessary, monitoring and displaying usage statistics, see FTS3 wiki. From the operations view, it optimises resource usage.
It supports all the basic transfer protocols, such as: GridFTP, SRM, Webdav, HTTPS, xroot. It is open source and can be used from command-line clients or WebFTS, the web-interface version, or python bindings.
The FTS client is currently installed on the UI ui.grid.sara.nl
. It is not available on the LSG UI machines.
Authentication¶
To use the FTS you need to create a local proxy. Then`fts-transfer-submit` automatically delegates the proxy to the FTS server (default lifetime is 12 hours). When the remaining lifetime of the stored proxy passes under 4 hours, fts-transfer-submit will automatically delegate a new one as long as there is a valid local proxy.
FTS file transfers¶
Note
To run the examples below you need to have a valid local proxy. The voms-proxy-init
tool can be used to generate a proxy with VOMS attributes from the personal certificate. See Starting a Grid session.
fts-transfer-submit¶
This command submits transfer-jobs by specifying the source and destination file location. The file location can be a SURL, TURL or HTTPS link. The source and destination endpoints are GridFTP or SRM servers. The output of the command is a unique ID that can be used for tracing the transfer status.
Basic options¶
-v
: enable verbose information-s
: specify fts server-K
: enable checksum. By default, adler32 is supported on the SURFsara servers.
File transfer - TURL to TURL¶
$fts-transfer-submit -s https://fts3.grid.sara.nl:8443 \
$ gsiftp://gridftp.grid.sara.nl:2811/pnfs/grid.sara.nl/data/lsgrid/homer/zap.tar \
$ gsiftp://gridftp.grid.sara.nl:2811/pnfs/grid.sara.nl/data/lsgrid/penelope/zap.tar
File transfer - TURL to TURL¶
$fts-transfer-submit -s https://fts3.grid.sara.nl:8443 \
$ gsiftp://gridftp.grid.sara.nl:2811/pnfs/grid.sara.nl/data/lsgrid/homer/zap.tar \
$ gsiftp://gridftp.grid.sara.nl:2811/pnfs/grid.sara.nl/data/lsgrid/penelope/zap.tar
File transfer - SRMv2 to SRMv2¶
$fts-transfer-submit -s https://fts3.grid.sara.nl:8443 \
$ srm://srm.grid.sara.nl:8443/srm/managerv2?SFN=/pnfs/grid.sara.nl/data/lsgrid/zap.tar \
$ srm://srm.grid.sara.nl:8443/srm/managerv2?SFN=/pnfs/grid.sara.nl/data/lsgrid/penelope/zap.tar
Note
Combinations between TURLS, SURLS, HTTPS and SRMv2 are possible.
Monitor Status¶
Command line¶
The fts-transfer-submit
command will return instantly an ID for the specific job. This ID can be used to trace the status of the transfer:
$fts-transfer-status -s https://fts3.grid.sara.nl:8443 9e665677-76e5-4734-b729-b69e161da99a
## replace the string with your ID
Web interface¶
You can monitor the transfer status and trace the logging information on this page:
At the moment any jobs are visible to anyone under any VO, but this can be closed by our system administrators upon request, just contact us at helpdesk@surfsara.nl.