How to transfer data to and from GEMINI

This guide explains accessible ways to move data to and from GEMINI using Globus (recommended), SFTP, and the DTN. Each section includes clear steps and example commands.

A. Transfer data using a Globus endpoint on the DTN (recommended)

We have a Globus endpoint set up on our Data Transfer Node (DTN). For step-by-step setup and transfer instructions, see Set up and use the DTN Globus endpoint (RCD Docs).

Step 1: Go to the Gemini mount point on the DTN

Example: Navigate to your project directory on the appropriate GEMINI instance.

To transfer data from other Globus endpoints or from a Personal Globus Endpoint (your workstation or laptop), see Create a Personal Collection – setup steps (RCD Docs) and follow the instructions under the Create a Personal Collection section.

For Personal Collections, follow the Create a Personal Collection section on the page linked above.

B. Transfer data using an SFTP client (not recommended for large transfers)

Use any SFTP client (for example, FileZilla or WinSCP) to transfer small amounts of data. For large or many files, use Globus instead for reliability and performance.

C. Transfer LCC data to GEMINI

DTN (Data Transfer Node) node is attached to both LCC (GPFS) and Gemini Storage.

Step 1: SSH to the DTN (Data Transfer Node)

Use the cp or rsync commands to transfer data between the following LCC directories and GEMINI mount points.

Step 2: Identify LCC and GEMINI paths