• ARCH
  • Data Transfer with Globus

Data Transfer with Globus

The recommended process to transfer large data files from and to the Rockfish cluster is to use Globus (globus.org). Globus manages all data transfers, in the background, and makes sure the process goes through even with interruptions.

1. Use a browser to connect to globus.org

2. Search and Select "Johns Hopkins"

3. Log in using your JHED ID.

4. Collection Search

After your credentials are verified you will get Collection Search screen.

You need to search for the collection “rockfish”.

The Rockfish User Data collection will appear below – click on it.

5. File Manager - Authentication

The following screen will give you the “Rockfish User Data” collection and a prompt to authenticate.

This needs to be done the fist time you access the collection, or if you delete it.

Click “Continue”.

6. Select your JHED ID

7. Allow Global Web App

Next, move to the bottom of the screen and click on “Allow”

8. Select your end point.

This screen shows that you are connected to the Rockfish end point (your HOME directory).

9. Search/Select the Second DTN

You need to select the end point. In this case and for simplicity we will use  my “Globus Connect personal” installed on my laptop.  It  can be any other DTN, for example Bridges2 (ACCESS resource provider) 

10. MyProxy Client Authorization / Login

You may or may not need to authenticate to the second system. For  my personal connect I do not need authentiation (see item 9)  

11. FileManager View

Now you will see a split window.

On the left side you can see files on Rockfish and on the right side files on the Rockfish (HOME dirs)

12. File Transfer

After you authenticate to Rockfish, you can start a file transfer.

For example: I want to copy the directory “OMP-src”, select it and then click on “start”. You may want to check the “Transfer & Sync Options”.

Data Transfer with Globus