Data Transfer with Globus
The recommended process to transfer large data files from and to the Rockfish cluster is to use Globus (globus.org). Globus manages all data transfers, in the background, and makes sure the process goes through even with interruptions.
1. Use a browser to connect to globus.org
2. Search and Select "Johns Hopkins"
3. Log in using your JHED ID.
4. Collection Search
After your credentials are verified you will get Collection Search screen.
You need to search for the collection “rockfish”.
The Rockfish User Data collection will appear below – click on it.
5. File Manager - Authentication
The following screen will give you the “Rockfish User Data” collection and a prompt to authenticate.
This needs to be done the fist time you access the collection, or if you delete it.
Click “Continue”.
6. Select your JHED ID
7. Allow Global Web App
Next, move to the bottom of the screen and click on “Allow”
8. Select your end point.
This screen shows that you are connected to the Rockfish end point (your HOME directory).
9. Search/Select the Second DTN
You need to select the end point. In this case and for simplicity we will use my “Globus Connect personal” installed on my laptop. It can be any other DTN, for example Bridges2 (ACCESS resource provider)
10. MyProxy Client Authorization / Login
You may or may not need to authenticate to the second system. For my personal connect I do not need authentiation (see item 9)
11. FileManager View
Now you will see a split window.
On the left side you can see files on Rockfish and on the right side files on the Rockfish (HOME dirs)
12. File Transfer
After you authenticate to Rockfish, you can start a file transfer.
For example: I want to copy the directory “OMP-src”, select it and then click on “start”. You may want to check the “Transfer & Sync Options”.
