Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The HPC team is updating this page. Check back for new information.

Introduction

Globus is an easy-to-use, high-performance data transfer tool developed by the Computation Institute, which is a partnership between The University of Chicago and Argonne National Laboratory. UConn has deployed Globus as one mechanism to facilitate data transfer to and from the Storrs HPC cluster. You can also use Globus to transfer data between external institutions and UConn, including to and from your personal machine. Data can be transferred using a convenient web interface or a command line interface.

...

The instructions below demonstrate how to move data from the /shared file system to the /archive file system. The same instructions could be used to transfer data between any two file systems which are permanently mounted on the cluster. UConn's Globus node has access to the following file systems:

Path

Description

/home/<user_name>

User home directories

/shared/<group_name>

Group shares

/archive/<share_name>

Long term data storage (deprecated)

/scratch/<advisor_name>/<user_name>

High-performance for temporary files

  1. Go to the Globus Web App. Select University of Connecticut from the Organization dropdown. Then authenticate using your NetID and password.

  2. On the left, click the File Manager link.

  3. Inside the Collection box, search for and select dtn2.storrs.hpc.uconn.edu, which is the identifier for UConn's Storrs HPC Globus server.

  4. If you haven't accessed Globus in a while, you will be asked to login with your UConn username/password. Under Please authenticate to access this endpoint enter your NetID next to Username, and then your NetID password.

  5. In the left pane, next to Path, enter the absolute path of the folder containing the files you wish to transfer to another location. For example, /shared/mylab.

  6. On the right pane, click inside the Search box. Search for and select the endpoint you wish to transfer files to.

  7. In the right pane, next to Path, enter the absolute path of the folder to which you would like to transfer the data selected in the left pane. For example, /archive/mylab.

  8. In the left pane, select the files to transfer and click Start to move the data from the location on the left, to the location on the right.

  9. You can click on the Activity tab at the top of the window to monitor the progress of your data migration. You will also receive an email alert when the migration is complete.

  10. To transfer To the dtn2.storrs.hpc.uconn.edu endpoint, reverse the source and destination in the above steps.

...

  1. Login to the Globus Web App using your Globus ID. To do so, visit this page: https://www.globus.org/app/transfer . Click on the link Then use Globus ID to sign in.

  2. Enter your Globus ID username and password and click Log in.

  3. Click on the Account link at the top right of the Globus Web App.

  4. Click Add Linked Identity.

  5. In the search box, enter University of Connecticut and click Continue.

  6. Finally, you will be redirected to UConn's NetID login web page, as shown in Figure 13. Enter your NetID and password, and then click Login. Your UConn NetID will now be linked to your Globus ID.

 

Setting up a Lab Machine/Instrument or Shared Computer

Warning

Sharing NetID passwords raises significant security concerns for the user and their data.

If a machine or instrument that is shared between many users need a globus endpoint set up for transfer to Storrs HPC or elsewhere, it is better to create a separate email and globus account to create the local end point.

Example:

  1. Create a new gmail for lab machine:

    1. labmachine3@gmail.com

  2. Log in to globus web with lab machine email

  3. Install (or resintall) globus personal connect and log in with lab machine email

    1. name the local endpoint “UConn Lab Machine 3”

All users of the lab machine should now have access to the local globus endpoint and transfer files to where it is needed.

If they wanted to transfer to Storrs HPC, they can find the http://dtn2.storrs.hpc.uconn.edu/ and login with their Netid to proceed.