XSEDE is a single, virtual cyberinfrastructure that scientists use to interactively share computing resources, data, and expertise. XSEDE resources may be broadly categorized as follows: High Performance Computing, High Throughput Computing, Visualization, Storage, and Data Services. Many resources provide overlapping functionality across categories. For more information visit the list of XSEDE resources.
This recently recorded webinar presentation provides an overview of XSEDE and it's services and capabilities. The second half of the presentation details each of XSEDE's compute resources.
| XSEDE New User Training |
Recorded January 14, 2014
Run time: 0:53:36
Your Campus Champion is your local source of knowledge about high-performance computing opportunities and resources. Your Campus Champion can direct researchers and educators to national high-performance computing resources and services that are available to you and that will help you to advance scientific discovery.
| Get to know your campus representative! |
Search the campus champions directory to find your local Campus Champion
Your representative will:
- Provide you with information about high-performance computing resources to researchers and educators, including resources available from XSEDE
- Assist you to quickly get access to allocations of high-performance computing resources
- Facilitate awareness and training workshops about the use of high-performance computing resources and services
- Provide you with contacts within the high-performance computing community for quick problem resolution
- Provide you with timely information on new resources, services, and offerings
Visit XSEDE User Portal at https://portal.xsede.org In order to get access to XSEDE resources you must create an XSEDE User Portal (XUP) account. The XSEDE User Portal (XUP) is a web-based, single point-of-entry to the XSEDE system providing:
- Allocation request submission capability
- Access to all your XSEDE accounts and allocated resources
- Up-to-date information on your accounts and and allocation usage
- Interfaces for data transfers, data collections, and other user tasks and resources
- Subscriptions to user news & announcements
- Training class registration and schedule
- Access to the XSEDE Help Desk and User Forums
Log in to XSEDE User Portal and accept your user responsibility The first time you login to the XSEDE User Portal you will be asked to accept the User Responsibilities form. This form outlines acceptable use to protect shared resources and intellectual property.
You are responsible for your account and for protecting your passwords. This means:
- Do not share passwords, do not write passwords down where they can be easily found, and do not use tools that expose passwords on the network. This includes private keys: make sure they are password-protected.
- Close SSH terminals and log out of the User Portal when finished
- Report Suspicious Activity. If you have any suspicion that your account or personal computer has been compromised, email email@example.com or call, 24/7, 1-866-907-2383 immediately.
Compute time on XSEDE resources is granted via the allocations process. You may apply for a new allocation or get added to an existing allocation. Please consult the detailed information in the XSEDE User Portal in the Allocations section.
A user may apply for one of the following allocation types:
- Startup: The fastest way to get started on XSEDE, Startup allocations require minimum documentation, are reviewed all year long, and are valid for one year.
- Education: Also lasting one year, an Education allocation provides time for academic or training classes.
- Research: Research allocation requests are reviewed quarterly and require more formal documentation. Research allocations will be granted for one year and may be renewed or extended.
In addition to requesting a new allocation, a Principal Investigator (PI) may add users to an existing allocation through the portal. Click "Add User" under the "My XSEDE" tab. Once your Startup or Education allocation is submitted, you should hear back from the Allocations committee within two weeks.
This recently recorded presentation details all the steps and requirements needed for successful research allocation requests. Topics covered include Computation Methodologies, Justification for SUs requested and many others.
| Writing and Submitting a Successful XSEDE Proposal |
Recorded December 18, 2013
Run time: 1:08:28
XSEDE offers an array of computing resources including both HPC and high throughput (data intensive) machines. We also offer visualization resources and XSEDE has the expertise to help you set up tiled clusters. Please peruse the resource user guides to obtain specific system information. If you already have an allocation, then skip to step 4 to start using XSEDE.
Some preliminary questions to help determine which resource is for you:
Read the XSEDE user guides - learn more about our XSEDE resources
We realize selecting the optimum resource can be daunting. We are here to help! Submit a ticket to the help desk to ask for recommendations on which resource(s) to use for best performance.
Once you have your allocation, please go to the XSEDE User Portal and login using the account information you created in Step 2. If at any time you don't remember your password, use the password reset tool on the user portal homepage. XSEDE resources can be accessed using several methods, but we highly recommend that you use the default method, Single Sign On via SSH login hub.
XSEDE now has a single sign on login hub that you can use to access your XSEDE resources with your portal username and password. You can login to the single sign on hub login.xsede.org using your favorite ssh client with your portal username and password. For detailed instructions please visit the Single Sign on Login Hub page.
The traditional method of accessing supercomputing resources is via command line. Each hardware resource on XSEDE may be accessed via SSH username/password or with your single sign on username and password (the same as your portal username and password). To use a single XSEDE resource, login using your username and host name of the resource. Please note: you must submit a help ticket requesting a password to that resource in order to login directly. Once you have your resource-specific password, Linux and Unix users may use the built-in Unix
ssh command. Windows users may download one of many ssh clients, free ones include "putty".
ssh [-l <username>] <machinename>
ssh -l slindsey ranger.tacc.utexas.edu
Learn to transfer your files using XSEDE Data Transfers & Management services Once your accounts are set up, you'll probably want to start transferring your project files to your allocated resource. XSEDE offers several easy, reliable file transfer mechanisms briefly detailed below. For more in depth information please consult the XSEDE Data Transfers & Management page.
The built-in XSEDE User Portal File Manager transfers both small and large files. When logged into the portal, go to Resources -> File Manager and wait for the Java Applet to load. You'll see a list of all machines including your local machine.
- Click the checkbox next to "Stripe Transfers" and click OK
- Repeat for the other panel using the destination resource
- Repeat this every time you change Resources
- Drag and drop the file from source to destination to transfer.
Globus Online is a web client that implements the GridFTP protocol, providing reliable data movement service between resources. Researchers with no IT background can easily move large quantities of files, or move files of large size, using the Globus web GUI, and developers who want to automate workflows can use the Globus command-line interface (GO CLI).
Please consult the Globus User Guide for complete instructions on how to use this service.
uberftp are command-line implementations of the GridFTP protocol, which underlies all XSEDE transfer mechanisms. Use these commands to transfer large files.
Here's a sample transfer from PSC's Blacklight to TACC's Ranger optimized for large files:
$ globus-url-copy -stripe -tcp-bs 8388608 \ gsiftp:// gridftp.blacklight.psc.teragrid.org/scratcha/joeuser/file \ gsiftp:// gridftp.ranger.tacc.teragrid.org/scratch/joeuser
Visit the Data Transfers & Management page to get the GridFTP endpoints for each site.
You may also use one of these command-line tools to transfer small (< 2 GB) files between XSEDE resources and/or your local machine. From Linux or Mac, you can run these commands directly from the terminal. From Windows, use your ssh client ("putty" is freely available). Both
sftp are easy to use and secure, but may provide poor performance for large files.
A computing environment refers to the state of a compute, components such as the operating system, basic hardware infrastructure, and software characteristics.
Where your data resides on XSEDE and the appropriate storage is your responsibility. In general, all resources provide the following file systems:
- HOME: Permanent space, but small. A good choice for building software and working file collections of small to medium sized files, where a medium sized file is less than 50 MB.
- SCRATCH: More space, but temporary; use while you are running your jobs. Scratch space is temporary; it is not backed up and has limited redundancy, and is periodically purged of old files!
- Archival Storage: Long term storage of large amounts of data (often tape); slower access, accessible from all sites.
For more detailed information on file systems and storage please consult the user guide and the XSEDE Storage page.
The environment management package, Modules, is a command-line interface providing commands for setting and modifying shell environment variables. These environment variables define values used by the shell (e.g., bash, tcsh,...) and by programs that you execute on the shell command line. For example, the PATH environment variable commonly defines a list of directories that the shell should search to find an executable program that you have referred to on the command line - this allows you to execute that program without having to type out the entire directory path to the executable file for that program. Modules makes it easier for you to manage collections of environment variables associated with various software packages, and to automatically modify environment variables as needed when switching between software packages.
Go here for further information on the XSEDE software environment.
module avail- lists available modules
module list- lists currently loaded modules
module help foo- help on module
module whatis foo- brief description of module
module display foo- displays the changes that are made to the environment by loading module foo without actually loading it.
module load foo- load module
module unload foo- unloads module
fooand removes all changes that it made in the environment
All XSEDE resources employ a job scheduler (sometimes called "batch" scheduler), software that monitors and runs programs in the background, ideally achieving optimum utilization of that resource, including processors, memory, and disk space. All schedulers basically work the same way:
- request number/type of nodes you need
- specify how long you need to run
- specify where your output files go
- submit the job script containing these specifications
A typical job script may look like the following:
#!/bin/bash #$ -N myMPI # specify the job name: "myMPI" #$ -j y # combine stderr and stdout output #$ -o $JOB_NAME.o$JOB_ID # name the output file based on the job id assigned #$ -pe 12way 24 # request 12 tasks/node, 24 cores total #$ -q normal # submit this job to the "normal" queue #$ -l h_rt=01:30:00 # specify a run time (hh:mm:ss) of 1.5 hours mpirun ./a.out # Run the MPI executable named "a.out"
For the most part, XSEDE systems use the Sun Grid Engine (SGE) job scheduler. Each resource will have one or more queues, a pool of jobs waiting to run. A user submits jobs to a queue via job scheduler commands. Some common SGE commands are listed below.
qsub <myjobscript>- submit the file 'myjobscript' to start a job
qstat -u <username>- display the status of all your jobs
qdel <jobid>- delete the job from the queue using the jobid
Check out our help resources:
User News - keep up to date with what is happening with XSEDE and the services you use. XSEDE staff regularly sends announcements, machine status notices, notifications of upcoming training classes and more. Please login to XSEDE User Portal to manage your subscriptions here.
Knowledge Base - search for answers to your questions or read the most frequently asked questions in XSEDE.
User Forums - ask questions and interact with other users on the user forums available within the XSEDE User portal.
Visit XSEDE Help - get direct help to your questions from XSEDE consulting staff
XSEDE has numerous ways to search for information and get help on a variety of topics. Our staff can help with problems such as choosing a platform or resource, choosing a software package, improving file transfer performance, and help with visualization.
Extended Collaborative Support (ECSS) is available to all XSEDE users. You may request XSEDE's advanced ECSS support at any time though the Allocations tab in the XSEDE User Portal. ECSS requires written justification and a project plan. Our highly experienced staff can help with:
- porting applications to new resources
- providing help for portal and gateway development
- implementing algorithmic enhancements
- implementing parallel math libraries
- improving scalability of codes to higher processor counts
- optimizing codes to efficiently utilize specific resources
- assisting with visualization, workflow, data analysis, and data transfer
- performance analysis
Need additional support? Visit XSEDE Extended Collaborative Support.
XSEDE also provides a way to manage your XSEDE information via your mobile device.
- browse all XSEDE systems
- view and subscribe to user news
- view and register for training courses
- view your allocations and account information
- monitor XSEDE resources and job status
- download files and manage transfers
- simple creation of shared groups for any file/folder
- one-click permission management
Check out XSEDE Mobile User Portal from the convenience of your mobile device anytime and anywhere.
Last update: March 5, 2014