What is Jetstream (IU/TACC)?
Jetstream is a cloud computing environment designed to provide Extreme Science and Engineering Discovery Environment (XSEDE) researchers and students user-friendly, on-demand access to interactive computing and data analysis resources. Jetstream is implemented and supported by Indiana University, Texas Advanced Computing Center (TACC), and several additional partner institutions across the nation.
Jetstream provides a library of virtual machines pre-configured to support scientific analysis and collaboration in a variety disciplines (e.g., biology, earth sciences, and social sciences, among others). Generic Linux-based VM configurations also are available, allowing software developers and researchers to create their own custom VMs to support specific applications or disciplines. Creators of custom VMs can save them for future reuse either as "private VMs" or share them with other Jetstream researchers via the "public" VM library.
Users can browse available images and launch new instances via Jetstream's web-based user interface (https://use.jetstream-cloud.org/). Once an instance is launched, users can access it either from the web console or via VNC remote desktop applications running on their personal workstations.
Jetstream's computing environment comprises two homogenous clusters deployed at IU and TACC, with a smaller development system is deployed at the University of Arizona:
Jetstream's web-based, on-demand environment is based on the Atmosphere cloud computing platform developed by CyVerse (formerly the iPlant Collaborative). Jetstream's operational software environment is based on the OpenStack cloud operating system. Identity and access management (IAM) functionality is handled by Globus Auth, allowing allocated users to authenticate using their XSEDE-wide credentials. Integration with the Globus file transfer service simplifies data transfers between Jetstream VMs and other endpoints, including other XSEDE digital services, other campus-based HPC systems, and personal desktop and laptop workstations.
Jetstream is not a high-performance computing (HPC) environment appropriate for large-scale parallel processing or high-throughput computing (HTC); it is intended primarily as a resource for performing interactive, small-scale, on-demand processing, and as a back-end for science gateways that route jobs to other HPC or HTC systems. The Jetstream environment is particularly useful for prototyping tailored workflows that can run on smaller-scale systems or be ported to larger environments.
Access to Jetstream is available to XSEDE researchers with Startup allocations. To request an allocation, create an XSEDE User Portal account, and then submit an allocation proposal using the XSEDE Resource Allocation Service (XRAS). For more, see How do I apply for a new XSEDE allocation?