Open OnDemand (Browser Based HPC Portal)

CURC Open OnDemand is a browser based, integrated, single access point for all of your high performance computing (HPC) resources at CU Research Computing. CURC Open OnDemand provides a graphical interface to view, edit, download, and upload files; manage and create job templates for CURC’s clusters; and access CURC interactive applications (Virtual Desktops, Matlab, and JupyterNotebooks). All of these actions are completed via a web browser and require only minimal knowledge of Linux and scheduler commands.

Getting started with CURC Open OnDemand

To connect to CURC Open OnDemand, visit https://ondemand.rc.colorado.edu. The first page of CURC Open OnDemand will bring you to a login prompt. Use your CU Research Computing credentials and Duo 2-factor authentication to login. If you need a CU Research Computing account please visit our account request page to get started.

../_images/login_page.png

Notes on logging out:

  • You must completely quit your browser in order for “logout” to occur. If after reopening your browser you are still logged in, please clear your cookies. If you are on a Chromebook or Chromebox, you will need to reboot your device in order to “quit the browser” and thus “logout”.
  • Tip: Using a “private browsing mode” window while using OnDemand is a great way to handle “auto-logout”, as closing your browser window will remove all associated cookies and session information.

Features

When you have successfully logged into CU Open OnDemand, you will see the landing page with the following features broken into tabs along the top of the page: Files, Jobs, Clusters (shell access), Interactive Apps, and My Interactive Sessions.

../_images/landing_page.png

We’ll step through these features one at a time.

Files

The File menu allows you to view and operate on files in different file spaces: your home directory, projects directory, scratch spaces, and (if you own one or are part of a group with one) access to PetaLibary allocations.

Selecting one of the file spaces will open a separate browser window which will allow you to navigate the space in a graphical setting similar to a file browser on a personal computer. From here you can download, upload, create, delete, and open files.

NOTE: Please use Globus to transfer files to and from /scratch/alpine or /rc_scratch. Additionally, Globus should be used if you have more than 1 GB of data to transfer. OnDemand is not designed to handle large file transfers.

../_images/home_file.png

For additional documentation visit OSC’s File Transfer and Management help page.

Jobs

Jobs can be monitored, created, edited and scheduled with the job management tools under the Jobs menu.

  • Active Jobs: Under the “Active Jobs” tab you can view active jobs. You can choose to view your jobs (or all jobs) as well as choose from specific clusters (Alpine, Core, or All Clusters). From this menu you can also cancel your own jobs.

../_images/active_jobs.png

  • Job Composer: Create and edit job scripts and schedule jobs under this menu.
See OSC’s Job Management help page for detailed use of the job composer feature.

../_images/job_composer.png

Clusters (Shell Access)

The Clusters menu provides shell access to login nodes on CURC clusters. The shell terminal is similar to many other tools that provide terminal access.

Currently, Alpine shells log you into a basic login node. You can load in either Alpine or Blanca slurm instances from here: module load  slurm/<cluster> with either Alpine or Blanca.
  • Alpine: The Alpine tab will launch a terminal that RC users can use to manually access an RC Login node. After the tab opens, type your CURC password and accept the Duo push to your phone, which will complete the login to the terminal.

Interactive Applications Menu

The Interactive Applications menu contains options to launch certain applications that have graphical user interfaces (GUIs) for interactive use on CURC clusters. Current supported applications include a remote desktop atop the core cluster, MATLAB, and JupyterHub .

Core Desktop (Remote Desktop)

  1. When starting a Remote Desktop session, you may customize the resources allocated to the session and other characteristics of the dispatched Slurm job. The default will open a Remote Desktop with 1 node (2 cores) for 1 hour (no need to specify “Account”). ../_images/core_launch.png
  2. Click “Launch” to submit the Remote Destop job to the queue. The wait time depends on the number of other users presently on the resource. Requesting smaller, shorter jobs may faciliate shorter wait times.
  3. When your Remote Desktop is ready, you can click the “Launch Core Desktop” button. In most cases, the default compression and image quality will suffice. If you do have problems with image quality you can adjust these settings as necessary.
  4. With the Remote Desktop session running and open, you should be able to run standard Linux desktop applications that have a graphical user interface (GUI).

Notes:

  • You can copy/paste into/out of the VNC desktop using the clipboard in the “hidden” tab on the left-hand-side of the virtual desktop. ../_images/copypasta.png
  • Closing the window will not terminate the job. You can use the “My Interactive Sessions” tab to view all open interactive sessions and terminate them.

MATLAB

  1. When starting an interactive MatLab job, you may customize the resources allocated to the session and other characteristics of the dispatched Slurm job, including the Matlab version. In most cases, the defaults will be adequate (i.e, no need to specify an account). ../_images/matlab_launch.png
  2. Click “Launch” to submit the MATLAB job to the queue. The wait time depends on the number of cores, nodes, and time requested.
  3. When your Matlab session is ready, you can click the “Launch MATLAB on Core- CURC”. In most cases, the default compression and image quality will suffice. If you do have problems with image quality of the Remote Desktop, you can adjust as necessary. An interactive Matlab session will be started in a new window.

Notes:

  • Some users find running Matlab in the Core Remote Desktop option provides an enhanced experience. To do this, start a Remote Desktop session, open a terminal by clicking “Applications” -> “System Tools” –> “MATE Terminal”, then load the MATLAB module. Finally, start MATLAB by typing
module load matlab/2019b
matlab
  • Closing the window will not terminate the job, you can use the “My Interactive Sessions” tab to view all open interactive sessions and terminate them.

JupyterHub

  1. When starting an interactive JupyterHub job, you may select JupyterHub 1 (Presets) or JupyterHub 2 (Custom) from the list of servers. The first server option offers preset configurations for convenience; you may select 1 core for 12 hours or 4 cores for 4 hours. Most use cases can be accommodated by one of the presets. The JupyterHub 1 (Presets) server submits jobs to Alpine’s ahub partition. This partition provides users with rapid start times, but limits users to one Jupyter session (or any one job using the partition). JupyterHub 2 (Custom) allows you to specify the cluster, account, partition, number of hours and cores, and QoS.
  2. Click “Launch” to submit the JupyterNotebook job to the queue. The wait time depends on the number of cores and time requested.
  3. Once your Jupyter Notebook session is ready, you can click “Connect to Jupyter”. An interactive Jupyter Notebook session will be started in a new window.
  4. To shut down a Notebook server, go to the “File” menu at the top and choose “Shut Down”. This will shut down the Jupyter notebook server and cancels the job you are running on Alpine or Blanca. You also have the option to restart a server if desired. Closing the window will not terminate the job. You can use the “My Interactive Sessions” tab in Open OnDemand to terminate running sessions.

Notes:

  • In most cases, the default compression and image quality will suffice. If you do have problems with image quality of the Remote Desktop, you can adjust as necessary.
  • When the server starts, the file navigator panel displays CURC root. You can navigate to one of your CURC spaces by selecting home or projects from the file panel on the left. Alternatively, you can go to “File” then “Open Path” and enter your path in the field (e.g. /projects/<your username>).

For more information on running Jupyter Notebooks, check out RC’s page on Jupyter.

My Interactive Sessions

The My Interactive Sessions menu will let you view and manage all of your current open Interactive applications. From this window, you can view the node/core count, status, as well as time remaining for current sessions.

Closing the window an interactive application is opened in will not terminate the session. You will need to click the “Delete” button for the individual session. ../_images/my_interactive_sessions.png

Couldn’t find what you need? Provide feedback on these docs!