FASSE – FASRC DOCS https://docs.rc.fas.harvard.edu Thu, 19 Dec 2024 15:13:16 +0000 en-US hourly 1 https://wordpress.org/?v=6.7.1 https://docs.rc.fas.harvard.edu/wp-content/uploads/2018/08/fasrc_64x64.png FASSE – FASRC DOCS https://docs.rc.fas.harvard.edu 32 32 172380571 FASSE Cluster (FAS Secure Environment) https://docs.rc.fas.harvard.edu/kb/fasse/ Wed, 24 Aug 2022 12:44:19 +0000 https://docs.rc.fas.harvard.edu/?post_type=epkb_post_type_1&p=23798 Overview

The FAS Secure Environment (FASSE) is a secure multi-tenant cluster environment to provide Harvard researchers access to a secure enclave for analysis of sensitive datasets with DUA‘s and IRB’s classified as Level 3. All servers in the FASSE environment are physically located inside an access-controlled data center. We have implemented security controls and access control lists to restrict access.

Access to the cluster is restricted via a Virtual Private Network (VPN) and only authorized users/groups will be added to the FASSE VPN realm. If you do not belong to a FASSE project group, you cannot access the FASSE VPN or cluster.

We provide different storage tiers based on project needs. Please review storage options. 

Note: As this is a secure environment, your home folder on FASSE is separate from any home folder you might have on the FASRC (Cannon) cluster. Data from the secure level 3 (FASSE) environment should not be transferred into level 2 space (Cannon).

FASSE is not rated for Level 4/DSL 4 data  If you require a Level 4 environment, please contact University RC (URC) to discuss options.
FASRC does not provide a Level 4 secure environment.

See also:


STEP 0: HRDSP REQUIREMENTS

In order to have a FASSE DSL3 environment created for a project, the project owner or PI must first satisfy the HRDSP application requirements. FASRC (or the HRDSP section here) is required by the university to review any documents (DUA/DAT/IRB) before a new FASSE project is created and/or any data is copied to the cluster. This information will also help FASRC determine how the environment should be set up, who the contacts are, and how project group names should be constructed.

FASRC cannot advise you on this step, please contact VPR for assistance and guidance.

HRDSP: Harvard Research Data Security Policy site
HRDSP: Applications Summary and Order of Reviews

 


Step 1: Sign up for a FASRC Account

(if you do not already have one)

Account Signup

PI/Project Owner

Users

Before you can access the FASSE cluster you need to request a Research Computing account, selecting your PI as your sponsor (in this case, this is a Harvard faculty PI [or in some cases, a non-faculty researcher with PI rights], not necessarily the person listed on an IRB or DUA). See How Do I Get a Research Computing Account for instructions if you do not yet have an account. If your Harvard PI does not exist, please direct them to this same page and the directions in the previous paragraph.

 

New Accounts

If you have an existing account or have already completed the following three steps, you can skip this section. But please note the FASSE VPN realm (@fasse) noted below. You must connect to this realm to access any FASSE resources.

Password Set

Once you have your FASRC account, you will receive an email with the same information as below, but step one is to set your password. This will be done using your email address and our password reset system.

[wpfa5s icon=”fa-link”] See our Password Reset documentation for instructions.

 

OpenAuth (two-factor)

To access FASSE and most FASRC services, including the FASRC VPN, you will need your personal FASRC OpenAuth two-factor (2FA) token. This can be set up on your smartphone using an app or downloaded as a Java applet to run on your desktop/laptop.

[wpfa5s icon=”fa-link”] See our OpenAuth documentation for setup instructions.

 

FASSE VPN

In order to access any secure system or environment in FASRC, you will need to connect to the FASRC VPN. The FASRC VPN is separate from other Harvard VPNs you may already be using.  To connect to a FASSE environment, you will connect to the FASRC VPN (vpn.rc.fas.harvard.edu) using the @fasse realm (ex. – jharvard@fasse), your FASRC password, and your OpenAuth 2FA code.

[wpfa5s icon=”fa-link”] See our VPN documentation for setup instructions.

 


Step 2: Request a FASSE Project

If you have completed the HRDSP process and you and your PI have FASRC accounts, you can proceed to fill out the

FASSE New Project Request Form (Harvard Key login required)

 


USING FASSE

Accessing the FASSE environment.

 

FASSE VPN

To connect to a FASSE environment, you will connect to the FASRC VPN (vpn.rc.fas.harvard.edu) using the @fasse realm (ex. – jharvard@fasse), your FASRC password, and your OpenAuth 2FA code.  If you’re used to using Cannon, note that the VPN realm, @fasse, is different from the @fasrc realm you’re used to using.

SLURM and Partitions

To manage the workload on the cluster we use SLURM. Partition is the term that Slurm uses for queues. Partitions can be thought of as a set of resources and parameters around their use.  You can use spart to find out what partitions you have access to. Following are the partitions available on the FASSE cluster.

To run jobs on the main cluster instead, please refer to Running Jobs (Cannon)

PartitionNumber of NodesCores per NodeCPU Core TypesMem per Node (GB)Time LimitMax JobsMax CoresMPI Suitable?GPU Capable?/scratch size (GB)
fasse4248Intel "Cascade Lake"1847 daysnonenoneyesNo68
fasse_bigmem1864Intel "Ice Lake"4997 daysnonenoneyesNo172
fasse_ultramem164Intel "Ice Lake"20007 daysnonenonenoNo396
fasse_gpu464Intel "Ice Lake"4877 daysnonenoneyesYes (4 A100/node)172
test548Intel "Cascade Lake"18412 hours596 coresyesNo68
remoteviz132Intel "Cascade Lake"3737 daysnonenonenoShared V100 GPUs for rendering396
serial_requeuevariesvariesIntelvaries7 daysnonenoneNoYesvaries
PI/Lab nodesvariesvariesvariesvariesnonenonenonevariesvariesvaries

Do not use salloc

Do not use salloc on FASSE.  Salloc is not available on FASSE for security reasons.  For interactive access, please use the FASSE VDI (see below).

Open OnDemand (OOD) Access

OpenOnDemand (OOD) or VDI (virtual desktop interface) is a virtual GUI interface that provides everything from pre-built apps to interactive command line access within a familiar desktop-like environment.

The FASSE OOD is available when connected to our @fasse VPN realm, through your web browser.  Please visit to access the service: https://fasseood.rc.fas.harvard.edu

See our FASSE VDI documentation for further information. FASSE VDI/OpenOnDemand

 

Command Line Access

Command-line access is also available for those who need/want to run jobs using a CLI. Login nodes for FASSE can be accessed by SSH at fasselogin.rc.fas.harvard.edu:

ssh jharvard@fasselogin.rc.fas.harvard.edu

Note that FASSE does not allow to run interactive jobs. Instead, you have to use OOD to run interactive jobs.

See our FASSE CLI documentation for further information. [Link Pending] 

Interim Documentation: See the very similar main cluster doc in the interim


FASSE FAQ

Please see STEP 0: HRDSP REQUIREMENTS at the top of this page. You must complete the Harvard HRDSP requirements before proceeding. If you do not have a FASRC account yet, you should also see: Account Signup

Level 3 and other sensitive files and data stored within the secure environment should never be transferred to storage on the FASRC main cluster or to outside storage which is not designed and approved to house secure data.

FASSE secure storage shares should be accessible via Globus to allow you to transfer your data.

Local Scratch on FASSE Nodes
Jobs on FASSE nodes should use /tmp for private temporary space. That space is accessible only by that job and not other jobs on the same node. We do not recommend using /scratch as any data there will be visible to any other job running on the same node.

Global Scratch
Global scratch is available at /n/holyscratch01 or using the $SCRATCH variable.

FASSE global scratch has the same 90-day retention policy. For policy details and more on the scratch variable, see: Scratch Policy

Each user has a home directory that is accessible only when logged into the secure FASSE environment. This home directory cannot be accessed on the main cluster. While you can also log into the main FASRC cluster, your FASSE home directory and project storage will not be accessible there as the main cluster is only rated for level 2 or lower data.
Users of the FASSE secure cluster can also log into the main FASRC cluster. This may be necessary for some users who also work with level 2 jobs or data with their lab on the main cluster. But bear in mind that these are two separate environments and data from FASSE cannot be transferred onto the level 2 FASRC Cannon cluster.

When logging into FASSE you will have a home directory that resides only on FASSE. When logging into the main cluster, you will find a different home directory. So bear this in mind if you do switch between the two.
Your lab directory on FASSE is accessible only when logged into the secure FASSE environment. Your lab directory cannot be accessed on the main cluster. While you can also log into the main FASRC cluster, your FASSE lab directory/project storage will not be accessible there as the main cluster is only rated for level 2 or lower data.

FASSE is a secure environment and, as such, does not allow direct access to the Internet.

Accessing the internet while connected to the FASSE VPN realm (@fasse) and from FASSE nodes is must be done through a network proxy.

This should be a global environment variable which is picked up by modern browsers, but some applications, including some command-line tools will require you to manually provide the proxy settings before they will be able to access the Internet.

NOTE: Our proxy does not allow all traffic, but should allow access to most things necessary for your work.

Command Line/Terminal
To manually set the proxy in your terminal environment, enter the following:
export http_proxy=http://rcproxy.rc.fas.harvard.edu:3128
export https_proxy=http://rcproxy.rc.fas.harvard.edu:3128

You can add these lines to your .bashrc if you find yourself needing to set this regularly.

 

Web Browsers
For web browsing, your browser should work if set to ‘Use system proxy settings’ / 'Auto-detect proxy’ (language may vary by browser). If this does not work automatically, you may need to manually add the proxies to your browser. You will need to disable this when not on the VPN.

HTTP Proxy: http://rcproxy.rc.fas.harvard.edu
Port: 3128

HTTPS Proxy: https://rcproxy.rc.fas.harvard.edu
Port: 3128

]]>
23798
Get a FASSE Account and Project Group https://docs.rc.fas.harvard.edu/kb/get-a-fasse-account-and-project-group/ Thu, 17 Mar 2022 19:10:11 +0000 https://docs.rc.fas.harvard.edu/?post_type=epkb_post_type_1&p=24827 Set up your account
  1. Get an FASRC account if you do not already have one
  2. Set or reset your FASRC password: https://portal.rc.fas.harvard.edu/p3/pwreset/
  3. Set up 2 factor authentication, which is also called 2FA: https://docs.rc.fas.harvard.edu/kb/openauth/
  4. Get your VPN working: https://docs.rc.fas.harvard.edu/kb/vpn-setup/
    1. You will not be able to log into the FASSE VPN until you are a member of a FASSE project group, but you can log into the general fasrc VPN realm following the above instructions.

Set up or join a project group

If you do not have a group for your project:

  1. Satisfy HRDSP application requirements
  2. Fill out the FASSE New Project Request Form

If you want to join an existing project group

  1. Navigate to the Add Grants page in portal
  2. Find the project group you want to be added to
  3. Select the checkbox for the project group you want to be added to
  4. Your PI will have to approve the addition.  Once you’re notified of the approval, it can take up to an hour for your permissions to be configured. If you’re not able to access the VPN or your home directory, try waiting an hour and logging in again.

Start using FASSE once your account and project group are configured

Getting started on FASSE

]]>
24827
FASSE Proxy Settings https://docs.rc.fas.harvard.edu/kb/proxy-settings/ Fri, 10 Aug 2018 11:42:00 +0000 https://www.rc.fas.harvard.edu/?page_id=18765 Using a proxy to reach the internet from FASSE cluster

If you are on FASSE or a VPN realm or server that is behind a firewall, there are times when you still need to reach the outside Internet. For example, you may need to install a condaStata, or R package. In that case, you will need to add a proxy setting to your environment.

Please note: Don’t set proxy on Cannon as it will back the internet. Our proxy does not allow all traffic, but should allow access to things necessary for your work.

Setting the proxy from the terminal

You can issue the following commands either manually each time you need access, or you can add them to your .bashrc so that the proxy is always configured when you log in or launch a new shell.

export http_proxy=http://rcproxy.rc.fas.harvard.edu:3128
export https_proxy=http://rcproxy.rc.fas.harvard.edu:3128

Setting the proxy for web browsing

For web browsing, your browser may work if set to ‘Use system proxy settings’ (Auto-detect proxy’ may also work). If this does not work automatically, you will need to manually add the proxies to your browser. You will need to disable this when not on the VPN.  Settings are as follows:

HTTP Proxy: http://rcproxy.rc.fas.harvard.edu
Port: 3128
HTTPS Proxy: http://rcproxy.rc.fas.harvard.edu
Port: 3128

The http:// is intentional for https_proxy. Your data are still encrypted between your web browser and the web server.

Also note that some applications only work if you give it the proxy address without the http://.  If your application is not working using the above definitions try: rcproxy.rc.fas.harvard.edu:3128

Setting proxy for sftp

For sftp you can add the ProxyCommand options like so (where username@example.com is the remote username and remote system you are connecting to) :

sftp -o ConnectTimeout=3 -o ProxyCommand='/usr/bin/nc --proxy rcproxy.rc.fas.harvard.edu:3128 %h %p' username@example.com

Setting the proxy for Stata

Stata sometimes loads libraries via http.  For security reasons, http access on FASSE must happen via a proxy.  Proxy access can be configured in Stata with the following commands:

set httpproxy on
set httpproxyhost rcproxy.rc.fas.harvard.edu
set httpproxyport 3128

Proxy settings appear to persist after Stata is closed, so it is recommended to issue the following command when exiting stata:

set httpproxy off

Setting the proxy for RStudio

Occasionally, Installing a package on RStudio may require HTTP. You can set http_proxy to allow this from FASSE.  This can be done for one time use from within R:

Sys.setenv(http_proxy="http://rcproxy.rc.fas.harvard.edu:3128")
Sys.setenv(https_proxy="http://rcproxy.rc.fas.harvard.edu:3128")

It can also be set permanently by placing this in ~/.renviron:

http_proxy="http://rcproxy.rc.fas.harvard.edu:3128"
https_proxy="http://rcproxy.rc.fas.harvard.edu:3128"

You can run these from inside R to check that the proxies are set:

Sys.getenv("http_proxy")
Sys.getenv("https_proxy")

To unset these variables run:

Sys.unsetenv("http_proxy")
Sys.unsetenv("https_proxy")

Setting the proxy for Jupyter Notebook

You can run these commands to set the proxies on FASSE:

import os
os.environ['http_proxy'] = "http://rcproxy.rc.fas.harvard.edu:3128"
os.environ['https_proxy'] = "https://rcproxy.rc.fas.harvard.edu:3128"

If you get the output  <Response [200]>, proxies are appropriately set:

import requests
requests.get("https://google.com")
<Response [200]>

The steps above can be seen in the screen shot:

FASSE_Jupyter_Notebook_Proxies

Setting the proxy for the Virtual Remote Desktop’s Firefox

When working from the virtual remote desktop in FASSE you will have to configure Firefox manually.  To configure a proxy in Firefox go to Preferences>General>Connection Settings and configure as follows:

Github

Cloning a repository from Github does not work using ssh. You have to use https. For example:

git clone https://github.com/fasrc/User_Codes.git

And not:

git clone git@github.com:fasrc/User_Codes.git
]]>
18765