Filesystems Details
Home Directory
The home area is both RAIDed and backed up nightly. The quota for the home area is set to 4GB.
Under no circumstances should large amount of data (>100MB) be transfered from the home area. All large data files must be located
on /lustre filesystem. Home area is provided for keeping the source
files and additional libraries, compiling executables, making plots,
etc. All analysis of large data files must be done on /lustre filesystem.
Scratch Directory
Each of the slave nodes has a 55GB (cc201 through cc624) or 750GB
(cc101-cc104, cc701 through cc724) local disk (/cosmos) that can be
used for storing the data during the execution of a batch job. This is
the fastest disk storage area available for batch jobs. An environment
variable COSMOS_DIR containing the value /cosmos/$PBS_JOBID is setup in each user's PBS job
environment.
All users should use this directory for storing their temporary
files. All contents of this directory will be automatically
deleted at the end of every user's job, so it is the
responsibility of a user to ensure the safe transfer of the data from
/cosmos area before the completion of the batch job.
Data Storage (Lustre)
The cluster has a main storage area mounted as /lustre. This area is
visible from all nodes, and can be used for direct reading/writing
from batch jobs.
Lustre is a software level that emulates a single very large disk
space over an array of (even heterogeneous) disks. New disks can
be added to Lustre completely transparently, without affecting the users. At
present, Lustre controls three disk arrays that are attached to
fulla, providing access to a continuous ~97TB of data storage. The quota for the Lustre filesystem is currently set at 12TB.
Note: Files in /lustre are not backed up and it is the user's responsibility to backup all their critical data.
|
