![]() In this section we will discuss the principal filesystems available on most of our systems and the intended use of each one along with some of its characteristics. ![]() Unlike your personal computer, our systems will typically have several storage spaces or filesystems and you should ensure that you are using the right space for the right task. More detailed output is available using the Diskusage Explorer tool. Below is a typical output of this utility: To use this utility, log into the cluster using SSH, at the command prompt type diskusage_report, and press the Enter key. For users with a single active sponsored role, it is the default project of your sponsor while users with more than one active sponsored role will have a default project that corresponds to the default project of the faculty member with the most sponsored accounts.Īll users can check the available disk space and the current disk utilization for the project, home and scratch filesystems with the command line utility diskusage_report, available on our clusters. In the folder projects within their home directory, each user has a link to each of the projects they have access to. A given individual may thus have access to several different project spaces, associated with one or more faculty members, with symbolic links to these different project spaces in the directory projects of your home. This group may consist of those individuals with an account sponsored by a particular faculty member or members of an RAC allocation. While your home and scratch spaces are unique to you as an individual user, the project space is shared by a research group. Note that these symbolic links may appear up to a few hours after you first connect to the cluster. It will contain references to your scratch and project spaces through the mechanism of a symbolic link, a kind of shortcut that allows easy access to these other filesystems from your home directory. When your account is created on a cluster, your home directory will not be entirely empty. Note that our storage systems are not for personal use and should only be used to store research data. Moving significant amounts of data between your workstation and one of our systems or between two of our systems should generally be done using Globus. It is also your responsibility to manage the age of your stored data: most of the filesystems are not intended to provide an indefinite archiving service so when a given file or directory is no longer needed, you need to move it to a more appropriate filesystem which may well mean your personal workstation or some other storage system under your control. A better approach is to use commands like tar or zip to convert a directory containing many small files into a single very large archive file. You should therefore avoid storing tens of thousands of small files, where small means less than a few megabytes, particularly in the same directory. These filesystems are also designed to store a limited number of very large files, which are typically binary since very large (hundreds of MB or more) text files lose most of their interest in being readable by humans. In most cases the filesystems on our systems are a shared resource and for this reason should be used responsibly because unwise behaviour can negatively affect dozens or hundreds of other users. ![]() ![]() These storage solutions range from high-speed temporary local storage to different kinds of long-term storage, so you can choose the storage medium that best corresponds to your needs and usage patterns. We provide a wide range of storage options to cover the needs of our very diverse users.
0 Comments
Leave a Reply. |
AuthorWrite something about yourself. No need to be fancy, just an overview. ArchivesCategories |