Difference between revisions of "Disk quotas"

From UCB Math Wiki
Jump to: navigation, search
(Initial creation)
 
Line 1: Line 1:
 
=Disk Quotas=
 
=Disk Quotas=
 
Standard quotas on the Math Network at this time are: 600 MB for faculty,
 
Standard quotas on the Math Network at this time are: 600 MB for faculty,
300 MB for graduate students and 150 MB for visitors' accounts.
+
450 MB for graduate students and 300 MB for visitors' accounts.
  
 
For the purposes of this web page, MB means 1024000 bytes.
 
For the purposes of this web page, MB means 1024000 bytes.
Line 58: Line 58:
 
The other program is '''du'''.  This will tell you your current disk usage.
 
The other program is '''du'''.  This will tell you your current disk usage.
 
In particular, the command
 
In particular, the command
du -skr ~
 
(on Solaris systems), or
 
 
  du -sk ~
 
  du -sk ~
(on Linux systems) will tell you how much space you are using in your
+
will tell you how much space you are using in your home directory.  At the
home directory. [Caution:  If you use symbolic links, you should be aware
 
that they take up space, but this is not accurately reflected in the
 
output of '''du''' under
 
Linux.  To get an answer that correctly indicates the space taken by symbolic
 
links, run '''du''' on a Solaris system.] At the
 
 
beginning of the day this should agree exactly with the output from
 
beginning of the day this should agree exactly with the output from
 
'''dqstatus'''
 
'''dqstatus'''
Line 73: Line 66:
 
'''du''' reflects the current situation while '''dqstatus''' is only updated
 
'''du''' reflects the current situation while '''dqstatus''' is only updated
 
once daily.  '''du''' is a standard Unix command; it has many other options
 
once daily.  '''du''' is a standard Unix command; it has many other options
which are described in the
+
which are described in the manual page for '''du'''.
[/cgi-bin/man.cgi?section=&program=du manual page for '''du'''].
+
 
 +
If you want to know what takes space in your current working directory, use
 +
the following command:
 +
du -sk .??* * | sort -rn | head
 +
The output will list up to ten largest files or directories including names
 +
beginning with "." (dot).

Revision as of 14:46, 7 November 2010

Disk Quotas

Standard quotas on the Math Network at this time are: 600 MB for faculty, 450 MB for graduate students and 300 MB for visitors' accounts.

For the purposes of this web page, MB means 1024000 bytes.

If your account is over this limit, you will be notified upon login and will be given 5 login opportunities to clean up and reduce your disk usage to an under-quota status.

Disk quotas are necessary on a system the size of Math in order to ensure that all users have sufficient disk space available to them.

To avoid further slowing down the file servers, the system currently in place determines each user's disk quota approximately once per day, in the early morning hours. If a user is over quota, then he or she is restricted to five logins until the quota system next determines that the user is within quota. When (or if) that occurs, the status is then cleared.

Thus, login restrictions are imposed or lifted in 24-hour units. This gives a slightly stronger incentive to stay within quotas. It is hoped that users who inadvertently exceed their disk quotas can bring themselves back under quota quickly, and can be fully productive with only a little additional planning to keep from logging in more than five times on that day.

Users who need additional disk space are required to submit a request to math@lscr.berkeley.edu with a careful explanation of what the excess disk space will be used for.

Notes

There are a few points which often lead to misunderstandings:

  • The disk usage is only determined once per day. Therefore, if one is flagged as being over quota, the login restrictions will remain in effect for the whole day, even if the user immediately deletes files to get back under quota. Conversely, users can go well beyond their quotas with impunity during the day, as long as they reduce their disk usage before the next run of the quota system. (This practice is not recommended, however--(a) one may forget to delete the files before the end of the day, and (b) if everybody does this then the problems with full file systems will recur.) The reason for running the quota program only once per day is that it involves ascertaining the ownership of every file on every disk. It is therefore too resource-intensive to be run more often.
  • Disk totals are computed by file ownership, not by whether they reside under your home directory. For most users this will not make any difference, but there are circumstances in which this may arise.
  • The ls command leaves out files and directories beginning with "." unless the -a option is used.

Quotas on Mail

The quotas described here are entirely separate from the 1GB quota on mail stored on the CalMail system. That is an entirely separate system, with different quota requirements.

(Prior to the conversion to CalMail, the math department disk quota system applied also to disk storage used by incoming mail, but that is no longer the case. The output of dqstatus still refers to the separate quota on incoming mail, but that comment is vestigial only.)

Determining Your Disk Usage

There are two programs to aid you in determining your disk usage.

First, there is the program dqstatus. This will print your quota, your disk usage as of the last time the quota system was run, and the number of logins you have left (if you are currently restricted). It may also happen that you have files located in places other than your home directory. These files or directories are also reported by dqstatus.

The other program is du. This will tell you your current disk usage. In particular, the command

du -sk ~

will tell you how much space you are using in your home directory. At the beginning of the day this should agree exactly with the output from dqstatus (unless there are files in your home directory that have somebody else as an owner). As the day goes on, however, the numbers will differ since du reflects the current situation while dqstatus is only updated once daily. du is a standard Unix command; it has many other options which are described in the manual page for du.

If you want to know what takes space in your current working directory, use the following command:

du -sk .??* * | sort -rn | head

The output will list up to ten largest files or directories including names beginning with "." (dot).