test

[hcoop/zz_old/ikiwiki] / AndrewFileSystem.mdwn

= Basic Architecture =\r
\r
Using the shared filesystem involves a combination of Kerberos and OpenAFS.\r
\r
= File conventions =\r
\r
The `/afs` tree contains shared filesystems.  `/afs/hcoop.net` (symlinked from `/afs/hcoop` as well) is our piece of the AFS-o-sphere.  Subdirectories include:\r
\r
 * `/afs/hcoop.net/user`, the home of home directories\r
 * `/afs/hcoop.net/user/U/US/$USERNAME`, `$USERNAME`'s home directory\r
 * `/afs/hcoop.net/common/etc`, the home of non-platform-specific fun stuff like DomTool\r
\r
= Connecting to AFS from an HCoop server =\r
\r
I found this handy summary of the commands that must be run:\r
  http://www.eos.ncsu.edu/remoteaccess/LinuxOpenAfs/kreset_debian/kreset\r
\r
On our servers, it seems sufficient to run:\r
{{{kinit\r
aklog}}}\r
\r
These should be run automatically if you log in normally, but admins who manually `kinit` to different users (for\r
the purpose of testing access permissions most often), need to of course run both `kinit; aklog` to completely\r
switch to a target user.\r
\r
= The kadmin shell =\r
\r
All Kerberos administration commands are run from a special shell, called Kadmin. There are two variants of Kadmin:\r
kadmin is the usual, remote version of the command which can be run on any machine; kadmin.local is the "local"\r
version which can only be ran on the AFS fileserver (deleuze).\r
\r
Invoke kadmin.local as `sudo kadmin.local -p YOURUSERNAME_admin`. It is good to include "-p YOURUSERNAME_admin", or\r
kadmin will "authenticate" as the first user it finds in the ticket cache, which may or may not be the username you\r
expected. All the administrative commands would work anyway (since you ran kadmin.local), but an incorrect principal\r
name would make various statistics incorrect (like name of principal who was adding/changing entries in the DB).\r
\r
To invoke kadmin, use `kadmin -p YOURUSERNAME_admin`. In normal course of action, kadmin asks for a password. This is\r
impractical for automated scripts. As usual, instead of a password, you can also pass a keytab file. Our keytabs are\r
saved in /etc/keytabs/ on each system, and they are readable by group 'wheel'. So administrators should be able\r
to invoke 'kadmin' (use control shell) or kinit/k5start (impersonate any user) by supplying target user's key from\r
a keytab, such as `kadmin -p domtool/deleuze -k -t /etc/keytabs/domtool.deleuze` .\r
\r
= Creating a new user =\r
\r
We follow the convention that Kerberos users for daemons are named `$DAEMON`, where `$DAEMON` is the name of the daemon (for instance, the name of system user it runs as, or the name of its `/etc/init.d` file). ''Some daemons\r
currently use DAEMON/HOST scheme, but this will be changed later and is not to be used for any new principals\r
you create''.\r
\r
To add the Kerberos principal for a daemon, run this in kadmin:{{{\r
addprinc -randkey -policy service $DAEMON}}}\r
\r
AFS users exist separately from Kerberos principals.  To add the AFS user for a daemon to which you want to assign UID `$UID`, run:{{{\r
pts createuser $DAEMON}}}\r
\r
"keytab" files smooth the way to running daemons that run with AFS privileges. An access-protected local file contains a user's credentials, and daemons read these files on starting up in order to authenticate.\r
\r
To create a keytab for a daemon, run this in kadmin:{{{\r
ktadd -k /etc/keytabs/$DAEMON -e "des3-hmac-sha1:normal rc4-hmac:normal" $DAEMON\r
chown $DAEMON:wheel /etc/keytabs/$DAEMON\r
chmod 440 /etc/keytabs/$DAEMON\r
}}}\r
\r
In the example above, only one key (of 4 or 5 created) is exported for a user. Sometimes it might be desirable to\r
only export a specific key into a keytab file, but we generally just omit the `-e KEY_TYPE` parameter and export\r
all keys to the keytab file.\r
\r
You can view keys stored in a keytab by doing `sudo klist -k /etc/keytabs/KEYTAB_FILE`.\r
\r
To make daemons properly kinit/aklog as the user you created for them, use ``k5start`` command. Many examples\r
of how to use it are already found in our /etc/init.d/ scripts. Important options include `-U` (which kinits as\r
the first principal found in the keytab file, without the need to explicitly name a principal), -f (which specifies\r
the keytab file to kinit from), and -K MINUTES (which re-news the ticket after MINUTES, so that daemons can run\r
for long periods of time).\r
\r
To give $DAEMON the actual permission in AFS space, for most common actions, `fs setacl DIR $DAEMON read` or `write` \r
are good. All subdirectories that get created within the toplevel directory for which you give permissions, will \r
inherit all the permissions.\r
\r
= Listing and setting quotas =\r
\r
To list volume quota, run{{{\r
fs lq DIR\r
}}}\r
\r
\r
To set volume quota in 1-kilobyte blocks, run{{{\r
fs sq DIR -max SIZE\r
}}}\r