clinton/scripts.git
15 years agohcoop-backup: Directory itself must be owner-writable.
mwolson_admin [Wed, 3 Sep 2008 07:54:13 +0000 (03:54 -0400)]
hcoop-backup: Directory itself must be owner-writable.

Otherwise it can't be deleted.

15 years agohcoop-backup: Update file permissions after run.
mwolson_admin [Tue, 2 Sep 2008 14:39:39 +0000 (10:39 -0400)]
hcoop-backup: Update file permissions after run.

15 years agohcoop-backup: Move logging to backup-wrapper, use UTC date.
mwolson_admin [Tue, 2 Sep 2008 02:18:35 +0000 (22:18 -0400)]
hcoop-backup: Move logging to backup-wrapper, use UTC date.

15 years agohcoop-backup: Update log location.
mwolson_admin [Tue, 2 Sep 2008 02:15:24 +0000 (22:15 -0400)]
hcoop-backup: Update log location.

15 years agoInitial attempt at rsync.net backup solution.
mwolson_admin [Tue, 2 Sep 2008 02:12:07 +0000 (22:12 -0400)]
Initial attempt at rsync.net backup solution.

15 years agoChange by someone else.
mwolson_admin [Tue, 2 Sep 2008 01:36:50 +0000 (21:36 -0400)]
Change by someone else.

15 years agoimport-list: Recreate exim mailmandb if domain changed.
mwolson_admin [Thu, 28 Aug 2008 02:53:25 +0000 (22:53 -0400)]
import-list: Recreate exim mailmandb if domain changed.

15 years agoimport-list: Add --domain option, check for root user.
mwolson_admin [Thu, 28 Aug 2008 02:50:45 +0000 (22:50 -0400)]
import-list: Add --domain option, check for root user.

15 years agoInitial version of import list script.
mwolson_admin [Thu, 28 Aug 2008 02:36:40 +0000 (22:36 -0400)]
Initial version of import list script.

15 years agoMiscellaneous accumulated scripts that were never checked in before.
mwolson_admin [Thu, 28 Aug 2008 02:35:23 +0000 (22:35 -0400)]
Miscellaneous accumulated scripts that were never checked in before.

15 years agoUpdate of member freeze logic from docelic.
mwolson_admin [Thu, 28 Aug 2008 02:33:54 +0000 (22:33 -0400)]
Update of member freeze logic from docelic.

15 years agoRemove S3 stuff.
mwolson_admin [Thu, 28 Aug 2008 02:32:19 +0000 (22:32 -0400)]
Remove S3 stuff.

15 years agoAdd freeze, frozen_shell, hcoop-kprop.
mwolson_admin [Thu, 17 Jul 2008 14:53:55 +0000 (10:53 -0400)]
Add freeze, frozen_shell, hcoop-kprop.

15 years agos3: Wait longer after failure, pick up any failed pieces later.
mwolson_admin [Thu, 17 Jul 2008 14:53:32 +0000 (10:53 -0400)]
s3: Wait longer after failure, pick up any failed pieces later.

15 years agos3: Use better retry logic.
mwolson_admin [Mon, 30 Jun 2008 18:51:12 +0000 (14:51 -0400)]
s3: Use better retry logic.

15 years agohcoop-backup: Don't complain about /opt directory.
mwolson_admin [Fri, 27 Jun 2008 14:35:13 +0000 (10:35 -0400)]
hcoop-backup: Don't complain about /opt directory.

15 years agohcoop-backup: On second thought, put -e back on bash subprocess.
mwolson_admin [Fri, 27 Jun 2008 14:32:55 +0000 (10:32 -0400)]
hcoop-backup: On second thought, put -e back on bash subprocess.

But ignore any errors that it produces, so that we have a better chance
of getting to the last database dump.  The first backup run did not get
to that point, for some reason.

15 years agohcoop-backup: Clean up messages, remove -e on bash subprocess.
mwolson_admin [Fri, 27 Jun 2008 14:28:43 +0000 (10:28 -0400)]
hcoop-backup: Clean up messages, remove -e on bash subprocess.

15 years agohcoop-backup: Put temp output in hcoop-backup, not hcoop-backup-testing.
mwolson_admin [Fri, 27 Jun 2008 14:21:39 +0000 (10:21 -0400)]
hcoop-backup: Put temp output in hcoop-backup, not hcoop-backup-testing.

15 years agos3: Display additional messages, sleep before retrying.
mwolson_admin [Fri, 27 Jun 2008 14:10:36 +0000 (10:10 -0400)]
s3: Display additional messages, sleep before retrying.

15 years agohcoop-backup: Try to make xargs die if an error occurred.
mwolson_admin [Wed, 25 Jun 2008 22:42:16 +0000 (18:42 -0400)]
hcoop-backup: Try to make xargs die if an error occurred.

15 years agos3: Try 3 times on a file before giving up.
mwolson_admin [Wed, 25 Jun 2008 22:37:28 +0000 (18:37 -0400)]
s3: Try 3 times on a file before giving up.

15 years agos3: Parameterize curl command.
mwolson_admin [Wed, 25 Jun 2008 21:44:40 +0000 (17:44 -0400)]
s3: Parameterize curl command.

15 years agos3.common: Get rid of third argument to move_over.
mwolson_admin [Wed, 25 Jun 2008 16:25:53 +0000 (12:25 -0400)]
s3.common: Get rid of third argument to move_over.

15 years agohcoop-backup: Keep track of date.
mwolson_admin [Wed, 25 Jun 2008 08:15:45 +0000 (04:15 -0400)]
hcoop-backup: Keep track of date.

 - Also, locase the local variable names.

15 years agohcoop-backup: Take file from stdin and split it.
mwolson_admin [Wed, 25 Jun 2008 08:01:39 +0000 (04:01 -0400)]
hcoop-backup: Take file from stdin and split it.

This avoids taking up double-space for each backed up file in the
temporary area.

15 years agoMore backup script revamp.
mwolson_admin [Wed, 25 Jun 2008 07:11:13 +0000 (03:11 -0400)]
More backup script revamp.

 - Split common s3-specific functions into s3.comon.

 - Make new simple script s3-move to move a single file over to S3.

 - Replace uses of copy_over with $MOVE_OVER.

 - Replace one use of catsync in an xargs command to use $MOVE_OVER
   instead.

15 years agohcoop-backup: Fix typo in comment.
mwolson_admin [Wed, 25 Jun 2008 06:36:24 +0000 (02:36 -0400)]
hcoop-backup: Fix typo in comment.

15 years agohcoop-backup: More work.
mwolson_admin [Wed, 25 Jun 2008 06:35:55 +0000 (02:35 -0400)]
hcoop-backup: More work.

 - Split files at ~5GB before transferring, due to Amazon S3 limitations.

 - Make s3_cmd easier to use.

 - Temporarily comment out backup pruning.

15 years agos3: Fix typos.
mwolson_admin [Wed, 25 Jun 2008 04:59:34 +0000 (00:59 -0400)]
s3: Fix typos.

15 years agohcoop-backup: Implement copy_over.
mwolson_admin [Wed, 25 Jun 2008 04:41:24 +0000 (00:41 -0400)]
hcoop-backup: Implement copy_over.

15 years agos3: Implement bandwidth limit.
mwolson_admin [Wed, 25 Jun 2008 04:25:54 +0000 (00:25 -0400)]
s3: Implement bandwidth limit.

15 years agos3: Make location of hmac script a constant.
mwolson_admin [Wed, 25 Jun 2008 04:08:00 +0000 (00:08 -0400)]
s3: Make location of hmac script a constant.

15 years agoRampantly initial checkin of progress on backup scripts.
mwolson_admin [Mon, 23 Jun 2008 04:45:47 +0000 (00:45 -0400)]
Rampantly initial checkin of progress on backup scripts.

15 years agoInitial version of other 3rd-party s3 bash script.
mwolson_admin [Mon, 23 Jun 2008 04:40:28 +0000 (00:40 -0400)]
Initial version of other 3rd-party s3 bash script.

15 years agoRemove s3-bash scripts, because they don't have ls.
mwolson_admin [Mon, 23 Jun 2008 04:38:14 +0000 (00:38 -0400)]
Remove s3-bash scripts, because they don't have ls.

15 years agos3-put: Implement bandwidth limit via -b argument.
mwolson_admin [Sun, 22 Jun 2008 23:57:51 +0000 (19:57 -0400)]
s3-put: Implement bandwidth limit via -b argument.

15 years agoInitial check-in of Amazon S3 helper scripts.
mwolson_admin [Sun, 22 Jun 2008 23:42:09 +0000 (19:42 -0400)]
Initial check-in of Amazon S3 helper scripts.

15 years agohcoop-git-maint: Fix URL.
mwolson_admin [Sun, 22 Jun 2008 16:30:22 +0000 (12:30 -0400)]
hcoop-git-maint: Fix URL.

15 years agohcoop-git-maint: New script to do periodic git maintenance.
mwolson_admin [Sun, 22 Jun 2008 05:08:05 +0000 (01:08 -0400)]
hcoop-git-maint: New script to do periodic git maintenance.

15 years agohcoop-backup: Only keep 2 backup runs lying around.
mwolson_admin [Thu, 5 Jun 2008 00:54:15 +0000 (20:54 -0400)]
hcoop-backup: Only keep 2 backup runs lying around.

15 years agolistnew: Fix typo.
mwolson_admin [Tue, 27 May 2008 04:56:34 +0000 (00:56 -0400)]
listnew: Fix typo.

15 years agoca-sign: Add instructions for generating CA key and cert to header.
mwolson_admin [Wed, 14 May 2008 21:54:54 +0000 (17:54 -0400)]
ca-sign: Add instructions for generating CA key and cert to header.

15 years agoca-sign: Mention in header that this needs to be run as an admin on deleuze.
root [Wed, 14 May 2008 21:46:38 +0000 (17:46 -0400)]
ca-sign: Mention in header that this needs to be run as an admin on deleuze.

15 years agoMake sure that listnew is run as root.
mwolson_admin [Tue, 6 May 2008 14:26:58 +0000 (10:26 -0400)]
Make sure that listnew is run as root.

16 years agoca-sign: Various improvements.
mwolson_admin [Mon, 7 Apr 2008 00:57:13 +0000 (20:57 -0400)]
ca-sign: Various improvements.

16 years agoca-sign: Verify cert request before acting on it.
mwolson_admin [Tue, 1 Apr 2008 06:44:35 +0000 (02:44 -0400)]
ca-sign: Verify cert request before acting on it.

16 years agoca-install: Mention that validation is done.
mwolson_admin [Tue, 1 Apr 2008 05:34:05 +0000 (01:34 -0400)]
ca-install: Mention that validation is done.

16 years agoca-sign: Add usage statement and more thorough param-checking
mwolson_admin [Tue, 1 Apr 2008 05:10:49 +0000 (01:10 -0400)]
ca-sign: Add usage statement and more thorough param-checking

16 years agoca-install: Add verification of cert and overhaul
mwolson_admin [Tue, 1 Apr 2008 05:08:42 +0000 (01:08 -0400)]
ca-install: Add verification of cert and overhaul

16 years agohcoop-clean-tmp: New script to clean /tmp.
mwolson_admin [Mon, 31 Mar 2008 01:27:58 +0000 (21:27 -0400)]
hcoop-clean-tmp: New script to clean /tmp.

16 years agomake-account-for-fyodor-user: Professionalize
mwolson_admin [Mon, 31 Mar 2008 01:25:54 +0000 (21:25 -0400)]
make-account-for-fyodor-user: Professionalize

16 years agocreate-user: Move vos release common.databases later
mwolson_admin [Mon, 31 Mar 2008 01:24:42 +0000 (21:24 -0400)]
create-user: Move vos release common.databases later

16 years agochange-user-password: Disable debug output
mwolson_admin [Mon, 31 Mar 2008 01:23:47 +0000 (21:23 -0400)]
change-user-password: Disable debug output

16 years agoMerge branch 'master' of ssh://mire.hcoop.net/home/mwolson_admin/hcoop-git/misc
mwolson_admin [Thu, 13 Mar 2008 01:59:05 +0000 (21:59 -0400)]
Merge branch 'master' of ssh://mire.hcoop.net/home/mwolson_admin/hcoop-git/misc

16 years agoapache-sync-logs: Use sudo rather than su to protect against user .bashrc.
mwolson_admin [Thu, 13 Mar 2008 01:56:16 +0000 (21:56 -0400)]
apache-sync-logs: Use sudo rather than su to protect against user .bashrc.

16 years agoapache-sync-logs: Don't email admins if user removes their log dir.
mwolson_admin [Thu, 13 Mar 2008 01:55:15 +0000 (21:55 -0400)]
apache-sync-logs: Don't email admins if user removes their log dir.

16 years agohcoop-backup: Make deletion of old backups work.
mwolson_admin [Sun, 17 Feb 2008 23:52:30 +0000 (18:52 -0500)]
hcoop-backup: Make deletion of old backups work.

16 years agocreate-user: Mention wiki.hcoop.net instead of wiki2.hcoop.net.
mwolson_admin [Fri, 15 Feb 2008 05:29:18 +0000 (00:29 -0500)]
create-user: Mention wiki.hcoop.net instead of wiki2.hcoop.net.

16 years agodestroy-user: Handle missing param, fix /old/ removal
mwolson_admin [Fri, 15 Feb 2008 00:51:08 +0000 (19:51 -0500)]
destroy-user: Handle missing param, fix /old/ removal

16 years agohcoop-backup: Delete backups older than 10 days.
mwolson_admin [Tue, 12 Feb 2008 14:16:44 +0000 (09:16 -0500)]
hcoop-backup: Delete backups older than 10 days.

16 years agohcoop-backup: Ignore another annoying file
mwolson_admin [Tue, 12 Feb 2008 14:09:22 +0000 (09:09 -0500)]
hcoop-backup: Ignore another annoying file

16 years agohcoop-backup: Throttle at 2.6Mbps.
mwolson_admin [Sat, 9 Feb 2008 05:12:09 +0000 (00:12 -0500)]
hcoop-backup: Throttle at 2.6Mbps.

16 years agohcoop-backup: Tidy up some UUOC.
mwolson_admin [Sat, 9 Feb 2008 05:08:41 +0000 (00:08 -0500)]
hcoop-backup: Tidy up some UUOC.

16 years agohcoop-backup: Fix deletion to only cover old directories, not files.
mwolson_admin [Sun, 3 Feb 2008 06:38:12 +0000 (01:38 -0500)]
hcoop-backup: Fix deletion to only cover old directories, not files.

16 years agohcoop-backup: Overhaul for bandwidth limiting.
mwolson_admin [Sat, 2 Feb 2008 19:20:31 +0000 (14:20 -0500)]
hcoop-backup: Overhaul for bandwidth limiting.

* scripts/hcoop-backup: (BWLIMIT): New var indicating KB/s bandwidth
  limiting to enforce.
  (BACKUPTMP): Place backups here individually on local disk before
  transferring offsite.  Make this the current directory rather than the
  offsite AFS directory.
  (copy_over): New convenience function that copies a file from the local
  backup location to the offsite location, removing the original.
  (complain): Make complaint email come from "The Backup Program".

16 years agohcoop-backup: Back up spamd directory specially.
mwolson_admin [Mon, 28 Jan 2008 07:24:48 +0000 (02:24 -0500)]
hcoop-backup: Back up spamd directory specially.

16 years agoTry not backing up spamd data, in case that pushes us over the edge.
mwolson_admin [Sun, 27 Jan 2008 06:52:48 +0000 (01:52 -0500)]
Try not backing up spamd data, in case that pushes us over the edge.

16 years agoKeep two days of backups (change by megacz)
mwolson_admin [Sun, 27 Jan 2008 06:50:51 +0000 (01:50 -0500)]
Keep two days of backups (change by megacz)

16 years agohcoop-backup: Deal with /usr/bin/*.notslocate files.
mwolson_admin [Tue, 15 Jan 2008 00:05:28 +0000 (19:05 -0500)]
hcoop-backup: Deal with /usr/bin/*.notslocate files.

16 years agoSync hcoop-backup changes from megacz
mwolson_admin [Mon, 14 Jan 2008 22:01:59 +0000 (17:01 -0500)]
Sync hcoop-backup changes from megacz

16 years agohcoop-backup: Sync changes from megacz, add IFS lines
mwolson_admin [Thu, 27 Dec 2007 04:16:21 +0000 (23:16 -0500)]
hcoop-backup: Sync changes from megacz, add IFS lines

This should fix the weird "1.png" entries in the email that the script
sends out.

16 years agoapache-sync-logs: Skip people who have unreadable log subdirectories.
mwolson_admin [Tue, 18 Dec 2007 21:31:42 +0000 (16:31 -0500)]
apache-sync-logs: Skip people who have unreadable log subdirectories.

16 years agoapache-sync-logs: Skip people who do not have keytabs
mwolson_admin [Tue, 18 Dec 2007 18:56:04 +0000 (13:56 -0500)]
apache-sync-logs: Skip people who do not have keytabs

16 years agocreate-user: Make .domtool symlink with correct ownership
mwolson_admin [Wed, 12 Dec 2007 17:24:56 +0000 (12:24 -0500)]
create-user: Make .domtool symlink with correct ownership

Apparently, it is not possible to change the ownership of a symlink that
is in AFS.  Presumably, that information is not paid attention to.  It
might just be for cosmetics that we do this.

I'm leaving the existing symlinks in user directories alone, because I'd
basically have to remove the symlink and make a new one, and I'd rather
not disrupt service.

16 years agonew-user: Expand ~$USERNM correctly
mwolson_admin [Wed, 12 Dec 2007 17:19:09 +0000 (12:19 -0500)]
new-user: Expand ~$USERNM correctly

16 years agonew-user: chown the .forward file after creating it.
mwolson_admin [Wed, 12 Dec 2007 06:37:08 +0000 (01:37 -0500)]
new-user: chown the .forward file after creating it.

Otherwise, Exim will refuse to recognize it.

16 years agoSync new-user fix from common area
mwolson_admin [Wed, 12 Dec 2007 06:30:58 +0000 (01:30 -0500)]
Sync new-user fix from common area

16 years agocreate-user: Own .domtool symlink, and own Maildir/(cur,new,tmp)
mwolson_admin [Sun, 9 Dec 2007 01:01:37 +0000 (20:01 -0500)]
create-user: Own .domtool symlink, and own Maildir/(cur,new,tmp)

16 years agocreate-user: Send nice introductory email, remove commented-out cruft
mwolson_admin [Sun, 9 Dec 2007 00:38:05 +0000 (19:38 -0500)]
create-user: Send nice introductory email, remove commented-out cruft

16 years agolistnew: Check arguments, handle new list_url argument, name parameters, add usage
mwolson_admin [Sat, 8 Dec 2007 23:27:08 +0000 (18:27 -0500)]
listnew: Check arguments, handle new list_url argument, name parameters, add usage

16 years agomailman-update-exim-db: Allow extras file and permit multiple domains per listname
mwolson_admin [Sat, 8 Dec 2007 06:14:15 +0000 (01:14 -0500)]
mailman-update-exim-db: Allow extras file and permit multiple domains per listname

16 years agoWhen making a new list, set web interface to be https://lists.hcoop.net by default.
mwolson_admin [Tue, 4 Dec 2007 01:54:15 +0000 (20:54 -0500)]
When making a new list, set web interface to be https://lists.hcoop.net by default.

16 years agoImplement adding and removing of members from mailing lists
mwolson_admin [Mon, 3 Dec 2007 02:02:01 +0000 (21:02 -0500)]
Implement adding and removing of members from mailing lists

16 years agoAdd docelic's new-user script
mwolson_admin [Mon, 3 Dec 2007 01:46:03 +0000 (20:46 -0500)]
Add docelic's new-user script

16 years agoUpdate mailman defs right away in listnew
mwolson_admin [Thu, 29 Nov 2007 21:50:09 +0000 (16:50 -0500)]
Update mailman defs right away in listnew

16 years agoAdd listnew script
mwolson_admin [Thu, 29 Nov 2007 21:40:28 +0000 (16:40 -0500)]
Add listnew script

16 years agoca-sign: Tell clients using our CA cert to update CRL every 30 days
mwolson_admin [Tue, 20 Nov 2007 21:37:12 +0000 (16:37 -0500)]
ca-sign: Tell clients using our CA cert to update CRL every 30 days

16 years agoapache-sync-logs: Skip empty source directories
mwolson_admin [Mon, 19 Nov 2007 02:21:11 +0000 (21:21 -0500)]
apache-sync-logs: Skip empty source directories

16 years agoNo need to back up .rand files in /usr/lib/courier/
mwolson_admin [Sun, 18 Nov 2007 17:15:01 +0000 (12:15 -0500)]
No need to back up .rand files in /usr/lib/courier/

16 years agoca-install, ca-sign: New scripts to sign and install user certs
mwolson_admin [Sun, 18 Nov 2007 01:03:09 +0000 (20:03 -0500)]
ca-install, ca-sign: New scripts to sign and install user certs

16 years agohcoop-backup: deal with perldoc.stub
mwolson_admin [Thu, 15 Nov 2007 14:22:57 +0000 (09:22 -0500)]
hcoop-backup: deal with perldoc.stub

 - Don't back up perldoc.stub
 - Match period in ,pyc and .elc files
 - Escape period in .modutils

16 years agomailman-update-exim-db: Fix typo, mention that it has to run as root
mwolson_admin [Thu, 15 Nov 2007 00:23:42 +0000 (19:23 -0500)]
mailman-update-exim-db: Fix typo, mention that it has to run as root

16 years agomailman-update-exim-db: New script that builds a Mailman lookup table for Exim
mwolson_admin [Wed, 14 Nov 2007 22:46:33 +0000 (17:46 -0500)]
mailman-update-exim-db: New script that builds a Mailman lookup table for Exim

16 years agoMake bin directory for user-executable stuff
mwolson_admin [Wed, 14 Nov 2007 22:19:07 +0000 (17:19 -0500)]
Make bin directory for user-executable stuff

Move run-in-pagsh there, and add frak and fsr

16 years agorun-in-pagsh: Figure out what user we're running as
mwolson_admin [Wed, 14 Nov 2007 03:38:56 +0000 (22:38 -0500)]
run-in-pagsh: Figure out what user we're running as

Cron can be stupid sometimes and set LOGNAME, but not USER.

16 years agorun-in-pagsh improvements
mwolson_admin [Tue, 13 Nov 2007 23:11:40 +0000 (18:11 -0500)]
run-in-pagsh improvements

 - Take --fg argument, which tells run-in-pagsh that we are running the
   command in the foreground, and should clean up k5start's PID file.
 - Send kill errors to /dev/null.

16 years agoFix gitweb stuff: needed sudo in front
mwolson_admin [Mon, 5 Nov 2007 21:00:53 +0000 (16:00 -0500)]
Fix gitweb stuff: needed sudo in front

16 years agocvsimport
mwolson_admin [Mon, 5 Nov 2007 20:56:32 +0000 (15:56 -0500)]
cvsimport

Conflicts:

scripts/create-user

16 years agorevert commands that are choking
megacz [Mon, 29 Oct 2007 06:09:12 +0000 (06:09 +0000)]
revert commands that are choking