Proper handling of vhost deletions and ownership changes