(server-buffer-done): Avoid changing the buffer when deleting the