Server downtime 2013-10-31


Advanced search

Message boards : Server backend and mirrors : Server downtime 2013-10-31

Author Message
Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4461
Credit: 2,094,806
RAC: 0
Message 12074 - Posted: 31 Oct 2013, 16:07:59 UTC
Last modified: 31 Oct 2013, 20:32:18 UTC

The main database server went down around 20:30 UTC last night due to a kernel issue and came back up at around 15:41 UTC today. We're jumping into diagnostics mode for a while to make sure that everything is fine before continuing the current renders. Expect more info to be posted here later.

[Edit: 16:10 UTC] Currently the raids are resyncing, next up is DB validation
[Edit: 20:31 UTC] Raid seems to be syncing fine. DB validation started

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4461
Credit: 2,094,806
RAC: 0
Message 12075 - Posted: 1 Nov 2013, 6:55:52 UTC - in response to Message 12074.

DB not completely ok, 4 workunits and around 10 results were in transit when the server crashed and had to be deleted. If you are the owner of one of these you will notice that the server has completely forgotten about you having them.

Apart from this it seems that things are looking good. Starting up the rendering queue again.


Post to thread

Message boards : Server backend and mirrors : Server downtime 2013-10-31