Extended Monday maintenance, Starting already Sunday 15th of November 2015


Advanced search

Message boards : Server backend and mirrors : Extended Monday maintenance, Starting already Sunday 15th of November 2015

Author Message
Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4479
Credit: 2,094,806
RAC: 0
Message 14173 - Posted: 14 Nov 2015, 19:44:04 UTC

Like last week there will be some intermittent downtime as the raid that the BURP storage system uses is recovering from an unfortunate ~8TB of disk failures.
The last two big data-moving tasks require the site to be offline entirely for around 2-3 hours to rescale and migrate some of the core file systems.

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4479
Credit: 2,094,806
RAC: 0
Message 14174 - Posted: 17 Nov 2015, 7:28:56 UTC - in response to Message 14173.
Last modified: 17 Nov 2015, 7:29:27 UTC

for around 2-3 hours to rescale

Erhm, make that 2-3 days... woah resize2fs can be slow.
We didn't quite get there either, more work will have to be done next weekend. So far we're about two thirds of the way to full restoration.

snaok
Send message
Joined: 29 Oct 15
Posts: 5
Credit: 1,024
RAC: 0
Message 14175 - Posted: 18 Nov 2015, 19:18:33 UTC

Hi,

I just posted a project; I was unaware of the maintenance until after I posted. I am wondering if this will make the maintenance more difficult. I can repost the project when the maintenance is through.

Thanks,

snaok

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4479
Credit: 2,094,806
RAC: 0
Message 14176 - Posted: 18 Nov 2015, 19:58:05 UTC
Last modified: 18 Nov 2015, 19:59:46 UTC

Probably no problem, next maintenance window starts Friday afternoon (utc), we can sneak a session or two in there before that.

snaok
Send message
Joined: 29 Oct 15
Posts: 5
Credit: 1,024
RAC: 0
Message 14177 - Posted: 18 Nov 2015, 20:59:45 UTC - in response to Message 14176.

Ok, just checking.

snaok


Post to thread

Message boards : Server backend and mirrors : Extended Monday maintenance, Starting already Sunday 15th of November 2015