Power Outage
log in

Advanced search

Message boards : News : Power Outage

Author Message
Kevin
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 4 Feb 12
Posts: 147
Credit: 2,427,829
RAC: 0
Message 1105 - Posted: 11 Nov 2013, 11:02:54 UTC

Hi Guys,
We had a power outage over the weekend. The server is back up now and we should be up and running with new WUs in the next 30 mins.
Thanks,
Kevin

Profile Brian S. Wilson
Avatar
Send message
Joined: 30 Nov 12
Posts: 19
Credit: 53,707
RAC: 0
Message 1106 - Posted: 11 Nov 2013, 11:25:26 UTC

Any chance a notice could be sent out on issues like this?

RNR
Send message
Joined: 12 Apr 13
Posts: 58
Credit: 1,961,436
RAC: 0
Message 1107 - Posted: 11 Nov 2013, 12:22:46 UTC

Too bad about the power outage. We're ready for more WUs when you are.

mikey
Avatar
Send message
Joined: 21 Jul 13
Posts: 68
Credit: 1,289,610
RAC: 836
Message 1108 - Posted: 11 Nov 2013, 12:29:39 UTC - in response to Message 1106.

Any chance a notice could be sent out on issues like this?


That sorta depends on what goes down, if the Server running the webpage goes down then where would they post something?

Kevin
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 4 Feb 12
Posts: 147
Credit: 2,427,829
RAC: 0
Message 1109 - Posted: 11 Nov 2013, 18:02:41 UTC
Last modified: 11 Nov 2013, 18:14:27 UTC

The power outage brought everything down. Our servers rebooted immediately but the network didn't return until this morning and as a result we were unreachable.

We are back running again now but I have disabled the work generator to allow the assimilator to catch up. If the assmililator makes good progress within the next hour, I will restart it for the night. As long as the queue is shrinking, I don't mind adding more WUs while we have a long queue. It's starting to go down quite quickly now.
Cheers,
Kevin

Profile Mankka*
Send message
Joined: 7 Feb 13
Posts: 1
Credit: 1,009,650
RAC: 0
Message 1110 - Posted: 11 Nov 2013, 18:12:45 UTC - in response to Message 1109.

Thanks for the information Kevin, we will be ready =)

Kevin
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 4 Feb 12
Posts: 147
Credit: 2,427,829
RAC: 0
Message 1112 - Posted: 12 Nov 2013, 17:26:49 UTC

Hi Guys,
The assimilator queue has grown significantly overnight. I've added a new assimilator to try and speed things up, but I've had to turn off the work generator while I wait to see if this fix works. Hopefully I will have it back online in the next two hours.

BTW we have completed 1,215,437 dockings in the last 24 hours with an error rate (failed tasks or no reply) of ~0.25%. Well done everyone!
Thanks,
Kev

RNR
Send message
Joined: 12 Apr 13
Posts: 58
Credit: 1,961,436
RAC: 0
Message 1115 - Posted: 13 Nov 2013, 11:30:34 UTC - in response to Message 1112.

Congrats on the sheer volume going through! The WU generator is treading water trying to keep up, lol.

Message boards : News : Power Outage


Main page · Your account · Message boards


Copyright © 2017 Dr Anthony Chubb