No new jobs for 24 hours
log in

Advanced search

Message boards : News : No new jobs for 24 hours

Author Message
Ant Chubb
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 18 Jul 12
Posts: 118
Credit: 1,019,875
RAC: 0
Message 270 - Posted: 5 Oct 2012, 11:03:14 UTC

We need to clear out the backlog that has accumulated in the validator, so we've stopped new jobs for a while. As soon as the server has caught up, we'll set new jobs going again. And early next week we'll purge the DB, so the server status should be back up and running again.

Thanks again for all your help and comments.
Ant

Conan
Avatar
Send message
Joined: 20 Jul 12
Posts: 31
Credit: 451,033
RAC: 0
Message 274 - Posted: 5 Oct 2012, 23:52:28 UTC

At the moment the Feeder is not running so we can't upload any of the work we currently have on our computers.
So when you allow work again you will get hit with a lot of uploaded work that will again need validating so may slow things down.

Conan
____________

Matthias Lehmkuhl
Send message
Joined: 5 Oct 12
Posts: 3
Credit: 247,068
RAC: 56
Message 277 - Posted: 7 Oct 2012, 11:42:30 UTC

Any progress info or status update possible?

____________
Matthias

Robert7NBI
Send message
Joined: 2 Oct 12
Posts: 10
Credit: 5,076,963
RAC: 0
Message 279 - Posted: 9 Oct 2012, 6:38:14 UTC

No new jobs, no uploads - any info?

Kevin
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 4 Feb 12
Posts: 147
Credit: 2,427,829
RAC: 0
Message 280 - Posted: 9 Oct 2012, 13:24:39 UTC

Hi Guys,
You should be able to upload any completed tasks. but there may be another delay while we purge the database. We hope to send out more tasks this evening (~20:00GMT) but db_purge has some catching up to do and may stress the server. If the DB server can handle it we will be back to normal, otherwise we will be delayed for a day or two. I'll keep you posted.
Thanks for your help!
Kevin

Dotsch
Avatar
Send message
Joined: 23 Sep 12
Posts: 2
Credit: 2,090
RAC: 0
Message 281 - Posted: 9 Oct 2012, 18:33:07 UTC - in response to Message 280.
Last modified: 9 Oct 2012, 18:34:46 UTC

I recommend you to setup the db_purge as a regular task on the BOINC server to keep the DB in a smaller and cleaner state. I had some heavy DB lockups and heavy IO waits on on our BOINC server in the testing phase without the purge.

Kevin
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 4 Feb 12
Posts: 147
Credit: 2,427,829
RAC: 0
Message 282 - Posted: 9 Oct 2012, 18:50:56 UTC

We're going to relaunch the work generator tomorrow. Until then we will be letting db_purge clear its backlog. We hope to rerun the work generator tomorrow afternoon (~14:00 GMT) and db_purge will be run as a regular task from now on.
Thanks for your feedback,
Kevin

Robert7NBI
Send message
Joined: 2 Oct 12
Posts: 10
Credit: 5,076,963
RAC: 0
Message 285 - Posted: 11 Oct 2012, 8:59:35 UTC

Every day I have more and more WUs in pending. It seems that you need a second validator. Many projects have two validators. This is a good solution.

Kevin
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 4 Feb 12
Posts: 147
Credit: 2,427,829
RAC: 0
Message 286 - Posted: 11 Oct 2012, 13:09:32 UTC

I've launched a second validator and paused the work_generator for a few hours. It will be a few days before db_purge catches up so things may be a bit slow until then.
Cheers,
Kevin

frankhagen
Send message
Joined: 15 Jul 12
Posts: 48
Credit: 400,146
RAC: 0
Message 287 - Posted: 11 Oct 2012, 14:43:11 UTC - in response to Message 286.

I've launched a second validator and paused the work_generator for a few hours. It will be a few days before db_purge catches up so things may be a bit slow until then.


you will not achieve a lot by that!


your problem is DB-speed, so 2 validators fighting each other for DB-access might even make things worse.

unless you either bundle jobs into WU's or get a much faster DB-server, you're toast.

Kevin
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 4 Feb 12
Posts: 147
Credit: 2,427,829
RAC: 0
Message 296 - Posted: 12 Oct 2012, 16:07:22 UTC

We're doing a cleanup of the database at the moment. We hope that this will be finished in a few hours and we will be back to normal shortly.
Thanks for you patience,
Kevin

Kevin
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 4 Feb 12
Posts: 147
Credit: 2,427,829
RAC: 0
Message 303 - Posted: 13 Oct 2012, 19:37:32 UTC
Last modified: 13 Oct 2012, 19:38:17 UTC

Ok, the database has now been cleaned up. You will notice that the server status page is now functional again. It is still a bit slow but it will speed up as more results are purged.

There is still a large backlog for the validators to process so we will wait until tomorrow to restart the work_generator.
Thanks again,
Kevin

Dotsch
Avatar
Send message
Joined: 23 Sep 12
Posts: 2
Credit: 2,090
RAC: 0
Message 304 - Posted: 13 Oct 2012, 19:59:46 UTC - in response to Message 303.

Ok, the database has now been cleaned up. You will notice that the server status page is now functional again. It is still a bit slow but it will speed up as more results are purged.

This is still an indicator for a high loaded DB, but will got better with a regurlar purge of the DB.
I had added a cron job which generates every 5 or 10 minutes a server status, and writes the output to a file (server_status.php) which the user views. This reduced also the load on the DB.

If you need some assistance in server, OS and DB tunning, feel free to contact me.

Kevin
Project administrator
Project developer
Project tester
Project scientist
Avatar
Send message
Joined: 4 Feb 12
Posts: 147
Credit: 2,427,829
RAC: 0
Message 305 - Posted: 14 Oct 2012, 13:04:16 UTC

Cheers Dotsch, I may PM you about the server_status modification you mentioned. I've started the work_generator again and I'll see how it goes over the next few days. The purge script is now much faster than before so hopefully the database will shrink significantly each day.
Kevin

Robert7NBI
Send message
Joined: 2 Oct 12
Posts: 10
Credit: 5,076,963
RAC: 0
Message 306 - Posted: 14 Oct 2012, 23:23:44 UTC

Something strange...

Now I have: 185 waiting for validation,

but server has only: 2 <workunits_waiting_for_validation>

Profile NATE1
Avatar
Send message
Joined: 4 Aug 12
Posts: 37
Credit: 1,065,899
RAC: 0
Message 307 - Posted: 14 Oct 2012, 23:48:41 UTC - in response to Message 306.

Something strange...

Now I have: 185 waiting for validation,

but server has only: 2 <workunits_waiting_for_validation>



my tasks show pending but it going up and down around high 70's low 80's.
it going up as I send back completed tasks, and as the validator get to them it goes down. hit refresh on your tasks page and you might see the pending change.
as far as the the server page. it still showing the upload/download as disabled

waldo
Send message
Joined: 31 Aug 12
Posts: 2
Credit: 382
RAC: 0
Message 344 - Posted: 21 Oct 2012, 22:19:44 UTC - in response to Message 307.

Please do not use web preferences for any of my projects....particularly fightmalaria@home and WCG. Just wipe/erase all web preferences please!!! It is causeing my pc to crash and also messes up the computations...I adjust these manually on the current p[c in use. I have tried to set things to 0...but it won't let me save. And i bet the web prefs overide what i tell the manager to do. Just please remove my web preferences for all projects. These were in place for a cpu grid i had going. But someone hacked my OC software and fried those pc's. So these settings are no longer relevent. And could end up frying another pc.

waldo
Send message
Joined: 31 Aug 12
Posts: 2
Credit: 382
RAC: 0
Message 345 - Posted: 21 Oct 2012, 22:20:59 UTC - in response to Message 344.

my names are muchpazsion@hotmail.com or pazsion thank you.

Message boards : News : No new jobs for 24 hours


Main page · Your account · Message boards


Copyright © 2017 Dr Anthony Chubb