57,634,517 WUs
log in

Advanced search

Message boards : News : 57,634,517 WUs

1 · 2 · 3 · 4 · Next
Author Message
Profile Ben
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 17 Nov 14
Posts: 316
Credit: 1
RAC: 0
Message 2310 - Posted: 12 May 2015, 10:08:38 UTC
Last modified: 12 May 2015, 10:38:31 UTC

Damn that's big :)

It "should" work. For now I just created 10,000 WUs, to test the estimation.

Profile Charles Dennett
Avatar
Send message
Joined: 18 Dec 14
Posts: 88
Credit: 3,342,826
RAC: 0
Message 2311 - Posted: 12 May 2015, 10:18:52 UTC

Something's wrong. Getting this in my boinc log file:

12-May-2015 06:12:05 [FiND@Home] Requesting new tasks for CPU
12-May-2015 06:12:16 [FiND@Home] Scheduler request completed: got 0 new tasks
12-May-2015 06:12:16 [FiND@Home] Server can't open log file (../log_findah/scheduler.log)
____________

Profile Ben
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 17 Nov 14
Posts: 316
Credit: 1
RAC: 0
Message 2312 - Posted: 12 May 2015, 10:35:39 UTC
Last modified: 12 May 2015, 10:37:11 UTC

My bad :/

I removed 110GB of log. Forgot to recreate the scheduler log.

Profile Charles Dennett
Avatar
Send message
Joined: 18 Dec 14
Posts: 88
Credit: 3,342,826
RAC: 0
Message 2313 - Posted: 12 May 2015, 10:40:21 UTC

That did it. I'm off and running!
____________

Profile Charles Dennett
Avatar
Send message
Joined: 18 Dec 14
Posts: 88
Credit: 3,342,826
RAC: 0
Message 2314 - Posted: 12 May 2015, 10:45:18 UTC
Last modified: 12 May 2015, 10:48:28 UTC

First tasks finishing and being reported back. Finishing in 2-3 minutes when the estimate is more like 12-30 minutes. So far they are all valid.
____________

Profile Charles Dennett
Avatar
Send message
Joined: 18 Dec 14
Posts: 88
Credit: 3,342,826
RAC: 0
Message 2315 - Posted: 12 May 2015, 10:52:15 UTC

As each completed task is reported back and a new one picked up, the estimates for the ones waiting is dropping significantly. Looks like they are zeroing in on the correct (or darn close to it) times. Looking good, I'd say.
____________

Profile Ben
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 17 Nov 14
Posts: 316
Credit: 1
RAC: 0
Message 2316 - Posted: 12 May 2015, 10:53:05 UTC - in response to Message 2314.

We need to have some long running task. Overestimate a short task is not bad, but underestimate a very long is not good.

Maxxina
Send message
Joined: 11 Dec 13
Posts: 22
Credit: 251,337
RAC: 0
Message 2317 - Posted: 13 May 2015, 8:45:19 UTC

You launched now small 2 run of 10 K units ?

Profile Ben
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 17 Nov 14
Posts: 316
Credit: 1
RAC: 0
Message 2318 - Posted: 13 May 2015, 8:48:29 UTC - in response to Message 2317.

Yes, it was a test for the estimator.

Maxxina
Send message
Joined: 11 Dec 13
Posts: 22
Credit: 251,337
RAC: 0
Message 2319 - Posted: 13 May 2015, 8:55:58 UTC

And now you opened a gates for good ?

Profile Ben
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 17 Nov 14
Posts: 316
Credit: 1
RAC: 0
Message 2320 - Posted: 13 May 2015, 9:25:46 UTC - in response to Message 2319.
Last modified: 13 May 2015, 9:26:19 UTC

Not yet :)

I don't want to generate 57M WU with a very bad estimation time. I need some feedback, if the estimation is good enough, the gates will be wide open.

Maxxina
Send message
Joined: 11 Dec 13
Posts: 22
Credit: 251,337
RAC: 0
Message 2321 - Posted: 13 May 2015, 10:00:12 UTC

5-20 minutes task so far for me . They show little more estimated time then they really needed. So atm so far so good .

By any chance, did you get option working, when we get to like Few K of jobs with the batch 57 Mil to do. that you will be able to send them to many people around so we dont lose MANY weeks again ?

Profile Ben
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 17 Nov 14
Posts: 316
Credit: 1
RAC: 0
Message 2322 - Posted: 13 May 2015, 10:27:35 UTC - in response to Message 2321.

I don't understand the question -_-

What option?

Maxxina
Send message
Joined: 11 Dec 13
Posts: 22
Credit: 251,337
RAC: 0
Message 2323 - Posted: 13 May 2015, 10:49:46 UTC

In previous WU . when there were like for example few hundred jobs left. Many people got like 30-40 jobs in queue and it was long time for them to crunch them. And they usually timed out on these. And rest of the people were waiting for them.

And you didnt have a option to resend these task again to people who had empty queue list.

Is there a chance for you now to do it with 1.02 version? ( or we gonna lose time with waiting on people again )

Profile Ben
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 17 Nov 14
Posts: 316
Credit: 1
RAC: 0
Message 2324 - Posted: 13 May 2015, 11:06:54 UTC - in response to Message 2323.

I was thinking of that, but I don't know how to do it. It's a BOINC thing, sending tasks, scheduling, etc... I was looking for a "cancel" trigger in the admin interface with no success.

Maxxina
Send message
Joined: 11 Dec 13
Posts: 22
Credit: 251,337
RAC: 0
Message 2325 - Posted: 13 May 2015, 11:16:30 UTC

So i guess same thing goes to possible way :

if you apply for work, that it would check the ammount of CPU you had and give the ammount of work on how many CPU you got right ?

Profile Ben
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 17 Nov 14
Posts: 316
Credit: 1
RAC: 0
Message 2327 - Posted: 13 May 2015, 11:40:50 UTC - in response to Message 2325.

I think it's a fixed number of WU that the server is sending to each client.

Profile Charles Dennett
Avatar
Send message
Joined: 18 Dec 14
Posts: 88
Credit: 3,342,826
RAC: 0
Message 2328 - Posted: 13 May 2015, 11:44:10 UTC

From watching my own systems, you get a maximum of 50 tasks per core. I say maximum because there are other factors such as how much work each individual chooses to have in their queue, combined with other projects and the weight they are given.
____________

Profile Ben
Project administrator
Project developer
Project tester
Project scientist
Send message
Joined: 17 Nov 14
Posts: 316
Credit: 1
RAC: 0
Message 2329 - Posted: 13 May 2015, 11:46:24 UTC - in response to Message 2328.

I set the max number of WU to send to 50.

Maxxina
Send message
Joined: 11 Dec 13
Posts: 22
Credit: 251,337
RAC: 0
Message 2331 - Posted: 13 May 2015, 11:58:05 UTC

50 ? ok, and you can adjust that to lower or bigger ammount any time you want ?

1 · 2 · 3 · 4 · Next

Message boards : News : 57,634,517 WUs


Main page · Your account · Message boards


Copyright © 2017 Dr Anthony Chubb