Estimated runtime, credits,.........

Message boards : Number crunching : Estimated runtime, credits,.........
Message board moderation

To post messages, you must log in.

AuthorMessage
marsinph

Send message
Joined: 13 Apr 18
Posts: 13
Credit: 33,921
RAC: 0
Message 15405 - Posted: 26 Jul 2018, 15:58:04 UTC

Hello,
Please check WU https://burp.renderfarming.net/workunit.php?wuid=3286086
The properties return about 10,000GFops to complete.
My host running this task (https://burp.renderfarming.net/show_host_detail.php?hostid=81394)
Have a power of 4 GFLOP/s and 13,000 Integer/sec
So normally the WU need to be finished after 2500 seconds.
After 4800 seconds, only one percent is done !!!
And the deadline is into 14 hours, but estimated running time 4 days !!!
Who can explain all of this???
ID: 15405 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
mmonnin

Send message
Joined: 21 Mar 17
Posts: 18
Credit: 508,435
RAC: 2
Message 15406 - Posted: 27 Jul 2018, 1:58:57 UTC

The runtime is inaccurate for BURB and is for many projects with mt apps. All your tasks completed.
ID: 15406 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
marsinph

Send message
Joined: 13 Apr 18
Posts: 13
Credit: 33,921
RAC: 0
Message 15448 - Posted: 13 Aug 2018, 17:18:10 UTC

Still no any answer from Admin !!!
Nothing !!!
The worst is that this project is candidate to run also with Formula BOINC ( http://formula-boinc.org/projets.py?lang=&year=2018 )

But it not produce work enough.
Credits are very volatile, never stable, very inaccuarte.
For the same host, similar WU (same rendering) runs twice longer but receive twice less than other !
I repeat, I compare what is to be compared : same hosts, same rendering with the same GFLOPS.
Without explanation, I think i will remove the first belgian team on all projects fr'om this one.
By the way if we see amount of people who runs WU here, it is very significant.
And BETA since 2004 !!!

Best regards from Belgium's first team admin.
ID: 15448 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Janus
Volunteer moderator
Project administrator
Avatar

Send message
Joined: 16 Jun 04
Posts: 4556
Credit: 2,097,282
RAC: 0
Message 15450 - Posted: 13 Aug 2018, 18:04:15 UTC - in response to Message 15448.  
Last modified: 13 Aug 2018, 18:05:36 UTC

Still no any answer from Admin !!!
Nothing !!!


Well, mmonnin is correct. There is not much more to add.

CreditNew is very unreliable for WUs without an estimated GFlop workload. We sometimes run a corrective credit algorithm that brings the variance down considerably.

Two things in the pipeline to change the credit situation:
1) Run Payday more often. Currently it is mostly run when the DB is being purged for big upgrades. It would be nice to be able to run it almost immediately after a session completes, or even replace CreditNew with Payday entirely but it is difficult to do that.
2) Provide a wild guess for runtime estimation up front. This has the to potential to make things better but could also make them way worse.
ID: 15450 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
marsinph

Send message
Joined: 13 Apr 18
Posts: 13
Credit: 33,921
RAC: 0
Message 15497 - Posted: 23 Sep 2018, 14:50:11 UTC
Last modified: 23 Sep 2018, 14:59:33 UTC

Hello Janus and mmonnin

I not so much mean about credits. But running time.
I repeat, i not follow the given time fom BAM.

I only speak about estimated needed GFLOPS to complete the WU
Also the etimated power of my host (a little more than 4GFLOPS and 12giga integer.
Both are given from the project.

So, 10,000 GFLOPS / 4 Gflops, would give a approximative of 2,500 seconds needed.
Once again, the data are given by project. And all approximatively.

But after 4,500 seconds running, still not finished !

My conclusions :
- the etimated GFLOPS given by project are not correct
!
and/or

-The estimated power of my host (given by project) is not correct
But I do not think the latest, because on all other project my calclculation power is more or less the same : 4 GFLOP/S and 12 G intger operations/S

It is what I try to understand.

We can estimate the running time depending the needed calculaztion and power (not BAM).
The problem is in Formula boinc. If some WU needs three days to run, all credits for mormula boinc will be lost. And I not speak about "out of delay" !


Here the stderr.txt after 5400 seconds :
WU : 3298532
Host : 81394

boinc_init_diagnostics() completed
boinc_init_options() completed
boinc_get_init_data() completed
CPU performance profile completed: 4270026131.419726 fpops, 12267714336.751814 iops reported. p_c is 1536329501.135065
Checking if GPU should be enabled...
No, using CPU
Mapping logical files to physical destinations:
in => in
out.zip => ../../projects/burp.renderfarming.net/ses0000003470frm0000000085prt00001_2_r312919470_0
./windows_zip.exe => ./windows_zip.exe
./windows_unzip.exe => ./windows_unzip.exe
Project Directory Base => C:\ProgramData\BOINC/projects/burp.renderfarming.net
Unpacking archives:
blender_5.13_windows_x86_64__mt.zip => blender_5.13_windows_x86_64__mt.zip
./windows_unzip.exe -o -d "." blender_5.13_windows_x86_64__mt.zip...done
Creating worker...
Worker constructing...
Worker constructed.
$Id: glue.cpp 1827 2014-08-02 13:28:01Z jbk $
$Id: BOINCHandler.cpp 1824 2014-07-29 12:27:55Z jbk $
$Id: Controller.cpp 1824 2014-07-29 12:27:55Z jbk $
$Id: ProgressMonitor.cpp 1278 2011-01-23 09:22:45Z jbk $
Executing blender.exe -noaudio --factory-startup -y -b in -P clirender.py -- -F PNG -T 16 -t 8 -f 85 0.0 0.0 1.0 1.0
po_r aft0x33b370
po_r aft0xb8
Created pipes
Child created.
Worker Wtohrrkeeard t hsrteaard tmeodn
itor up.
|('Observer constructed',)

|('Python Main',)

Application reports 'Booted'
|('Reading args',)

|("Preparing disk cache based on 'C:\\ProgramData\\BOINC\\slots\\6' basedir",)

|('Preparing scenes',)

|('Autodetected rendering engine: CYCLES',)

|('CPU rendering',)

|('Using cycles samples:', 500)

|('Estimating render properties',)

|('I found an output node', 'Scene')

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('Search path ended',)

|('I did bpy.context.scene node tree parsing',)

|([bpy.data.scenes['Scene']],)

|('Done examining the node trees!',)

|[bpy.data.scenes['Scene']]

|('Renderer: ', 'CYCLES')

|('Samples: ', 500)

|('Additional: ', 151)

|('Total work: ', 1800151.0)

|('Scene parsing done',)

|('Cleaning old files',)

|('No need to delete out',)

|('No need to delete out.png',)

|('Launching Cycles Render',)

|found bundled python: C:\ProgramData\BOINC\slots\6\2.79\python

|Read blend: C:\ProgramData\BOINC\slots\6\in

|Cycles shader graph connect: can only connect closure to closure (Mix Shader.001.Closure to Mix Shader.002.Fac).

Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.
Forwards time skew detected, internal timers reset.

Best regards from the first Belgian team
ID: 15497 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile plonk420

Send message
Joined: 14 Apr 08
Posts: 14
Credit: 533,857
RAC: 1
Message 15505 - Posted: 25 Sep 2018, 7:02:50 UTC

are the credits going to be adjusted at all (including recently rendered ones)? 25-50 points seems a bit low for some of these...
ID: 15505 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile DoctorNow
Project donor
Avatar

Send message
Joined: 11 Apr 05
Posts: 403
Credit: 2,182,867
RAC: 0
Message 15506 - Posted: 25 Sep 2018, 9:32:28 UTC - in response to Message 15505.  

are the credits going to be adjusted at all (including recently rendered ones)?

Janus said it already in the post above:
1) Run PayDay more often. Currently it is mostly run when the DB is being purged for big upgrades. It would be nice to be able to run it almost immediately after a session completes, or even replace CreditNew with Payday entirely but it is difficult to do that.

So expect that it not happens in the next days, it probably will take a while until it will be done.
Life is Science, and Science rules. To the universe and beyond
Proud member of BOINC@Heidelberg
My BOINC-Stats
ID: 15506 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile plonk420

Send message
Joined: 14 Apr 08
Posts: 14
Credit: 533,857
RAC: 1
Message 15508 - Posted: 25 Sep 2018, 14:59:16 UTC

oh, i guess PayDay is some server-side thing, seeing as how google didn't pull anything useful?
ID: 15508 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile DoctorNow
Project donor
Avatar

Send message
Joined: 11 Apr 05
Posts: 403
Credit: 2,182,867
RAC: 0
Message 15509 - Posted: 25 Sep 2018, 18:54:20 UTC - in response to Message 15508.  
Last modified: 25 Sep 2018, 19:43:01 UTC

Well, you can read how the whole thing works here.
Maybe it should be made sticky so that it won't vanish someday in too much threads. It's currently still visible a few threads below in this "Number crunching" section. ;-)
Although I guess when the next time PayDay is executed the thread moves to the top anyway if Janus announces it there.
Life is Science, and Science rules. To the universe and beyond
Proud member of BOINC@Heidelberg
My BOINC-Stats
ID: 15509 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote

Message boards : Number crunching : Estimated runtime, credits,.........