Failure on linux


Advanced search

Message boards : Number crunching : Failure on linux

1 · 2 · Next
Author Message
Achim
Send message
Joined: 17 May 05
Posts: 182
Credit: 2,525,093
RAC: 1,010
Message 12428 - Posted: 16 Mar 2014, 23:39:23 UTC

Hi,

I recently upgraded my computer, so now I can crunch agan for burp :-)

But using linux (debian) all WU fail like this one

Any idea?

funkydude
Send message
Joined: 23 Dec 13
Posts: 275
Credit: 2,478,281
RAC: 0
Message 12429 - Posted: 17 Mar 2014, 0:26:38 UTC - in response to Message 12428.

Hi,

I recently upgraded my computer, so now I can crunch agan for burp :-)

But using linux (debian) all WU fail like this one

Any idea?


The BURP farm is using an old version of Blender, which I believe doesn't support the latest kernels. I've only seen people will old kernels having success.

Hopefully BURP will one day update to the latest version of Blender, but I'm not sure what the blockers are for doing that currently. I'm guessing they are pretty serious. It's a shame because soon Blender 2.7 will release which brings rendering speed improvements, something very important for a rendering farm.

Achim
Send message
Joined: 17 May 05
Posts: 182
Credit: 2,525,093
RAC: 1,010
Message 12430 - Posted: 17 Mar 2014, 6:57:19 UTC

Sorry, wrong link..
Here is a better one

Achim
Send message
Joined: 17 May 05
Posts: 182
Credit: 2,525,093
RAC: 1,010
Message 12431 - Posted: 17 Mar 2014, 7:19:40 UTC - in response to Message 12429.

Yes, seems somehow right, but I don't think it is not the kernel.
looks like an issue with blender_ld and the provided libs.

I extracted the blender_4.78_x86_64-pc-linux-gnu.zip manual and startet without the blender_ld, so simply like this:

tmp$ ./blender -noaudio -y -b ../file2526406 -P clirender.py -- -F PNG -t 1 -f 136 0.0 0.0 1.0 1.0 found bundled python: /var/lib/boinc-client/projects/burp.renderfarming.net/tmp/2.66/python read blend: /var/lib/boinc-client/projects/burp.renderfarming.net/tmp/../file2526406 ('Observer constructed',) ('Python Main',) [-->] Boot ('Reading args',) ('Tweaking settings',) ('Autodetected rendering engine: CYCLES',) ('Changing features to supported',) ('Unpacking texture files',) Info: Saved packed file to: /var/lib/boinc-client/projects/burp.renderfarming.net/textures/mainCharBig.png Info: Saved packed file to: /var/lib/boinc-client/projects/burp.renderfarming.net/textures/mainCharBig_blue.png Info: Saved packed file to: /var/lib/boinc-client/projects/burp.renderfarming.net/textures/wut-Alpha.png Info: Saved packed file to: /var/lib/boinc-client/projects/burp.renderfarming.net/textures/wut-RGBA.png Info: Saved packed file to: /var/lib/boinc-client/projects/burp.renderfarming.net/textures/mainCharBig.png Info: Saved packed file to: /var/lib/boinc-client/projects/burp.renderfarming.net/textures/mainCharBig_blue.png Info: Saved packed file to: /var/lib/boinc-client/projects/burp.renderfarming.net/textures/wut-Alpha.png Info: Saved packed file to: /var/lib/boinc-client/projects/burp.renderfarming.net/textures/wut-RGBA.png Info: Total files 16 | Changed 0 | Failed 0 Info: Total files 16 | Changed 0 | Failed 0 ('Using cycles samples:', 1000) ('Estimating render properties',) ('Renderer: ', 'CYCLES') ('Samples: ', 1000) ('Additional: ', 117) ('Total work: ', 1117) ('Scene parsing done',) ('Cleaning old files',) ('No need to delete out',) ('No need to delete out.png',) ('Launching Cycles Render',) [-->] Prog 8.952551477170994 Fra:136 Mem:33.05M (17.58M, peak 54.90M) | Mem: 0.00M, Peak: 0.00M | Scene | Elapsed: 00:00.00 | Synchronizing object | Camera.002

This way it works.
So I assume some incompatibilities with the provided libs and actual environment.

JZD
Send message
Joined: 30 Dec 11
Posts: 89
Credit: 3,123,831
RAC: 5,381
Message 12432 - Posted: 17 Mar 2014, 10:35:58 UTC - in response to Message 12431.

Hey, you can use the anonymous platform, more information here http://burp.renderfarming.net/forum_thread.php?id=2154&nowrap=true#12383.

Achim
Send message
Joined: 17 May 05
Posts: 182
Credit: 2,525,093
RAC: 1,010
Message 12434 - Posted: 17 Mar 2014, 22:52:20 UTC - in response to Message 12432.

Thanks for the hint,
Just got my first WU, and it started calculating...

M0CZY
Avatar
Send message
Joined: 31 Jul 09
Posts: 24
Credit: 279,094
RAC: 0
Message 12822 - Posted: 10 Jun 2014, 19:04:03 UTC

I've just been updated to blender_4.87_x86_64-pc-linux-gnu__mt, but it's not working on my Ubuntu 12.04.4 machine.
All the workunits I have received, from 2 different sessions, fail with computation error in about 16 seconds with an Stderr output that ends with

Exception caught: Worker application apparently died prematurely
Status: -9
---------------------------
Calling boinc_finish()...
____________
The biggest threat to public safety and security is not terrorism, it is Government abuse of authority.

Bitcoin Donations: 1Le52kWoLz42fjfappoBmyg73oyvejKBR3

funkydude
Send message
Joined: 23 Dec 13
Posts: 275
Credit: 2,478,281
RAC: 0
Message 12823 - Posted: 10 Jun 2014, 22:09:52 UTC - in response to Message 12822.

I've just been updated to blender_4.87_x86_64-pc-linux-gnu__mt, but it's not working on my Ubuntu 12.04.4 machine.
All the workunits I have received, from 2 different sessions, fail with computation error in about 16 seconds with an Stderr output that ends with

Exception caught: Worker application apparently died prematurely
Status: -9
---------------------------
Calling boinc_finish()...


Copy-pasting my response from the other thread:

Install Blender from the Ubuntu software center.

Create a directory called "native" in /var/lib/boinc-client/projects/burp.renderfarming.net/

from terminal:
cd /var/lib/boinc-client/projects/burp.renderfarming.net/
sudo mkdir native

That will fix it. The problem is discussed here: http://burp.renderfarming.net/forum_thread.php?id=2312

Profile 7ri9991 [MM]
Avatar
Send message
Joined: 3 Oct 09
Posts: 5
Credit: 308,397
RAC: 0
Message 12985 - Posted: 7 Jul 2014, 13:34:42 UTC - in response to Message 12823.

I've just been updated to blender_4.87_x86_64-pc-linux-gnu__mt, but it's not working on my Ubuntu 12.04.4 machine.
All the workunits I have received, from 2 different sessions, fail with computation error in about 16 seconds with an Stderr output that ends with

Exception caught: Worker application apparently died prematurely
Status: -9
---------------------------
Calling boinc_finish()...


Copy-pasting my response from the other thread:

Install Blender from the Ubuntu software center.

Create a directory called "native" in /var/lib/boinc-client/projects/burp.renderfarming.net/

from terminal:
cd /var/lib/boinc-client/projects/burp.renderfarming.net/
sudo mkdir native

That will fix it. The problem is discussed here: http://burp.renderfarming.net/forum_thread.php?id=2312

I thought it was supposed to be a 'file' not 'folder'. Apparently, it just needs something there called "native". Same effect, different method?

funkydude
Send message
Joined: 23 Dec 13
Posts: 275
Credit: 2,478,281
RAC: 0
Message 12986 - Posted: 7 Jul 2014, 15:16:35 UTC - in response to Message 12985.

I thought it was supposed to be a 'file' not 'folder'. Apparently, it just needs something there called "native". Same effect, different method?


I didn't know that, but good to know :)

M0CZY
Avatar
Send message
Joined: 31 Jul 09
Posts: 24
Credit: 279,094
RAC: 0
Message 13431 - Posted: 1 Dec 2014, 11:51:07 UTC - in response to Message 12986.

I've upgraded my Ubuntu installation to version 14.04.1 LTS 64-bits, which uses Boinc version 7.2.42, and my blender application version is now 4.95 x86_64-pc-linux-gnu (mt)

I'm pleased to report that this version of Blender runs fine, and I didn't need to install the external Blender program separately, so it seems that the dependency problems have been solved, at least for now.
____________
The biggest threat to public safety and security is not terrorism, it is Government abuse of authority.

Bitcoin Donations: 1Le52kWoLz42fjfappoBmyg73oyvejKBR3

M0CZY
Avatar
Send message
Joined: 31 Jul 09
Posts: 24
Credit: 279,094
RAC: 0
Message 13952 - Posted: 21 Jul 2015, 6:49:55 UTC
Last modified: 21 Jul 2015, 6:57:02 UTC

I've been upgraded from version 4.99 to 5.00, and it's not working for me using Ubuntu 14.04.2.

I've had to install Blender and the "native" folder to get the work units running.

I reckon there will be Linux users who won't bother to do this, and they'll trash loads of work units.
____________
The biggest threat to public safety and security is not terrorism, it is Government abuse of authority.

Bitcoin Donations: 1Le52kWoLz42fjfappoBmyg73oyvejKBR3

M0CZY
Avatar
Send message
Joined: 31 Jul 09
Posts: 24
Credit: 279,094
RAC: 0
Message 13953 - Posted: 21 Jul 2015, 12:15:01 UTC - in response to Message 13952.

Now that I've got Burp working again under Linux, I'm running into the problem that my work units are being marked as 'Completed, marked as invalid' because my wingmen are using Windows!
____________
The biggest threat to public safety and security is not terrorism, it is Government abuse of authority.

Bitcoin Donations: 1Le52kWoLz42fjfappoBmyg73oyvejKBR3

JZD
Send message
Joined: 30 Dec 11
Posts: 89
Credit: 3,123,831
RAC: 5,381
Message 13955 - Posted: 21 Jul 2015, 16:57:48 UTC - in response to Message 13952.

I reckon there will be Linux users who won't bother to do this, and they'll trash loads of work units.

I find it odd that this does not solve the users. Such a lot of waste. It makes sense to contact them and alert them to the mistake? It is enough to create native file and everything will be fine.

Achim
Send message
Joined: 17 May 05
Posts: 182
Credit: 2,525,093
RAC: 1,010
Message 13960 - Posted: 21 Jul 2015, 20:34:54 UTC - in response to Message 13953.
Last modified: 21 Jul 2015, 20:35:05 UTC

because my wingmen are using Windows!

Let's get more Linux user crunching for burp, and we solve this problem :-)

Profile mStuff
Send message
Joined: 29 Oct 09
Posts: 26
Credit: 67,721
RAC: 0
Message 13963 - Posted: 21 Jul 2015, 21:35:01 UTC - in response to Message 13960.


Let's get more Linux user crunching for burp, and we solve this problem :-)


I think getting more linux users crunching would make windows/linux interoperability issues happen even more. :)

I'm not sure what makes the cycles validation differ between linux and Windows, but maybe it could be solved somehow.
Otherwise separating windows users from linux users to do each of their own workunits would be a solution.

tanguay
Send message
Joined: 30 Jan 13
Posts: 4
Credit: 2,197,065
RAC: 0
Message 13964 - Posted: 21 Jul 2015, 22:57:56 UTC - in response to Message 13963.

From what I can see, there doesn't seem to be invalid WU from the GPU.
Instead, a large amount from the CPU (Blender v5.00 (mt)) are marked as invalid.

Perhaps some more investigation into why the WU are marked invalid. Are there any error logs that can be checked?


Tanguay

funkydude
Send message
Joined: 23 Dec 13
Posts: 275
Credit: 2,478,281
RAC: 0
Message 13965 - Posted: 21 Jul 2015, 23:24:17 UTC - in response to Message 13952.

From what I can see, there doesn't seem to be invalid WU from the GPU.
Instead, a large amount from the CPU (Blender v5.00 (mt)) are marked as invalid.

Perhaps some more investigation into why the WU are marked invalid. Are there any error logs that can be checked?


Tanguay


This isn't new or unique to v5, it's specific to certain features than some renders have enabled that Blender itself doesn't seem capable of rendering consistently.

I've had to install Blender and the "native" folder to get the work units running.


It's annoying and I really dislike the fact that this is STILL an issue after all this time. I'm assuming Janus hasn't had time to investigate it.

Random though: Does the native setup mean you're using the version of Blender distributed by your distro? If so, I can see how this would cause rendering issues. I'm hoping this isn't the case, but if the native setup does use a BURP packaged blender executable (the latest version) then what is the point of the native setup, libraries? That still seems like it could cause inconsistencies across the farm according to which distro you choose and how up-to-date it is.

M0CZY
Avatar
Send message
Joined: 31 Jul 09
Posts: 24
Credit: 279,094
RAC: 0
Message 13970 - Posted: 22 Jul 2015, 6:33:44 UTC - in response to Message 13965.
Last modified: 22 Jul 2015, 7:08:26 UTC

Does the native setup mean you're using the version of Blender distributed by your distro?

Yes. In my case, with Ubuntu 14.04.2, I installed Blender version 2.69 from the Ubuntu repository.
Using the native Blender version instead of the BURP packaged version is not ideal, but it is my only choice if the BURP version doesn't work.
The only other solution is for me to pause all work until the contents of the BURP zip package are corrected to make it work properly.
____________
The biggest threat to public safety and security is not terrorism, it is Government abuse of authority.

Bitcoin Donations: 1Le52kWoLz42fjfappoBmyg73oyvejKBR3

funkydude
Send message
Joined: 23 Dec 13
Posts: 275
Credit: 2,478,281
RAC: 0
Message 13976 - Posted: 23 Jul 2015, 1:07:26 UTC

It seems my initial assumption was incorrect, at least, according to the task log for linux renders.

Executing ./blender -noaudio --factory-startup -y -b in -P clirender.py -- -F PNG -t 4 -f 440 0.24956055 0.0 0.50043947 1.0


So it is using the executable provided by BURP. I assume however that any libraries it requires will be the system used libraries. I don't think that should really influence results.

I'm not sure why Janus doesn't seem to want to partake in this thread, or correct the obviously incorrect assumptions being made.

1 · 2 · Next
Post to thread

Message boards : Number crunching : Failure on linux