Memory

Message boards : Number crunching : Memory
Message board moderation

To post messages, you must log in.

1 · 2 · Next

AuthorMessage
Profile UBT - Halifax--lad
Avatar

Send message
Joined: 10 Sep 05
Posts: 74
Credit: 589
RAC: 0
Message 4651 - Posted: 26 Feb 2007, 7:57:07 UTC

Hi Janus,

currently getting this

26/02/2007 07:09:15|BURP|Message from server: Your computer has 990.42MB of memory, and a job requires 1024.00MB

It seems a bit harsh as I know WU\'s would complete as there is plenty of virtual memory too, any chance of looking into this in a spare moment or 2?
Join us in Chat (see the forum) Click the Sig


Join UBT
ID: 4651 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Raimund Barbeln
Project donor
Avatar

Send message
Joined: 14 Mar 05
Posts: 73
Credit: 25,881
RAC: 1
Message 4657 - Posted: 26 Feb 2007, 9:28:23 UTC

I got the same message. But there are other renders ins the queue, which requre less memory, so why don\'t we get WUs from one of those?

when life gives you lemons, make lemonade!
ID: 4657 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile UBT - Halifax--lad
Avatar

Send message
Joined: 10 Sep 05
Posts: 74
Credit: 589
RAC: 0
Message 4658 - Posted: 26 Feb 2007, 9:29:45 UTC

Must be the way the work gets queued?
Join us in Chat (see the forum) Click the Sig


Join UBT
ID: 4658 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Janus
Volunteer moderator
Project administrator
Avatar

Send message
Joined: 16 Jun 04
Posts: 4572
Credit: 2,100,463
RAC: 8
Message 4662 - Posted: 26 Feb 2007, 11:03:27 UTC
Last modified: 26 Feb 2007, 11:05:26 UTC

You do get work from some of the smaller sessions too. The work is currently divided into several queues (small, bigger, biggest) etc. and some of the smallest ones are being emptied faster than the feeder can fill them up.

So with a little bit of patience you should be able to get through from time to time. However, the scheduler will ALSO write out a warning about memory from time to time... this is just the way it works.
ID: 4662 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mike Dunn

Send message
Joined: 21 May 05
Posts: 22
Credit: 9,965
RAC: 0
Message 4663 - Posted: 26 Feb 2007, 11:14:22 UTC - in response to Message 4651.  


26/02/2007 07:09:15|BURP|Message from server: Your computer has 990.42MB of memory, and a job requires 1024.00MB

It seems a bit harsh as I know WU\'s would complete as there is plenty of virtual memory too, any chance of looking into this in a spare moment or 2?

You think that\'s harsh ? Try this :(
26/02/2007 11:14:08|BURP|Message from server: Your computer has 1023.04MB of memory, and a job requires 1024.00MB

ARGH !!!
ID: 4663 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Raimund Barbeln
Project donor
Avatar

Send message
Joined: 14 Mar 05
Posts: 73
Credit: 25,881
RAC: 1
Message 4664 - Posted: 26 Feb 2007, 11:40:05 UTC

I just did a manual update and got one WU from session 278.
It was finished in 37 seconds.

when life gives you lemons, make lemonade!
ID: 4664 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Professor Desty Nova
Avatar

Send message
Joined: 21 Mar 05
Posts: 97
Credit: 294,357
RAC: 3
Message 4666 - Posted: 26 Feb 2007, 11:42:59 UTC - in response to Message 4662.  
Last modified: 26 Feb 2007, 11:46:55 UTC

some of the smallest ones are being emptied faster than the feeder can fill them up.


I guess the server page has broken stuff. The feeder is shown as \"not running\".

AND... BOINC/Windows were are MY 500KB :\'(

26/02/2007 11:44:01|BURP|Message from server: Your computer has 1023.53MB of memory, and a job requires 1024.00MB



Professor Desty Nova
Researching Karma the Hard way
ID: 4666 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Raimund Barbeln
Project donor
Avatar

Send message
Joined: 14 Mar 05
Posts: 73
Credit: 25,881
RAC: 1
Message 4667 - Posted: 26 Feb 2007, 11:45:22 UTC

I could upload my WU, but when the client tried to rport it, the was a timeout.
It seems the whole server has gone down.

when life gives you lemons, make lemonade!
ID: 4667 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mike Dunn

Send message
Joined: 21 May 05
Posts: 22
Credit: 9,965
RAC: 0
Message 4669 - Posted: 26 Feb 2007, 13:33:18 UTC - in response to Message 4667.  

I could upload my WU, but when the client tried to rport it, the was a timeout.
It seems the whole server has gone down.

Mmmm, that would explain why, although I\'m now allowed work, the system has no WUs left - I hope .....

Don\'t want to have missed ALL of this :(
ID: 4669 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Keck_Komputers
Avatar

Send message
Joined: 6 Mar 05
Posts: 94
Credit: 1,384,324
RAC: 7
Message 4670 - Posted: 26 Feb 2007, 13:47:21 UTC - in response to Message 4657.  

I got the same message. But there are other renders ins the queue, which requre less memory, so why don\'t we get WUs from one of those?

One of the things the standard server deamons do is once a task fails to be issued to a host it jumps to the top of the send queue. The server then looks at the first x tasks in the queue to see if your host can handle them. Once all x tasks are high memory tasks it can be very hard to get one.


BOINC WIKI

BOINCing since 2002/12/8
ID: 4670 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Mike Dunn

Send message
Joined: 21 May 05
Posts: 22
Credit: 9,965
RAC: 0
Message 4672 - Posted: 26 Feb 2007, 15:12:25 UTC - in response to Message 4670.  
Last modified: 26 Feb 2007, 15:12:59 UTC

Janus,

Seeing as there seems to be a few of us very close to the minimum memory spec needed, can the session causing this \'issue\' have the requirements relaxed a couple % (say from 1024MB to 1020MB or 1000MB) while \'live\' ? This would help get these \'problem\' WUs out of the queue.

If not, can future ones be a little more lenient ?

Mike
ID: 4672 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile remix85

Send message
Joined: 2 Dec 06
Posts: 2
Credit: 1,069
RAC: 0
Message 4731 - Posted: 28 Feb 2007, 21:51:51 UTC

Would it be possible, to reverse the queue? (to send the biggest available WU that computer can handle)
ID: 4731 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile AndyK
Project donor
Avatar

Send message
Joined: 2 Apr 05
Posts: 137
Credit: 20,063
RAC: 0
Message 4741 - Posted: 1 Mar 2007, 17:27:01 UTC

Had the same problem, my boinc said me no work but in the server status there were some sessions, but all of them required 1024MB.

Ok I thought.. I have another gig here...
shut down the pc, put it in and rebooted with 2048MB of ram

guess what boinc said?
No work from project... ?!?!????


Andy
ID: 4741 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile mpan3

Send message
Joined: 24 Apr 06
Posts: 64
Credit: 29,899
RAC: 0
Message 4752 - Posted: 2 Mar 2007, 5:04:08 UTC

andyk, right now I am getting lots of WUs (306) without any problem, I am also on 2GB RAM. Are you sure you plugged in the extra gig in correctly? check to make sure your system is actually seeing 2GB... it happened to me once.
Contribution to BURP total: 0.5% (manually updated)
ID: 4752 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile AndyK
Project donor
Avatar

Send message
Joined: 2 Apr 05
Posts: 137
Credit: 20,063
RAC: 0
Message 4769 - Posted: 2 Mar 2007, 13:47:32 UTC - in response to Message 4752.  

andyk, right now I am getting lots of WUs (306) without any problem, I am also on 2GB RAM. Are you sure you plugged in the extra gig in correctly? check to make sure your system is actually seeing 2GB... it happened to me once.


yep, the boostrap showed me 2048MB, windows reported 2048, and even in the boinc logfile:
2007-02-27 19:45:53 [---] Starting BOINC client version 5.8.11 for windows_intelx86
2007-02-27 19:45:53 [---] log flags: task, file_xfer, sched_ops
2007-02-27 19:45:53 [---] Libraries: libcurl/7.16.0 OpenSSL/0.9.8a zlib/1.2.3
2007-02-27 19:45:53 [---] Data directory: I:\\BOINC
2007-02-27 19:45:53 [---] Processor: 2 AuthenticAMD AMD Athlon(tm) 64 X2 Dual Core Processor 4800+ [x86 Family 15 Model 35 Stepping 2] [fpu tsc pae nx sse sse2 3dnow mmx]
2007-02-27 19:45:53 [---] Memory: 2.00 GB physical, 3.35 GB virtual
2007-02-27 19:45:53 [---] Disk: 209.97 GB total, 66.86 GB free
2007-02-27 19:45:53 [BURP] URL: http://burp.boinc.dk/; Computer ID: 26497; location: home; project prefs: default


so I was sure boinc had notice of the new RAM.

After the little \"big\" sessions which required 1024MB or more were finished I got new work...
Now I\'m waiting for a new sessions which requires more than 1024MB to check, if I would get a workunit.

PS: Session 306 needs 256MB of RAM... and not more than 1024MB

AndyK
ID: 4769 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Speedy

Send message
Joined: 25 May 06
Posts: 208
Credit: 676,104
RAC: 0
Message 4786 - Posted: 3 Mar 2007, 6:57:41 UTC - in response to Message 4666.  

some of the smallest ones are being emptied faster than the feeder can fill them up.


I guess the server page has broken stuff. The feeder is shown as \"not running\".

AND... BOINC/Windows were are MY 500KB :\'(

26/02/2007 11:44:01|BURP|Message from server: Your computer has 1023.53MB of memory, and a job requires 1024.00MB

I\'m getting same thing

3/3/2007 7:50:44 PM|BURP|Sending scheduler request: Requested by user
3/3/2007 7:50:44 PM|BURP|Requesting 8640 seconds of new work
3/3/2007 7:50:49 PM|BURP|Scheduler RPC succeeded [server version 509]
3/3/2007 7:50:49 PM|BURP|Message from server: Your computer has 1023.48MB of memory, and a job requires 1024.00MB
3/3/2007 7:50:49 PM|BURP|Message from server: No work sent
3/3/2007 7:50:49 PM|BURP|Message from server: (there was work but your computer doesn\'t have enough memory)
3/3/2007 7:50:49 PM|BURP|Deferring communication for 45 min 1 sec
3/3/2007 7:50:49 PM|BURP|Reason: no work from project

I have 1024.00MB any idea why this is happening?
Cheers Jarod
ID: 4786 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile John Hunt
Avatar

Send message
Joined: 11 Sep 06
Posts: 33
Credit: 60,026
RAC: 0
Message 4787 - Posted: 3 Mar 2007, 7:02:18 UTC
Last modified: 3 Mar 2007, 7:03:42 UTC

My earlier problem has now been fixed -
http://burp.boinc.dk/forum_thread.php?id=646
but I am now having the same problem as everyone else here - only worse!
My PC has only 512M of RAM which is more than enough for all except just one or two
BOINC projects (SAP and Cancer on WCG).

Does this project ALWAYS need this much memory? There are no \'Minimum Requirements\'
listed anywhere I can see and I\'ve had a look through the FAQ....

ID: 4787 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Fritz

Send message
Joined: 26 Nov 06
Posts: 3
Credit: 127,369
RAC: 0
Message 4789 - Posted: 3 Mar 2007, 7:46:57 UTC

John

Each Render job is different. As some of the comments in this thread state there are jobs that require 256M ... check the list of jobs waiting (server status) to see the various sizes

Just looked ... the requirements vary from 128M to 1024M for the 4 jobs queued up. Your machine qualifies for 3 of the 4
ID: 4789 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile John Hunt
Avatar

Send message
Joined: 11 Sep 06
Posts: 33
Credit: 60,026
RAC: 0
Message 4790 - Posted: 3 Mar 2007, 8:04:53 UTC

Thanks Fritz - much appreciated!

ID: 4790 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
Profile Janus
Volunteer moderator
Project administrator
Avatar

Send message
Joined: 16 Jun 04
Posts: 4572
Credit: 2,100,463
RAC: 8
Message 4791 - Posted: 3 Mar 2007, 8:08:55 UTC
Last modified: 3 Mar 2007, 8:15:24 UTC

I think you may be forgetting what it is that the server status page and session pages show - they show the progress in completed frames and not in frames-to-be-sent.

Why does this make a difference? Let\'s have a look at an example:
Session A requires 256MB RAM
Session B requires 1024MB RAM
To begin with the queue is about 50% A and 50% B.
What happens is that session A almost instantly will be allocated to a lot of machines (there\'s quite a few machines with less than 512MB RAM) and after a short while the queue is now 0% A and 100% B - all results from A are in progress but haven\'t finished rendering yet. At this point in time you\'ll see session A having a few percent progress on the session page and it will be \"in progress\" on the status page but no parts are available for rendering because they are all rendering already. In such a situation you may get the memory notice even though there\'s one or more sessions fitting your memory segment on the status page.

This is how the situation is right now. So since we changed to the randomized scheduler you should just trust it when it says \"no work\", hehe.
The next step is to move on to a stochastic fairness queue scheduler which also takes the priority of sessions into account, this is useful since a few units of small sessions may be blocked by large numbers of units from a larger session (which is also the case right now unfortunately).
ID: 4791 · Rating: 0 · rate: Rate + / Rate - Report as offensive     Reply Quote
1 · 2 · Next

Message boards : Number crunching : Memory