Client Re-Downloading Completed Sessions


Advanced search

Message boards : Client : Client Re-Downloading Completed Sessions

Author Message
overkill
Send message
Joined: 12 Jun 08
Posts: 56
Credit: 922,628
RAC: 0
Message 10556 - Posted: 10 Jul 2010, 17:09:50 UTC

Just curious how session files are managed on the client. I have various computers who store old sessions, and re-download them whenever I manually delete them.

As of writing this, the only active session on burp is 993...

Computer #1 : Boinc 6.2.14 - No sessions downloaded.
Computer #2 : 6.10.17 - Sessions 950, 1009, 1020.
Computer #3 : 6.10.17 - joined recently / never crunched. Has sessions 996 and 993.

It looks like the session files are re-downloaded if the client has worked on tasks in the past. Even though the session is complete. Except for Computer #1 which is 6.2.14 (could it be a "bug" with the 6.10.17 clients?).

I suppose a timely deletion of workunits/results would handle the problem, but not downloading if the session is complete could be a quick fix(?). It would (at least) allow me to clean up my client without re-downloading.

I quickly looked at the development site and didn't see anything related. Can you add the devel link to the burp web menu (under "Other?")?

Thanks and keep up the excellent work!

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4461
Credit: 2,094,806
RAC: 0
Message 10557 - Posted: 12 Jul 2010, 8:17:08 UTC

Yes, the BOINC sticky files have always been a little funny. In theory what it should do is to download the files when you are rendering and then leave them on the host (not redownload them unless you are rendering them again). This allows the client to re-use the same files between workunits and sessions without fetching them for each workunit.

There's a workaround on the server that will ask hosts to delete files that haven't been used for a (really) long time. Additionally BOINC will delete them once it hits the disk limits specified in your host's preferences.

I quickly looked at the development site and didn't see anything related. Can you add the devel link to the burp web menu (under "Other?")?

Sure, the "Help us code" menu item now points to the development platform.

Profile DoctorNow
Project donor
Avatar
Send message
Joined: 11 Apr 05
Posts: 392
Credit: 2,167,694
RAC: 109
Message 10558 - Posted: 12 Jul 2010, 11:57:05 UTC - in response to Message 10557.

There's a workaround on the server that will ask hosts to delete files that haven't been used for a (really) long time. Additionally BOINC will delete them once it hits the disk limits specified in your host's preferences.

Yeah, would be nice to have such a thing on BURP too, Einstein uses this thing always to delete files, which are not more used.
I mostly do a regular check of my BURP folder, when it grows too big of unused sessions, I delete them. ORE (Renderfarm.fi) unfortunately has the same problem, I forgot about that and as I watched recently I had over 800 MB in the folder... ;-)

Tips from my experiences:
The re-download of older sessions either can be prevented by editing the client_state.xml, which contains all ever transferred files (but that needs a little knowledge), or by cancelling it the time they are redownloaded(!), the client remembers this then and it shouldn't occur that next time of starting BOINC/BURP the session files are downloaded again.
____________
Life is Science, and Science rules. To the universe and beyond
Proud member of BOINC@Heidelberg
My BOINC-Stats

overkill
Send message
Joined: 12 Jun 08
Posts: 56
Credit: 922,628
RAC: 0
Message 10561 - Posted: 12 Jul 2010, 14:51:57 UTC - in response to Message 10558.

If the disk limits will auto-delete the old sessions, I suppose it's ok. I was worried about refusing work due to space limits (mainly at ORE).

Thanks DoctorNow for the tip about aborting the transfer. I'll try that too.

Deleting old results from the server seems to work. BURP is pretty clean (~5K) while ORE seems cluttered (~180K). Once this gets automated(?) it should clear things up.

Thanks

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4461
Credit: 2,094,806
RAC: 0
Message 10564 - Posted: 13 Jul 2010, 8:19:01 UTC - in response to Message 10561.

Deleting old results from the server seems to work. BURP is pretty clean (~5K) while ORE seems cluttered (~180K). Once this gets automated(?) it should clear things up.

This was automated for completed sessions fairly recently and the patch deployed on both the main BURP project as well as the clones. Failing sessions will stay in the table until they can be looked at by an admin and then removed.

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4461
Credit: 2,094,806
RAC: 0
Message 10691 - Posted: 23 Jan 2011, 13:48:21 UTC - in response to Message 10556.

It looks like the session files are re-downloaded if the client has worked on tasks in the past. Even though the session is complete.

This should now have changed. The client will keep recent files and libraries but will delete old ones during scheduler requests.


Post to thread

Message boards : Client : Client Re-Downloading Completed Sessions