Lots of old sessions on the server status page


Advanced search

Message boards : Server backend and mirrors : Lots of old sessions on the server status page

Author Message
Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4483
Credit: 2,094,806
RAC: 0
Message 14785 - Posted: 15 Oct 2016, 16:53:10 UTC
Last modified: 15 Oct 2016, 17:20:35 UTC

Recently CATS (the software that enables easy downloads of active and rendered sessions) was updated. During this update it became clear that there were way too many sessions marked as "active" in CATS, only 2 were actually rendering but around 47 showed up in the list in CATS, 45 of which didn't even show up at all on the website and most certainly weren't being actively rendered by the farm.

At first it looked like an issue with the UI in CATS but it became clear from looking at the session IDs that something weird was going on.
It took a few days to narrow down exactly what the issue was: A peculiar bug in code related to a yet-to-be-written automatic intelligent session checking system caused sessions to crash in a queue that was not visible on the website because the queue is not in use yet. The bug only triggered if artists selected a particular combination of image and colour settings, and when it triggered it would cause their session to vanish into this limbo state without trace. Unfortunately this is some code that was added back in 2011 and the issue has been eating a handful of sessions every year since then.

The sessions were essentially lost, until today.
I activated the queue and added it to the server status pages. 30 dead sessions got resurrected almost immediately as the queue started processing the backlog of uploads. Another 15 sessions may have been genuinely erroneous uploads because they do not seem to work even after the bug was fixed.

At BURP the policy is to always give a fair explanation when a session is rejected and these people didn't get one. Some of them were newcomers who didn't return since.
Over the next few weeks I'll be trying to clean up this mess, the server status page will look crazy until it is fixed.

Thor's Thunderbox
Send message
Joined: 22 Dec 09
Posts: 2
Credit: 880,840
RAC: 2,377
Message 14787 - Posted: 15 Oct 2016, 19:58:45 UTC - in response to Message 14785.

Are the sessions that are viable going to be run?

MAJ Carr
Send message
Joined: 14 Nov 06
Posts: 2
Credit: 133,894
RAC: 0
Message 14788 - Posted: 16 Oct 2016, 15:21:14 UTC - in response to Message 14787.

I hope they will be done. I have cleared my cache of other projects and ready to process these tasks.

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4483
Credit: 2,094,806
RAC: 0
Message 14796 - Posted: 19 Oct 2016, 10:47:34 UTC

Some of them are going to be rendered if the author is still interested in doing so and the session is actually valid.

Just adding another way that sessions were getting stuck in this limbo: If the file uploaded was not actually a Blender file at all but something else like a .rar archive.

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4483
Credit: 2,094,806
RAC: 0
Message 14921 - Posted: 23 Nov 2016, 18:41:24 UTC
Last modified: 23 Nov 2016, 18:41:48 UTC

Just a quick 1-month-update on this one:
So far, work on the admin UI has improved the workflow on reviewing this kind of session. 10 limbo sessions have either been accepted and rendered or given a good reason for their rejection.
We're down to 35 sessions in limbo. Progress on this will be slow until after New Years.

Profile noderaser
Project donor
Avatar
Send message
Joined: 28 Mar 06
Posts: 507
Credit: 1,551,761
RAC: 224
Message 15232 - Posted: 23 Aug 2017, 5:02:33 UTC

Any updates on the orphaned sessions? Seems like the creators probably won't miss them, since it's been a year or more for most of them were submitted. I think it's also giving a lot of people the false impression that the project is stalled.
____________

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4483
Credit: 2,094,806
RAC: 0
Message 15233 - Posted: 11 Sep 2017, 19:57:55 UTC - in response to Message 15232.
Last modified: 11 Sep 2017, 20:38:51 UTC

You are very likely right, it may have been a contributing factor in why there has been so few sessions recently.

We're down to around 17 now. I have to admit that it kinda drowned a bit in some of the other exciting stuff going on with new server hardware planning and the BARF development milestone, which I'll have to write a more detailed post about soonish.

A few of them will probably be used to test a series of new client releases for Blender 2.79 in a few weeks when it officially launches. There's probably going to be more client tests than usual.

One of the reasons why they are being (painstakingly slowly) manually rejected is that the system that was originally responsible for bugging them out is still a planned feature and the orphaned sessions represent a great source of testing data - and a way to further fix and fine-tune that system. The intention is to (properly) enable the system at one point, so that it may sift through incoming sessions and very quickly point out common upload issues to their authors even before an admin reviews the session.


Post to thread

Message boards : Server backend and mirrors : Lots of old sessions on the server status page