New image cache algorithm


Advanced search

Message boards : Website : New image cache algorithm

Author Message
Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4461
Credit: 2,094,806
RAC: 0
Message 13685 - Posted: 29 Mar 2015, 18:31:44 UTC
Last modified: 29 Mar 2015, 18:34:01 UTC

We're currently testing out a new hardware-backed image caching algorithm. It was developed specifically to be used in tandem with some other optimizations in the next version of the image gallery to speed up page switches (try hitting the "Next" link a few times on the demo page to see if the next page images load instantly for you)

The test also affects images in the current website gallery.

If you notice anything odd please post back to this thread!

Mateon1
Send message
Joined: 29 May 15
Posts: 1
Credit: 187,075
RAC: 0
Message 14068 - Posted: 23 Aug 2015, 19:23:10 UTC

I can't see any images in Chrome version 45.0.2454.46 beta. Upon closer inspection I can see that something is being sent with a jpeg mime-type, but the image might be malformed because all show as broken image icons.

http://i.imgur.com/CxmCTTF.png - Gallery
http://i.imgur.com/QkNvn88.png - Unfinished session page (image link looks like http://xmlrpc.burp.renderfarming.net//static/sessions/1234/frames/123/full or /preview, the double slash should be fixed, but doesn't seem to be the problem)
http://i.imgur.com/R3UxTEa.png - static image example with request and response info

The images fail to render in Firefox as well, displaying an error message roughly translating to: Image "http://xmlrpc.burp.renderfarming.net/static/sessions/2824/frames/20/full" can't be displayed because it contains errors.

img_handler.php images suffer the same issue.

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4461
Credit: 2,094,806
RAC: 0
Message 14069 - Posted: 24 Aug 2015, 18:27:53 UTC - in response to Message 14068.
Last modified: 24 Aug 2015, 18:31:04 UTC

Are you behind a proxy (possibly a local proxy on port 1080?)?

If you use wget instead of Chrome/Firefox to fetch the URL, does the resulting file contain any extra/less data when inspected in a file editor? The beginning of the file may have an error in it.

Profile Janus
Volunteer moderator
Project administrator
Avatar
Send message
Joined: 16 Jun 04
Posts: 4461
Credit: 2,094,806
RAC: 0
Message 14125 - Posted: 17 Oct 2015, 11:01:29 UTC
Last modified: 17 Oct 2015, 12:09:59 UTC

Newer really got much feedback on this one but the algorithm was recently updated and a new image thumbnailing backend was added as well. The cache should be around four times as fast and the new backend handles translucent images much better than the old one.
If anything weird shows up please post back here.

The cache should now be able to serve
- client-side cache-hit images in "0ms" - if the client already has the image and knows it is fresh
- client-side fuzzy or miss, server-side hit in 4ms - accounting for 99% of all hits.
- and misses in typically 150ms-?s depending on size/type of image - the first time an image is ever shown
Naturally network latency is added on top of that to get the actual speed seen in the browser.

kubinator4321
Send message
Joined: 6 Apr 15
Posts: 28
Credit: 452
RAC: 0
Message 14178 - Posted: 19 Nov 2015, 19:59:58 UTC - in response to Message 14125.

Not sure if this is just me, but I haven't seen the images on the website ever since the big update. Using firefox 42.0, every image comes up blank (even the frame/part previews), however I can download them from the project pages alright.

Regarding what you said about proxies, the network I use is "nested" AFAIK, which means there is a higher-level router which I don't have access to that has a public IP except our router, which probably means it could cause problems kind of like a proxy?

Images of the problem:

http://i.imgur.com/x6fAthJ.png
http://i.imgur.com/JwAQyKH.png
http://i.imgur.com/8oAYG55.png


Post to thread

Message boards : Website : New image cache algorithm