How to save hi-res images from museum websites

When I worked in publishing, I used to do a lot of picture research. I’d love to go deep into a topic and uncover amazing, little-known, pictures that captured a special time and place. On these trawls through the internet, however, I would frequently come across websites that did everything in their power to stop you downloading images. Museum websites are particularly annoying about this as the images are usually public domain anyway. Half the time, the same institution is running some sort of open access program, but hasn’t gotten round to making everything available yet. When I came across situations where I the hi-res existed, I was pretty determined to get them. I enjoy taking things apart and tinkering with them. knew Here’s how you do it. Disclaimer . Downloading public domain images for inspiration/personal use is one thing. Ripping off content creators is a different thing. Respect copyright . Sysadmins do eventually fix things. Maybe they’ll read this article. If these methods stop working, you may or may not be able to figure out a workaround. These ‘hacks’ might not work forever . The techniques are not exhaustive, but if you play around with them, you should have the tools to experiment on different sites. I’m giving you a net, not a fish So, , here is how you hack into… for educational purposes only The Library of Congress Probably the biggest and best collection of historic images on the internet. An incredible collection of tremendous importance. A large number of their scans are downloadable in the form of gorgeous, enormous, tifs. Thank you LOC — this is how you do it! You put other institutions to shame! Some are not. . But they’re often still out there, hidden on the server Let’s look at an example. Unlike many of their records, this example has no download options. Open the thumbnail in a new tab and you get disappointment. They claim “Full online access to this resource is only available at the Library of Congress”. Hmmm, let’s just see about that shall we? The LOC file system is pretty easy to crack. There appear to be 3 main sizes of jpeg and 2 main sizes of tif. The jpeg filenames end with either , or . An example: _150px r v filename r.jpg. The tifs end with or . u a In the example above, lets see what happens when we replace the thumbnail with an . _150px r Bingo Larger image. Just like that. Try it again with a and you’ll get an even better image. Try it with or , and you’ll get… v u.tif a.tif Failure The fix is easy. If you find an image that you download as a tif, you’ll see from the download address that the tifs are located in a ‘master’ folder instead of the ‘service’ folder. Change ‘service’ to ‘master’ in that section of the url and you’re good to go. can If you’re in luck, a hi-res tif will start downloading. Some of the images only seem to be digitised up to the level, but they should still be big enough for most purposes. u Happy downloading. University of Las Vegas This one’s a bit trickier, but still pretty doable. There are actually a few ways of getting in but I’ll show you the easiest. Here’s a photo of Howard Hughes on parade. It can be downloaded via the download button, but we’re going to ignore it for now and download it the hacker way. That way, you can use the technique with files that have a download button. don’t Open the image in a new tab and you’ll see the website spits out a small section of the image, which is pretty useless. Look in the url though and there’s some useful info: http://d.library.unlv.edu/utils/ajaxhelper/?CISOROOT=hughes&CISOPTR=1713&action=2& & &DMX=0&DMY=0&DMTEXT=&DMROTATE=0 DMSCALE=15 DMWIDTH=512&DMHEIGHT=512 The important bits here are in bold: , , . Change the scale to 100 and change the width and height to the values listed on the record page (in this case 6016 x 4948), hit return and you’ll get a lovely big jpeg to download. dmscale dmwidth dmheight If you can’t find the dimensions, change scale to 100, put the dimensions to something big (5000+) and see if the image is cropped. If it is, increase the dimensions by an appropriate amount until it contains the whole image. Many archives use a system similar to this. Once you know how, it’s amazingly easy to get past it. BNF France’s national library is another treasure-trove of images. They have digitised some beautiful volumes, but they make it fairly hard to download the hi-res. Fortunately, we can use Chrome’s developer tools to peek under the hood and then use the same principles as above to get full-size jpegs. Find an image and open the console in Chrome. Find an item and flick through the pages. Once you find an image you love, right click and . Click at the top of the Inspector and you’ll see a folder that reads something like: Inspect Sources http://gallica.bnf.fr/iiif/ark:/12148/ btv1b8600236v/f24/0,0,2770,4093/174,/0 This refers to (in order left to right) the , , , , , , . volume folio section coordinates width height resolution rotation Open the top folder, which should contain a lo-res of the full image. . The first two numbers after the folio number will be 0, and the second two numbers will give you the true dimensions Right click the preview image in inspector and open in a new tab. In order to generate a full image, click in the url and change the values after the f23/ to full/full/0/native.jpg. You could also set or keep the first two values at 0, change the second two to the full dimensions (e.g. 2770, 4093) and (in this case 2770). change the number after the slash to the full width Boom. Massive image. University of Chicago The protocol is similar to the above. Find a zoomable image. Inspect the image and open one of the tiles in a new tab. Replace the last command, , with &jtl=x,x &cvt=jpeg This should give you a fairly large version of the whole image. You can also set the width of the full image by adding the command . &wid=x It should be possible to define but, annoyingly, the server appears to have a max limit, and this doesn’t produce a bigger file. wid=full By looking at the source code more closely, we can find out the exact size of the source file. This is a bit more technical, but just take my word for it and look at the screengrab below: 19862! That’s enormous! I tried setting the width as that and while I didn’t get that size, the server did return a file twice the size of the “full” width image. Weird. If you want to do this yourself, drop in 5000 and see what happens. The best option for now appears to be: Inspect the image and find a tile Open the tile in a new tab Replace the bit of the url with the commands jtl &wid=5000&cvt=jpeg This will produce a pretty big jpeg, which should be good enough for most purposes. You could probably print it in a book for instance…But it’s not a super hi-res poster-size image. If anybody knows how to get the original tif, please let me know! Stanford Libraries Like the BNF, this is built on the IIIF protocol. Annoyingly, it’s much tricker to download as there are several roadblocks to get around. For a start, they’ve just completely blocked the ability to create a large image. The function just doesn’t work, so we need to use a handy tool to stitch together all the tiles instead. Nothing is that difficult, it just takes a bit more time. I’ll try to cover as clearly as possible: Part One Open up an image page. Open developer tools. Click the NETWORK tab. Then click XHR. Refresh the page — you should see some files load in the left-hand panel. Select and then right-click and “copy link address”. info.json Here are some images, using Wayne Gretzky as an example: Open Developer Tools, select Network, then click XHR. I’ve circled them in red. Then refresh the page. Select info.json. Right-click and copy the link url. This contains all the relevant information about the image. Part Two Load . This will most likely only work in Firefox, . Firefox not Chrome Go to . Dezoomify Paste in the json link. Wait for the image to load. Right-click and download the image. You may need to wait for a few seconds. The browser won’t like it (Chrome actually prevents it), but you’ll probably be fine, just give it a bit of time to process. Download. A Note on Dezoomify Dezoomify is a great little tool, but I’ve found it often takes a bit of fiddling to make it work. It never seems to detect automatically for me. It’s a good solution for blocked images, and will probably fetch any tiled, zoomed, image you want, but it’s useful to understand the server structure first and know how these archives work. And that’s how you hack into museum websites and download hi-res images! I hope you found this guide useful and entertaining. I actually get more email about this article than almost anything else I’ve written, even though the Medium stats are quite low. I’m guessing it’s a very specific audience who read it. I used to try and answer every email and could usually help out. Unfortunately, I have far less free time these days, so apologies if you emailed and I never got back to you. I admit a few websites have me stumped. It appears as though dezoomify isn’t as reliable it used to be. It is encouraging that so many people are actually using these amazing archives. I hope that more and more institutions will digitize their archives and make the images freely available. ############################################ A little about me I’m a bibliophile and writer who worked at various museums and publishers, then decided the future was digital. I learned a lot about people, design, and writing, and now use that knowledge to create great user experience.