prophotolife dot com banner   
Custom Search


  

rss subscribe blue
starting a photo biz pdf
ppl video library
ppl discussion forum

digital workflow: preserve those captures

May 14, 2008 – 2:00 am

dig workflow stages rawDigital Workflow, Stage 1: backing up digital captures

Shooting great photographs means little if you don’t handle your files properly. I’d like to share the outline of my digital workflow, one refined over the past few years at the photo studio. Workflow is a process that takes time and experience to implement and understand. We’ll be taking it a step at a time. This week: properly caring for your RAW digital captures (we are all shooting RAW, aren’t we?).

If you are serious about managing your digital files properly, I should tell you right now that the definitive resource is Peter Krogh’s DAM (Digital Asset Management) book. It gives a thorough examination of the subject be prepared to learn. Get your hands on it if you can (but not our copy, please, because people don’t seem to bring it back once it’s been loaned).

Before diving in too deeply I should mention there are many ways to tackle this topic and new methods and software tools are introduced on a regular basis. My personal photo workflow differs a bit from the studio workflow, which differs from how my business partner, Bob, handles his images. For these reasons I will mention various softwares while trying to speak in more general terms about our process. The goal at this point is to help everyone, whether they have the latest software or must use a freeware download to organize their images.

It is worth noting that newer softwares like Lightroom (and Bridge within Photoshop CS3) can accomplish a number of the tasks that once required multiple softwares. For a personal or small operation they may provide all that you need. You can get Free Trial Downloads from Adobe for both Lightroom and CS3. I own Lightroom but really need instruction from someplace like Kelby Training to get a thorough understanding. It’s on the list…

frwr reader small
We move our date with a firewire card reader.

At Daylight Photo, there are four stages in the life of every digital file prepared for a client:

1. RAW
2. Selected
3. Working
4. Final

So if you’d like to try things the “Daylight Photo way”, create a folder on your desktop right now, while you’re thinking of it. This folder is dedicated to just one job (or set of images), whether we’ve filled a bunch of flash cards or only shot a few photos. Inside this folder create the following four sub-folders: RAW, Selected, Working and Final. I have this folder hierarchy created and sitting empty on my desktop at all times. Then, when I’ve shot some new images, I duplicate this empty set of folders for the fresh photos to go into. I then name the main folder with our specific, assigned job number. Many people use the day’s date as their job / tracking number: 2008_05_13.

I should have mentioned that, before shooting, make sure your camera is set to number files in a continuous sequence, rather than starting over at 0001 every time you start a new series. This alleviates having a bunch of files all named the same thing later down the road.

After you’ve shot your job or series of personal images and filled a flash card or two:

Download the RAW files into the RAW folder on your desktop using the fastest card reader you have available. Downloading from the camera is slow and you don’t want to risk file corruption if the download is interrupted (camera gets turned off or battery dies).

dig wkflw small disk
A quality CD/DVD, a full-sized jewel case andan archival DVD marker are the tools of the trade.

Now, before doing anything else, I temporarily copy the RAW files to an external hard drive. We have a dedicated portable drive with multiple connections for this specific purpose (officially called the LaCie 160GB Rugged Triple Interface Portable FireWire 800/400 USB 2.0 Hard Drive). The RAW files will stay on this drive until a job is completed, maybe a few weeks (or until the drive fills up). This is the fail-safe backup to the backup.

Before even breaking for lunch or reaching for another iced tea, burn a CD or DVD of the RAW files from the desktop. No file renaming, no metadata, no nothin’ else has been done at this point. This disk is our primary backup for the longevity of the RAW files, so we really take care of it. Bob thinks I’m crazy for not renaming the files beforehand but I don’t want to alter any data at all. Call me crazy (it’s okay, he does already).

On the CD or DVD, as close to the center hole as we can get, we write the job number (for you that might be: 2008_05_13) with an archival marker and also “RAW” (see photo). The way I understand it, gases emitted from a regular marker can accelerate the deterioration of storage media. We take no chances and use a specific DVD marker.

Gently place the disk in a DVD case and store it standing up (like books on a bookshelf) to help retain the disk shape. A major goal here is to refrain from touching the recording surface or bending the disk. Using the roomier DVD cases (instead of the slimmer CD cases) gives the disk more room “to breathe”. Bending or twising also greatly contributes to disk damage and can harm the recording surface. If you bend disks like a potato chip when pulling them out of a case, try to be a little gentler next time.

disk small archive dig wkflw
The backup DVD library.

A note on CD / DVDs: I’m not an expert but it’s generally recognized that the re-writable (-RW) variety are not as stable as the one-time (-R) writable disks (more on DVD formats here). We prefer Taiyo Yuden brand CDs and DVDs. Again, from what I hear, this brand is the best quality available outside of the very expensive gold disks. I’m being honest in saying we don’t spring for the very expensive gold ones. Most media (regardless of who “labels” them) come out of just a few factories in China and Taiwan. The Taiyo Yuden are made in Japan and regarded as being of higher quality.

A downside to the Taiyo Yuden disks: they’re generally sold in quantities of 600. For our studio it’s not a big deal but for the hobbyist, well, that’s a lot of media to buy at one time, especially when discount disks are available for pennies at the local office supply store. From MacMall they run $195 for the 600 Taiyo Yuden White Inkjet Hub Printable 8X DVD-R and $169 for the 600 Taiyo Yuden silver lacquer 52x CD-R 6×100 pc spindl.

Whew, that’s it and that’s a lot. Next week it’s on to the next stage of the process: Selecting files for processing.


Related Posts:

  • digital workflow: working files
  • digital workflow: image processing
  • digital workflow: image selection
  • digital workflow: final files, final installment
  • Switching from Apple Mac OS X to Windows Vista ?
  • If this article was helpful then please consider subscribing to pro photo life by email or full feed RSS.

    1. 13 Responses to “digital workflow: preserve those captures”

    2. Hi,

      Good start, interesting article. One thing that I would add is that one should always buy DVD+R not DVD-R for or data preservation. Basically this is because DVD-R is not as good or robust as DVD+R. There is an excellent article on this here: http://adterrasperaspera.com/blog/2006/10/30/how-to-choose-cddvd-archival-media

      By Iceman on May 14, 2008

    3. I’m curious on what your feelings are about converting the Raw files to DNG, before saving. Seems it would cut down on file space.

      By Danny on May 14, 2008

    4. Iceman (great handle, by the way), thanks for the tip on DVD+R, I need to check that article out. I’ve realize an RSS feed can be created for comments on this site, too, so I’ll make that “live” soon. It’s sharing this kind of information that keeps me stoked on photography.

      Danny, I’m a big fan of DNG in theory but haven’t been implementing it. The way I understand it, though, DNG files are actually larger than the original RAW files(?). I believe RAW files converted to DNG also embed the original RAW file, making it a little larger than the original but universally readable.

      If anyone is using DNG I’d love to hear about it because it’s appealing for many reasons (kudos to Pentax for building it into their DSLRs). Great topic.

      By Jim Talkington on May 14, 2008

    5. Ask and you shall receive: http://www.eiserman.net/blog/2008/05/to-dng-or-not-to-dng.html

      It looks like regular DNG is 85% file size and DNG plus embedded RAW is 185%.

      By Iceman on May 14, 2008

    6. Hi,

      Taiyo Yuden DVDs can be bought in smaller quantities (100) from a few trusted online resellers. Rima and Supermediastore seem to be the favorites at http://club.cdfreaks.com/

      Their forum about blank media has lots of hints on resellers and authentic Taiyo Yuden dvds.

      Cheers,

      Luis

      By Luis Gracia on May 14, 2008

    7. Just wondering, why not store the files in a hard drive instead?? Could you offer more explanation??
      Thanks!!

      By Daniel on May 14, 2008

    8. Great piece on DNG, Iceman, I hope interested photogs will click over. You have a nice conversation started on the topic, one well worth pursuing.

      And that’s a hot tip on the smaller quantity CD purchases, Luis. I’m tagging those retailers to check them out. Are you using any particular brand of media?

      As for long-term storage of the RAW files on a hard drive, I always do that for my personal work but not for our studio work (we do have hard drive backups for our Working and Final files). The reasoning will be explained in future posts so details can be explained. The short version is, if in doubt, back it up wherever you can. Everyone has a different level of comfort. My friend Bobby C. backs up to three different hard drives. He also has the worst luck I’ve ever seen with losing information!

      I’ve been tempted to completely abandon CDs and DVDs for storage since hard drives have gotten so darn cheap and are fast to use. Seems like a no-brainer. There’s also a lot of fear that CDs and DVDs aren’t archival. But personally I’ve yet to have a CD/DVD lose information but have seen a number of hard drives go down. And when a hard drive goes down, years of data can be lost at one time. So I still go through burning disks.

      Doing both sure wouldn’t hurt. More to come…

      By Jim Talkington on May 15, 2008

    9. Saw your link on Photoshop Insider Love your site. Will be coming back often. This is a fantastic article, can’t wait to read the rest of the story.

      By Penny on May 15, 2008

    10. Hi again,

      so far I was relying on hard drives. But hard drives have a high rate of failure (apparently higher than advertised by manufactures: http://www.usenix.org/events/fast07/tech/schroeder.html).
      I don’t have a raid array, and if I had one I would probably be less paranoid.

      However, I honestly don’t care much if DVDs are better hard drives for long term storage, I care about having access to my photos in 20+ years. I think that having backups in 2 different media is much safer, and that’s the direction I want to go.

      Recently I did a lot of reading in http://club.cdfreaks.com/ and a couple other places to find the best possible DVDs for long term storage. Everybody seems to agree on Taiyo Yuden, as you pointed out in the article. However it is difficult to find opinions about the new Gold DVDs from Delkin and other manufactures, and even more difficult to find comparisons between these and Taiyon Yuden. So I settle for Taiyon for the time being.

      You can find them in DVD-R and DVD+R. These is another area of debate. I chose DVD+R based on this article:
      http://adterrasperaspera.com/blog/2006/10/30/how-to-choose-cddvd-archival-media

      There are also different series of TY DVDs (YUDEN000T02 and YUDEN000T03), I chose T02 because it is 8x, and that’s the maximum that my burner can do (the newer T03 is 16x).

      Then you have to select Silver Lacquer or White Inkjet, and some other option I don’t remember.

      And finally if you want them wrapped in plastic or in a cake box with spindle, the later being better. This is were I did my mistake (there had to be one! and probably more that I haven’t catch yet), I chose wrapped by mistake and I can tell you lose at least the bottom DVD because the wrapping doesn’t cover the bottom of the pack (that DVD is completely scratched, oh well).

      I trusted the people on the cdfreeks forums about the resellers to use. This is the first time I bought from them. It seems like there are a lot of fake TY out there.

      My plan is too burn at least 2 DVDs of each set of photos and store them in different 2 places (New York, where I live and my hometown in Spain). It’s a bit too much, but it doesn’t take much to do so, and I have peace of mind. I also plan to duplicate those DVDs in a few years, just to be on the safe side. That should be easy enough.

      Best,

      Luis

      By Luis Gracia on May 15, 2008

    11. Sorry for asking, but what software do you use to make the covers for those jewel cases?

      Just asking because the ones I tried to use didn’t print the borders so I wouldn’t know where to cut them :/

      By Celso on May 27, 2008

    1. 1 Trackback(s)

    2. Jul 24, 2008: Trackbacks

    Post a Comment

    All content on prophotolife.com is copyright 2008 prophotolife / Jim Talkington unless otherwise noted