Backup Solutions for Media Producers
It’s true for any industry, but especially computer users in the media production field- if you do not have a backup solution in place for your computer systems and all of your media assets, you are sitting on a ticking time bomb. It’s not a matter of IF, but of WHEN you will have a hard drive crash. Not having a backup solution in place as a media producer is like not changing the oil on your vehicle.- it is a virtual kiss of death. Stop and take 30 seconds to ponder on how many hours, DAYS in fact, that you have spent on recording, editing, chroma keying, post-production, rendering, etc. Now imagine, no really; right now, imagine the gut-wrenching feeling you would have if you sat down in your studio only to find that those media assets are missing or corrupted, or maybe it’s JUST the configuration settings of your most used apps. How would you finish that one project you are currently working on, not to mention reference any media assets for future projects? How many deadlines would you miss? How many potential clients would you lose while you are attempting to salvage your work environment? Again, the thought of losing your data in ANY field, such as a common office environment, is a sickening feeling. But it is exponentially worse as a producer in the media field due to the hours of time spent on media projects. I’m a very optimistic person, but I’m also a realist. I’m not trying to point out the worse case scenario. I’m pointing out the inevitable scenario. You MUST have a backup solution TODAY. Don’t put it off another day.

What needs to be backed up? What constitutes a real backup solution to protect your assets?
What to backup:
1. Main internal hard-drive – OS, apps, configurations, and typically your contacts and email.
2. Media assets – raw recordings, effects, plug-ins, project files, fully rendered video, etc. If you feel its important enough to keep on your external “media” hard drive, its important enough to backup.
The common rule of thumb is if you don’t have three copies, you don’t have a backup.
The first of the three copies of your data, of course, is your main hard drive(s) including external hard drives used for mass storage of media files used in projects and that must be readily available for those projects.
The second of the three copies is usually on site and can consist of either a separate external hard drive or DVD data discs and is used strictly for the purposes of backup storage. If you are a Mac user and you don’t have a 1 Tb external drive setup as your “Time Machine”, it’s time to drop $99 on the 1 Tb drive and turn on the Time Machine software included with Mac OS X. Within the first few months of owning my Macbook, due to some faulty non-Apple RAM, I crashed my internal hard drive. I literally purchased a 1 Tb hard drive and made a Time Machine backup the day before the crash. It saved my business from total failure. I got lucky. Don’t wait for some day. Do it today. This will allow you to put the OS, apps, configurations, etc. back into place as if nothing happened within hours or less of the crash and replacing or formatting your internal hard drive. Cheap hardware + free software = saved business. Don’t learn this lesson the hard way. Wisdom is learning from other people’s failures without having to experience the failure yourself.
To make a backup of your external drive(s) to your on site backup drive for Mac OS X, you can use software such as Carbon Copy Cloner . It is “free to use until you trust them” (a.k.a. freeware, please donate). For Windows users, try HDClone. The key to choosing a software package is to ensure that you can backup from one external drive to another, and have the ability to schedule those backups to run automatically. If you depend on your memory to manually backup your data, it won’t be done effectively if at all. Don’t trust yourself as part of your backup solution.
Having a second external copy (hard drive or DVD data disc) of your data on site will give you the ability to recover data back to your main hard drive(s) and restore your work environment to full functionality quickly.
The third of the three copies needs to be off site. In the old days, that meant backing up to a tape drive and shipping the tapes off site to a climate controlled media storage facility equipped with fire suppression. But things have changed for the better in this wonderful age of technology in which we live. Thanks to the Internet, the age of “Cloud Computing” and readily available high-speed Internet connections, meeting the requirement for off site storage of one of your copies has become much easier than the older method of shipping tapes off site. Online backup comes in many flavors. Do a Google search for online backup and you’ll find plenty to choose from. The most commonly advertised online backup company is Carbonite. I personally tried them first because it was the first one I’d heard of due to the advertising. However, I chose not to go with their online backup service based on one major lack of a feature. Carbonite, although its not obvious on their website, does not backup external drives (hard drives, CD/DVD, USB “thumb” drives, etc.) This is huge requirement for implementing this backup solution. You must be able to backup all of your important data to an off site (online) storage regardless of whether its an internal hard drive or one of the many flavors of external storage as mentioned above. This led me to iDrive. This service allows you to back up any drive attached to your computer including mapped network drives and USB “thumb” drives. They have a “basic” free service plan that gives you up to 2GB of storage. This is obviously for trying out the service. You may be able to store your important internal hard drive information with 2GB, but it’s obviously not enough to backup your media assets. You can purchase 150Gb of storage for $49.50 per YEAR, or 500GB of storage for $149.50 per year. The iDrive software allows you to choose what specific folders or files you wish to backup and has a scheduler for automatic backups. It also can run in “incremental backup” mode which is constantly monitoring your drive(s) for files that change, and immediately sends the changed file(s) to the online backup servers. The iDrive service is available for Windows and Mac OS X.
Having an offsite backup gives you the ability to recover data back to your work environment after a catastrophic event such as a fire, flood, or hurricane.
Although not officially part of a backup plan, two solutions for keeping a quick copy of fairly small amounts of data that you may need to quickly retrieve from virtually any location is Dropbox and Evernote. Both are Internet based systems and allow you to quickly store and retrieve data from multiple devices.
Dropbox is for storing files (or sharing files with others) using simple drag and drop within the Finder (or Windows Explorer). Dropbox apps are also available for iPhone, iPad, Anroid, and soon on BlackBerry devices. See www.dropbox.com for details.
Evernote is for storing information (i.e. text, audio notes, small video notes, and photographs such as a business card). The text that you type as well as the text on photos is indexed and easily searchable at a later date. Notes within your Evernote account are accessible via the Evernote.com website or apps running on your Windows or Mac computer, iPhone, iPad, or other mobile devices. See www.Evernote.com for details.
Interesting this one because I am faced with a problem where my storage drives are all full and my MBP is being called in for a re-install. So much for running the drives at optimum usage (and not > 80%) full.
So I am wanting to sort this issue out with one foul swoop.
Carbon Copy Cloner looks like an option for backing up my system drive, although it will not solve my re-installing nightmare to follow soon.
For me, it is not practical to upload my media for backup on a remote drive – not 2TB.
But what I want to do is get 3 x 1.5TB drives and find some balance between redundancy and performance (some RAID setup)
I went to a RED One exhibition/discussion where one of the guys who did part of District9 post was speaking. He spoke about 3 copies of your data. Something crazy like 26TB for typical feature film footage. Scary stuff.
OUCH!!! Man that could potentially hurt a ton! Full drives mean a huge loss in performance – I know the standard is 80% of free space – but I shoot for 60 – 75% max as head room on the drive really makes a difference with read / write speeds. I'm not sure what would cause the call for a re-install, but I'm not a mac guy – I'd clone the drive asap! And move as much as you can off of the drive to a NAS or SAN to free up the space (as you had stated).
The 3 copies thing is true, if you don't have Local, On-Site, and Off-Site you don't have a true backup. The day of could computing gave us the ability to use products like Mozy to do our off-site, but if you don't have the broadband and it would take months to get a full off-site via your connection – you might need to look to a LTO or DLT tape backup solution that you can keep some on-site, and some in a safe off-site (like at a bank). This isn't going to be as inexpensive as a SaaS solution as you have to pay for the hardware too, but it will give you a rock solid way to do it. Also remember that tapes age – and you'll have to change them out over the years.
In building your 3 x 1.5 TB RAID – I'd go with a Drobo and use fast drives (not green) if you plan to edit from these drives, if it's just Backup Storage – then go green. The Green drive are slow, but great for plain storage.
thanks for the Drobo suggestion – I am caught between many rocks in which way to go. If only I could afford something like CalDigits HDPro2, hmmmm
South Africa is getting there with improvements in Broadband – cost and supply. Currently I can only afford a 384kbs line, soon uncapped 4mbs will be affordable and I will start making use of the cloud for media.
My recent post GenArts Sapphire
Oh, and congrats on winning the Sapphire for Shake! Yeah – you'd be slick if I told you what I was paying for 20Mb / 4Mpb upload. — CalDigit make some very solid products, but you pay a premium as they know what you're using them for. (Anything associated with video production seems to have a price tag to go with it) the Drobo is more of a consumer level product (but they have been making in roads toward more pro use).
I also look to the guys who say that they are using them – like Stu Maschwitz ( http://prolost.com/blog/2007/12/8/prolost-holiday… ) just to name one…
Another good thing to do is make monthly ghost images of your system, so that if you do have an issue where system configurations get damaged, or the OS gets corrupted somehow, you can go back in time to when the system was working right, not losing all your hard work. On some systems with the full Adobe suite loaded, and all the other bits and pieces of your normal computing environment going… it can take days to get the system back to normal if there is a problem. A simple ghost restore can bring you back in an hour, versus days…
Very good point Ben! I really need to start doing that on my system.
Good point Ben. Ghost is a great option for Windows for ensuring that your OS, apps, configs, etc. are easily restorable. But if you are using Mac OS X, the built-in Time Machine app that comes with OS X really is the simplest, most efficient method for backing up your OS, configs, apps, etc. It functions while your system is running. It "does its thing" in the background automatically. It restores your OS, configs, apps, and all in a very short amount of time with ease. But if you are on Windows then you definitely should Ghost image your system. Good call!
Even though this is a site dedicated to Media Professionals, and fact that a majority of media pros use Apple products. The strange thing is that 65% of the readers here are on some flavor of a Microsoft product. I guess what you are is who you attract, as I have worked with Apple products (in fact I'm at my office writing this comment on a G5), but my workstation at home is a PC – as I refuse to pay the apple tax.
Regardless of what system you're on – there is a viable system of backing up your system.
How about some discussion on offsite solutions/strategies for those of us cut off from the cloud. We pay for bandwidth ($50/month gets you 10Gig – I can blow that on youtube) in the antipodes, and we get at best a 3rd of the speed. Couple that with the 2 Tb of data I regularly need access to…
And just for grins…who has a backup NLE strategy for when your box gets totaled and you still need to earn? Got a real power protection scheme? Got somewhere to go with all those backup drives? As a Vegas user, I keep one old machine ready to go, 'cause there are NO other Vegas users within an hours drive…there may not be any in New Zealand other than me haha!
Well Deane, there's a ton of ways to skin that cat! The best method might be a LTO drive that will let you ghost your system image to a tape so that you can bring it back to life if your drive goes bad or something else goes horribly wrong. Like Ben was saying – keeping a ghost image can save you a week of work trying to get back to system zero. There are also a few apps that will help you make a system restore DVD set etc, I know of a few shops that do integration – I cannot for the life of me remember what app they swear by, but I'll find it.
Here's the down side of a Tape based solution – it's going to cost a serious amount of green. A 6.4Tb LVD will set you back aroun $4,300 this for a Tape library (auto-loader). This is what HP consider their entry-level automated backup solution.
As to backup NLEs man I'm all ears there as I know most people have invested in their one machine – and when (not if) that goes down, it's a bad time!!!
Great article Kevin – it's really got me thinking. There is a lot of good housekeeping that you point to that's just good professional practice.
As a media weenie – It occurred to me that we need to be giving clients complete backups of projects. I've done this a few times by simply buying a cute little USB drive and dumping everything on there.
I've never lost a client I wanted to keep buy giving them all the raw material – but some of you may want to consider this. Some savvy clients might decide to cut their next project themselves. It's not happened to me, because my clients are unable to replicate the things I do for them that exceed the raw footage.
Alternatively – keep that backup all on it;s own drive, and charge the client for the drive as part of the expendable budget on the job. Drives are now cheaper than BetacamSP tapes, I can't see anyone complaining. Be upfront, it's part of the cost of doing the job safely. I keep all the original footage, transcode to Cineform for editing and keep them in separate drives.
I've often told clients to "keep this safe, it's your only backup in case I get killed by a falling duck (it's a very real risk on the current project)"
On the subject of backup machines – instead of cannibalizing your old NLE for an upgrade, spend the extra $400 to get newer, faster, more reliable parts and software – and keep the old machine running shotgun. It's great to have 2 machines, even if one is slower, when you are rendering multiple projects.
Brad – that LTO will cost me 6 Million Pacific Pesos, or the cost of a small used car. Any other suggestions?
I hope that the copy that you give the client is not the only copy of the project as the adage is if you have a copy you don't have a backup. If you make a copy and give it to the client – but dump the original off your drive (to do more work) and then don't keep two copies yourself – then if the cheep drive fails the entire project is lost.
I had a feeling when recommending the tape backup – the only other then that I could figure would be two SAN system's one that you archive to – and one that you replicate that archive and keep in a safe off-site location. If you are not editing from these drives then you can get away with less expensive drive with larger capacity. I'd also make sure it's a RAID 5 solution so that you can rebuild (would even put in a hot spare). Also it's not impossible to build your own RAID box these day – a few years ago there was a great write up of John Flowers doing such (if I recall correctly).
Wow bro, Thanks for the mini-blog post!
Brad, Maybe you should harvest out some of these comments for a followup article or two
+1 – there is definitely enough subject matter, even before I laid down the mini-blog.
Will do that for sure! I've been kicking around the idea of doing more system / IT stuff – as I've seen the reaction from this post. Things that I've taken notice of is the need of people to talk best practices in regard to file system organization. As well as more work flow — "How I do it" like posts.
Sorry….got a little carried away, eh? Kind of easy to do when you are passionate about technology and creating the right solution for anyone.
RamboJones –
thanks for the heads up – can you email me a screen shot?I’ve just checked it in Opera 1063 and it’s fine. You might need to upgrade (and consider switching to a more main stream browser like Firefox.
Wow! Thank you! I always wanted to write in my site something like that. Can I take part of your
post to my blog?
i just read your article, i found it on google, very useful read, i’ll certain be coming back to this website for a second time.
I’m writing to let you understand what a brilliant experience my friend’s princess gained studying your blog. She realized so many issues, most notably what it’s like to possess a great coaching mindset to let the others without problems fully grasp certain problematic subject matter. You truly exceeded people’s desires. Thanks for imparting these invaluable, trustworthy, explanatory and even cool tips on the topic to Kate.
I precisely wanted to appreciate you yet again. I am not sure what I might have implemented in the absence of those hints shared by you regarding my theme. Certainly was a real horrifying condition for me, but coming across a well-written strategy you processed it forced me to jump over delight. Now i’m happier for your assistance and then pray you find out what a powerful job you are always putting in training men and women by way of your web page. Most likely you have never encountered all of us.
Nice post. I’ll “favorite” the site for future posts like this.
Very good job my dear! The best blog I’ve ever read