Backup, Backup, Backup

I’ve had a very frustrating (and expensive) last two days. I’m a pessimist who believes that Murphy wasn’t an only child. I usually have not only a Plan B, but Plans C through E. In fact, a pessimist is someone who is actually DISAPPOINTED when Plan A works.

Optimists, on the other hand, don’t have Plan Bs because they are SURE than Plan A is going to be successful beyond anyone’s dreams.

How do you fight Murphy?

I have about 50% of my data on a pair of external 2-terabyte drives. The drives are mirrored, so the information is duplicated on both drives at the same time. If one fails, then you slap in a replacement and the mirror rebuilds itself.  We used this technology on equipment in our telephone switchroom, and it saved our voicemail system and what we called the “cash register,” the equipment that supported our circulation and classified advertising call centers. There’s no more sinking feeling than seeing the alarm, “Drive Fail>’

On the other hand, there’s a great feeling of satisfaction when you slide in the spare and watch your world – and your job prospects – become infinitely brighter.

Backblaze puts out the fire in your tummy

To be even safer, I back up the mirrored drives to a second external drive, and I also use on offsite, “cloud” backup system called Backblaze. You can’t beat the deal. It costs five bucks a month and you can back up unlimited amounts of data. (It was an even better deal for me: Son Adam prepaid a year of the service as a Father’s Day gift.)  The advantage to a cloud backup is that it’s not in your house where it can get stolen, flooded or burn up.

I wasn’t their normal customer. I have so much data that it took about four months to upload it all. One it’s there, though, it constantly monitors the files on my computer and sends changes to the cloud almost immediately.

I just signed up to become an affiliate, so if you click on the Backblaze logo above, or this link, I’ll get credit if you sign up for the service.

If you are an optimist, this is a good Plan B. If you are a pessimist, this will probably slot in at about Plan C or D. Five bucks a month is less than some folks spend in Starbucks a day and it’ll let you sleep a lot better.

So, what happened?

Last month, my RAID drives gave me an alarm that one of them had taken a dirt nap. These drives have names. The bad guy was the primary, the good guy was the secondary.

I ordered a replacement drive under warranty. It arrived in a couple of days. I popped it into the slot and watched with satisfaction as the primary synched up to the secondary in about six hours. All was good for about a month. Then, two days ago, the drive in that slot failed again. The vendor had sent me two drives by mistake, so I pulled out the replacement and replaced it with the second drive.

Just before I turned the drive back on, I decided to do a backup on my external drive G. I kicked it off just before going to bed and it finished just about breakfast time. That means the data exists on the secondary, on Drive G and in the cloud with Backblaze.

Life just got uglier

I pushed the new drive in, powered up the enclosure and got an error message that the drive had to be formatted. Format is a scary command. If you screw it up, you’ll wipe out all the data on the drive. To be on the safe side, I removed the good secondary drive, then formatted the primary. I’d never had to do that before, but…

I put everything back together, turned on the power, then watched, first with satisfaction, then with horror, that the mirror was being rebuilt. The little arrows were going the wrong way. The little arrows SHOULD have been pointing FROM the secondary to the primary. Instead, they were going the other way, meaning that the blank primary drive was overwriting all my data.

The pessimist in me was satisfied

This was a bad thing, but, at least I had the satisfaction of knowing that I had two other sources of the data, both fresh. I logged into my Backblaze account and started a download of the data. It’s a lot faster to restore from a local drive than from the cloud. (If I had REALLY been in a hurry, Backblaze would have sold me an external drive with my data on it.) Downloading everything on that drive was going to take about 50 hours, even with a fast Internet connection.

Here’s where I made a minor error. Backblaze has everything that was on the drive. When I did my backup to local Drive G, I elected not to copy over a couple of directories of nice-to-have-but-not-essential files. I would have been better off to have requested a Backblaze download of only those files instead of EVERYTHING. It would have saved a lot of download bandwidth and time. Still, this is a nice practice run and will give me a good idea of how good the service is.

THEN what happened?

I decided that the problem was probably in the piece of equipment that holds the drives, not the drives. I pulled out the primary drive, booted up on only the secondary, and copied all my data from the local external drive to the secondary. It worked fine. I decided NOT to try to rebuild the mirror.

I called Son Matt, who has been trying to convince me that I should buy a magic Drobo S Beyond Raid 5-Bay USB 3.0/FireWire 800/eSATA/SATA 6GB/S Storage Array with Drobo PC Backup by Drobo  because he had good luck with them both at home and at work. The magic part is that you can put a mixture of drive sizes in it to use old drives or you can upgrade them if you need more storage. Wife Lila is out of town on a cruise ship in Alaska, safely out of cellular range, so I felt safe in ordering the Drobo.

The bad news is that it cost $553.14 (without the drives). (That’s one of the reasons you should click on my Amazon link at the top left of the page. It helps pay for these kind of glitches.)

The worse news is that I clicked on the item to create the links on this page, and saw that the price had DROPPED in the few hours since I had placed my order. A very nice woman said they don’t normally do price matching, but they’d make a one-time exception for me and refund the difference between $553.14 and the new price of $518.49.

 

 

 

Vice Raids and a Skeptical Editor

I guess it’s safe to tell this story now. On my way back home, I passed through Gastonia, N.C., where I worked in the early 70s. One of my favorite SBI (State Bureau of Investigation) officers, sadly, is no longer with us, I found. To keep him from haunting me, I’ll just refer to him as “Vance.”

Bill, the Gazette cop reporter, and I supplemented our meager newspaper incomes by freelancing stories and photos to crime magazines. Gaston County folks had unique and imaginative ways of eliminating each other. I had lots of tasteless pictures and Bill had a knack for lurid prose, so we could sell something every couple of months to turn fifty or seventy-five bucks each.

“You’re making this stuff up”

One of the editors we dealt with in Chicago called and said, “I think you guys are making this stuff up. I have to pass through there and I want to meet you.”

He happened to pick a day when there was a major bootlegging and gambling raid going on, so we took him with us. My SBI buddy, Vance, said, “We know there is gambling going on in that bar, but they know all of us. We need a stranger to go in and observe the gambling so we can get a warrant. Hey, you, Chicago. Go knock on the door and tell ’em ‘Charlie sent me.’ Look around and come back out.”

He was a frail little thing who was obviously more comfortable editing crime than seeing it, but he went in, saw skullduggery and reported back. They got the warrant and busted the place for gambling and bootlegging. The cops were standing around the card table counting the cash they had seized when one of them asked, “Anybody here got a rubber band to wrap this up?” One of the gamblers reached into his pocket, pulled out a roll of cash bigger than what was on the table, slid a rubber band off it and handed it to the cop.

Later that evening, we were over at Bill’s house rehashing the day’s events when the phone rang. It was Vance looking for me.

“I need a favor”

“I’ve got a favor to ask. It’s totally off the record. Can you help me out?”

“Let’s talk.”

“An old woman who had been confined to a state mental hospital died and her body was shipped down here to a funeral home. The family, who hadn’t seen her in years is insisting that the woman in the casket isn’t ‘Aunt Nellie.’ We KNOW it’s Aunt Nellie because the institution’s records say that Aunt Nellie has a club foot. They want someone to go to the funeral home to take a photo of Aunt Nellie and her foot so they can confirm her identity.”

I went with him to the funeral home, shot the photos and handed him a roll of film. “This never happened,” I told him. (Not that the newspaper would have cared anyway.)

“Can I pay you for your time?”

“Nah, I’d rather have you owe me.”

“Well, we took down all those joints today. I have a trunk full of booze. Want some?

“Nah.”

“How ’bout some pot?”

“That’s OK.” I was afraid to see what else he would offer me.

I just “happened” to have a screwdriver

During the raid, I spotted this cool slot machine being carried out. It had a brass Indian head on it that had been polished shiny by hundreds of hands rubbing it for luck. When the courts were through with the case, all of the gambling equipment was consigned to the local landfill where it was to be destroyed by pulverizing it with a bulldozer.

I saw my slot machine sitting waiting for its turn and just “happened” to have a screwdriver with me. I took the Indian off and sidled up to my buddy Vance. “I’d really like for this to follow me home.”

“Sorry, Ken, I have to swear to the judge that I saw the pieces scattered all over the landfill,” he said, tossing it about 10 feet and turning his back.

The Indian head is in a place of honor on my bookshelf. R.I.P Vance.

Oh, and, by the way, the Chicago editor never questioned any of our stories after that.

P.S. Mother has a slot machine story of her own. (It’s at the bottom of the post.)

Farmworkers on Strike

Labor Day got me to thinking about this photo of farm workers on strike in Immokalee, Florida. I spent a lot of time covering migrant farm workers in South Florida and had gotten to know this crew well enough that I talked them into taking a reporter and me into the fields with them.

I spent the day shooting photos and trying to avoid being shot by the farm owner (fortunately for me, the guy’s wife liked me well enough to intervene). My partner spent the day picking peppers. He was paid $18 for a day’s work: $17 of it in cash, and a buck withheld for Social Security by the crew chief. Whether that buck ever made it to Washington is a matter of conjecture. My buddy said, “When I retire, the very first dollar I spend is going to be the dollar I earned picking peppers.”

Not long after that, I went back to Immokalee to cover the workers striking for their pay to be raised from $18 a day to $22.50 a day. The strike was unsuccessful.

I am, if you haven’t guessed, the guy with a camera over his shoulder.

Flood Creates Big Thirst

A Florida Power & Light dike containing a cooling pond at a power plant in Indiantown, Fla., broke in the middle of the night in 1979, washing a railroad locomotive off its tracks and sending residents scrambling to their rooftops for rescue. At first light, I waded into this bar in Port Mayaca because I saw people coming and going from it.

Thigh-deep water didn’t keep them from serving drinks.

The photo moved on the Associated Press wire. This is the original print I transmitted, including the caption. Click on the image to make it larger.

Decoding the caption

WPB-9 – this was the ninth photo we had transmitted from our office in West Palm Beach that day. We might go weeks without moving a photo, so to have transmitted nine meant that it was a big deal.

(AP LASERPHOTO) – was a required slug.

(ps041645mbr) – I think this was some kind of time stamp. “mbr” meant we we a member newspaper, not an AP staffer or PR flack.

MO MO NOT FOR USE IN FT PIERCE, STUART, FT LAUDERDALE OR MIAMI. Local TV out. – This is where I wasn’t playing nicely with the Associated Press. MO Means Magazines Out. (If they wanted to use the photo, they had to negotiate with us directly.) We were in a highly competitive area, so we “embargoed” our photos from being used by any competing media. I got into quite a set-to with the head AP guy who complained after we expanded our embargo to read, “Florida Out; USA Today Out,” meaning that no paper in Florida nor USA Today could use our photos. The AP guy said, “USA Today is a national paper. They don’t compete with you.”

“They’ve got a paper box in front of my office. I consider that competition,” I retorted, standing my ground.

One of my gripes with the AP was that they were very demanding. They wanted the pictures right away, not caring if you had to meet your own newspaper’s deadlines or or you hadn’t eaten or slept for 36 hours. Oh, yeah, they paid you five bucks a picture and didn’t give the photographer a credit line until just a few years ago.

Why am I running this?

Why am I running this? It’s two in the morning, I don’t have the car packed and I’m supposed to pull out for Cape in the morning. It was this or nothing.

The photo won a couple of national awards. Maybe it was because some folks thought it was news that people around Lake Okeechobee COULD pour water out of a boot without having the directions written on the bottom.