Posts Tagged ‘storage’

QNAP Data Recovery Hell…….

Wednesday, May 11th, 2011

It’s never goes easily does it ?!

Somehow, I had managed to almost fill my 1TB drives in my x2 bay QNAP NAS. Owing to my being paranoid about my data, I choose to mirror a pair of x1TB drives for 1TB total storage, rather the create a 2TB spanned volume using both of them.

I was down to a couple of hundred MB of free space, time to take action. I ordered a couple of shiny new Seagate 2TB drives online with the intention of going from a pair of mirrored 1TB drive to a pair of mirrored 2TB drives.

My plan was to removed one drive from the mirror set, and one of the new 2TB drives, wait for it to rebuild, and then replace the second drive and allow a subsequent rebuild to take place. Did not go according to plan :o(

I removed one of the 1TB disks, and then to ensure the 2TB disk would stand a greater chance of working, I upgraded the firmware (dumb dumb dumb !). I then installed one of the new 2TB disks.

The NAS did indeed rebuild/re-mirror with the new drive, but it created a 1TB volume on the 2TB disk. Not entirely unexpected, but not quite what I wanted :o(

Now I needed to get all the data off of the existing NAS 1TB disk onto something else, install both the new 2TB disks, create an empty 2TB volume, mirror it, and re-copy the data back onto the new larger volume. I attempted to connect one of the original 1TB disks to a Windows desktop machine with a SATA converter cabe/kit, and to mount the file system to copy the data off. And here’s where I hit real problems.

I could see the top level folder structure on the disk, but nothing below it ! :o( The QNAP version of EXT4 is a custom patched version that it seems can only be read by their chassis running their firmware. Fair enough, intellectual property and all that, but this was making my life a mite difficult now.

I tried putting the original drive back into the chassis and booting it to copy the files off over the network, but the new firmware update seemed not to like this, it booted ok, but the actual file server part did not kick in, I couldn’t see the device on the LAN to map a drive to.

In the end I had to ssh to the NAS device itself and use the Samba services to run a CIFS mount to my Windows desktop. I then spent several glorious days moving the files off folder by folder till I had them all. Then I put both new 2TB disks in, did a factory reset (including down grading the firmware as it seemed a little….buggy).

Once the device booted up and presented itself as a shiny new empty 2TB NAS, I began the unenviable task of copying all my crap back over…….several more lost days. Moral of the story for me would be:

a) don’t upgrade drivers/firmware for the sake of it
b) when dealing with a *lot* of data, *copy* and then delete, do not use move. even if a 20 stone psycho has a knife pressed to your throat

Ironically as I write this, my 2TB is being eaten into at a rate of knots. Am probably gonna have to buy a bigger NAS. Have my eye on one of these full to the brim with 3TB disks.

possibly all the storage I could need.......?

Home NAS To The Rescue

Saturday, May 23rd, 2009

My 500gb lacie external mac mini storage unit decided it was no longer going to work :o(

The fault seemed to be with the bus interface of the casing, rather than the drive itself. The drive is a bulk standard ide drive which gets converted to a usb port connection on the outside of the case via an internal cross connector.

First off I tried connecting the device to a PC instead of the Mac to see if anything could be seen/salvaged at all (the Mac mini’s role is an mp3 file repository for the Sonos wireless hi-fi units around the home……no Mac mini = no music !! gaaaaaaahhhhhhh :o(

I opened the case and extracted the physical drive and connected it to a PC using a standard ide cable. The PC recognised the drive no problem, but clearly Windows does not understand the Mac OSX file system without some help.

Luckily, macdrive to the rescue. Once installed I could read all files on the mac volume and was able to copy them across to a more reliable drive.

Next step was to provide new storage. Almost losing 10 years worth of music collecting was quite a panic, so I wanted the new solution to provide some piece of mind. enter the Qnap TS209 Pro II nas server.

ts-209 pro ii

The device costs just under £230 from scan.co.uk without drives. Offically Qnap only support the device with 1tb drives fitted, but I have seen reports of people running them with 1.5TB drives (probably 2TB drives by now !). A pair of 1tb seagate drives cost £63 each so the whole thing came in for under £400.

The device is small enough to fit into the little cupboard next to my media unit and runs almost silent, even during write operations. The device is powered by a marvell cpu running at 500Mhz and configuration is managed by a well designed web interface.

Embedded applications include ftp server, web server, mysql database server and more, although I don’t need any of these as I just need somewhere to dump files. Having x2 drives the configuration options are either RAID 0 striping across the x2, which will improve read/write performance, but provides no resiliency, or RAID 1 mirroring which halves the total storage capacity but provides piece of mind.

The initial setup requires a direct ethernet connection from a PC/Mac directly into the units ethernet port. Once you have assigned the device a tcp/ip address you can connect it to the network and finish the setup.

You have the option to select either NTFS, FAT and EXT3 filesystems so you can use it with both PC and Mac/Linux/Unix systems. My only gripe with it would be the pre-configured shares defined on the system. There are shares such as Qdownload, Qweb, Qusb etc. etc. (you get the idea) that you cannot remove. You can however mark the shares as hidden so they don’t show up on the network so this is not a major show stopper.

Performance seems ok. The device has been handling simultaneous read/write requests from me, my flatmate, a visiting friend, a x3 sonos wi-fi players without any blips or stutters. All in all, money well spent and I sleep much better at night knowing my data is duplicated.