What do you think about buying second hand disks and using higher redundancy?
For example 4x 16TB in RAIDz2? Is anyone using something like that? How’s it performing, reliability-wise?
E: Thanks all for the opinions and information!
My current setup is eight 18TB Exos drives, all purchased from Amazon’s refurb shop, and running in a RAIDz2. I’m pulling about 450MB/s through various tests on a system that is in use. I’ve been running this about a year now and smartd hasn’t detected any issues. I have almost never run new drives for my storage and the only time I’ve ever lost data was back when I was running mdadm and a power glitch broke the sync on multiple drives so the array couldn’t be recovered. With zfs I have even run a RAID0 with five drives which saw multiple power incidents (before I got a redundant power supply) and I never once lost anything because of zfs’ awesome error detection.
So yes, used drives can be just fine as long as you do your research on the drive models, have a very solid power supply, and are configured for hot-swapping so you can replace a drive when they fail. Of course that’s solid advice even for brand new drives, but my last set of used drives (also from ebay) lasted about a decade before it was time to upgrade. Sure, individual drives took a dump over that time, this was another set of eight and I replaced three of them, but the data was always safe.
I got the same setup with eight 18TB Exos drives running in a RAIDz2 with an extra spare. Added to this though I got another vdev of eight 12 WD reds with another spare.
With this I can have 2 drives fail in a vdev at any point and still rebuild the pool. Though if more than 2 drives all fail at the same time the whole pool is gone.
But if that happens I have a second NAS offsite at my bro’s place that I backup specific datasets. This is connected with tailscale and a zfs replication task.
I dunno, like I said zfs is pretty damn good at recovery. If the drives simply drop out but there’s no hardware fault you should be able to clear the errors and bring the pool back up again. And the chances of two drives failing at the same time are pretty low. One of these days I do need to buy a spare to have on hand though. Maybe I’ll even swap out one drive just to see how long it takes to rebuild.
Do it. The last thing you need during a rebuild is the stress of not knowing how long / other issues with your specific setup.
It’s only "disaster recovery* if you’ve never practiced… orherwise it’s just “recovery”
It all depends on how safe you want your data to be.
Second Hard drives should be fine with enough redundancy.
I’d rather run 2 secondhand drives in Raid 1 than a single new drive.
I swear I misread “second hand dicks” and was so confused
“Get yer dicks here, fresh dicks, only slightly used!”
“Tired of having two hands but only one dick? Get your second hand dicks here! Big or small. Black or white. Our state of the art facility has dicks of every shape and size! Call now to order today! The first 30 callers will receive a bonus Mystery Dick! CALL 1-800-2ND-DICK NOW!”
Is that a pickup line? Lol
I guess Freud was right
I’ve had great experiences with exactly one vendor of second hand disks.
Currently running 8x14TB in a striped & mirrored zpool.
I wish this was an option for Europe. Once you slap VAT and shipping, you end up paying more than for new disks. :(
I can proxy for you.
They don’t charge me tax and only $15 shipping. Then shipping within the EU is 15 euros max
How does this work, some loophole or a business customer? You can drop some info in a private message if you don’t f feel like posting in public. Re server part deals, I am not sure if this is always the case, but the current selection of disks is 90% helium (Exos etc) HDDs, a few IronWolfs which are too large (20TB) and basically that’s it. My DIY NAS is unfortunately in the apartment and I’m reluctant to try He disks due to the intensive sound profile.
Pm
I’m running 160tb of refurbished Exos right now.
I throughout the years
2 x 10tb
2 x 14tb
3 x 16tb
12 x 18tb
8 x 20tb
I’ve only had 2 x 16tb fail within 500 hours. All other disks have 7k+ hours and are running fine.
As long as you manage your backups properly, you won’t need to worry.
Bought mine through server part deals. Their 2 year warranty is so painless. Shoot them the SN and smart data and you just swap disks.
If they don’t have the disk they just refund you completely.
This sounds pretty great. If reliability can be mitigated via software, which it seems it can, then using old parts might even be more environmentally friendly than buying new ones. 🤔
I have 2 x 20tb mirrored for hot storage
2 pools x 3 x 20tb in Z1 for warm backup.
And I have 2 x 14tb for cold storage
2 x 18tb at a remote location
All are refurbished drives
There seems to be two types of homelabbers with regards to storage:
- Those who take storage redundancy seriously
- Those who don’t seem to care
I’ve made the mistake of asking the second group what they thought about types and quantities of storage, and I got quite a few “why are you concerned?” type questions. My guess is that they regard obtaining data to be free/trivial, so storing it redundantly is a pointless cost. I’ll just say that I don’t share their cavalier attitude.
This setup is my personal goal, and I think refurbished drives are the best way to go about it (provided they are reasonably taken care of). If you’re working in a redundant setup, the age of the drives matters a lot less.
wow i wish in my country there was a company like this, with those prices
If you keep an eye out for sales, you can get new drives for not much more than used. I got two Seagate Exos X20 20TB drives for around US$240 each on sale. One from Newegg and one from ServerPartDeals.
Regardless of if you buy new or used, buy the drives from multiple different suppliers as it makes it likely that they’ll come from two different batches. You don’t want an array where all drives came from the same batch since it increases risk (if there was a manufacturing issue with that batch, it’s possible all drives will fail in the same way)
I’m thinking even different drive brands/models.
I would check out serverpartdeals as they’re pretty reputable. But for any used drive, I would make sure that you have a limited warranty or at least some sort of return policy. Once you get the drive, run badblocks on it, which will check for… bad blocks.
Hot damn these are cheap!
For $600 I could get 32TB array in:
- 4x 16TB manufacturer recertified, 2-disk redundancy
- 3x 16TB new, from interesting sellers, 1-disk redundancy
A 1-disk redundancy 32TB array sold from Newegg would be closer to $900. I could get 3-disk redundancy 32TB array from these guys for that much. 🤔🤔🤔
Regardless of where you get your secondhand drives do yourself a favor and make sure they package them correctly (antistatic bag, 1-2inches of bubblewrap and a cardboard box) by messaging for that. That’s my biggest complain when I brought used drives. Think Serverpartdeals and goharddrive are the main eBay sellers with great reps but I sadly haven’t done business with them so can’t verify
In my experience both new and used drives either fail within the first few weeks or they go on foreverrrrr…
For hard drives I’d never trust them used with data I care about. Especially big drives like that that would take AGES to rebuild.
For enterprise grade SSDs I’d kinda yolo it for a system I care a bit less for, or as a cache drive. But not HDDs.
What if you can do a 2 or 3 disk redundancy?
The biggest fear would be when you’re rebuilding, you’re putting extra stress on the other drives, thereby increasing the risk of them, too, dying.
I suppose using mirror vdevs technically also puts stress on drives during rebuilding, however it should be significantly less than on drives in RAIDz.
4 of my 14tb drives are from server part deals, 2 10tb are old shucked WD. Have had no issues over the 4 years so far.
Thanks! I’ve been running 5x16T from SPD for over 6 months with zero issues.
Make sure there is a warranty/decent return policy and test obviously as others have said…but I’ve bought more 3 and 4TB HGST drives than I care to admit and have very rarely had any issues. At the price you can find even larger TB sizes for I personally consider it worth the gamble for certain use cases.
Like everyone else I’d be skeptical of used disks. I’d also go for a larger array than 4 drives to have less of it redundant. Like 6+2 or 5+3 instead of 2+2.
