Computer Storage

I mainly use the harddisks in the PCs I run for storage of Hidef movies and TV series.

Current storage situation
MachineBruto*RedundancyNetto*Disks
livingroom PC2.7TBsingle disk2.5TB256GB Crucial M4 SSD, 480GB Crucial M500, 1x 2TB Seagate
NasPC112TB60GB Boot
14x4T RAIDZ2
14x4T RAIDZ2
96TB60GB Intel 330 series, 14x4TB Seagate, 14x4TB Seagate
NasPC296TB120GB Boot
12x8T RAIDZ2
80TB120GB Intel 330, 12x8TB Seagate Constellation
LinuxPC36TBSSD 30G for boot
SSD 60G share
12x3TB RAIDZ2 ZFS
30TB128GB Crucial C300 SSD, 12x3TB Seagate
ServerPC5TBSSD 120G for boot
SSD 5x 1TB RAIDZ1 ZFS
4TB120GB Crucial M500 SSD, 5x1.05TB Crucial SSD
Atom Low power PC256GB1x30GB boot
226G
226GB500GB Crucial BX100 SSD
Total:252TB.212TB.

I store all data to ZFS on Linux. All previous LVM raid 0 volumes have been moved to ZFS pools with RAIDZ2.
RAIDZ1 is like RAID5 but after disk failure recovery is only needed for the data, not the entire disk so it is much quicker than plain RAID5. ZFS keeps checksums on all data to ensure data integrity at all times. For RAIDZ1 there is the space of 1 spare disk, for RAIDZ2 (like RAID6) the space of 2 spare disks is needed and used for CRC data and other ZFS overhead data. Besides that ZFS takes about 5% of the volume size for as additional overhead.
Currently there are 10x2T as spare disks. In the linux desktop I have 12x3T in raidz2. In nas1 there are 14x4T in RAIDZ2 plus another 14x4T in RAIDZ2. In nas2 I have 12x8T in RAIDZ2. The new always on xeonD server has 5x 1TB SSD in RAIDZ1. I keep separate pools in order to be able to swap them out to different PC's. I have removed the 10x2T because 2 disks were failing and 3 more are pending failure.
The main NAS PC has 8 onboard sata interfaces and 24 extra sata interfaces through a sas card, there are 24 regular bays (2x10 + one 4in3 bay) and I have stacked 1 seperate 4 drive bay inside the case. Currently 28 bays are in use. The free PCI-E 4x slot is now used for a 10Gbe Intel X520-DA1 network card with SFP+.
The second NAS PC has 14 onboard sata interfaces, 1x for boot 12x in use for the data disks, 1x free sata. It has a 10Gbe Intel X520-DA2 network card with SFP+.
The XeonD has 6 sata interfaces. 1x boot plus 5x data. It has onboard 10Gbe RJ45.

12x Seagate 8.0TB : ST8000NM0055 (7200 rpm) (sata3, 256MB)
27x Seagate 4.0TB : ST4000DM000 (5900 rpm) (sata3, 64MB)
1x Seagate 4.0TB : ST4000DM005 (5900 rpm) (sata3, 64MB)
12x Seagate 3.0TB : ST3000DM001 (7200 rpm) (sata3, 64MB)
9x Seagate 2.0TB : ST2000DL003 (5900 rpm) (sata3, 64MB) (2x broken)
1x Seagate 2.0TB : ST2000DM001 (7200 rpm)
2x Seagate 2.0TB : ST32000542AS (5900 rpm)
2x WesternDigital 2.0TB : WD20EARS Caviar Green 2TB, 64MB (1x broken)
4x Samsung 1.5TB : HD154UI Green (5400 rpm)
4x Seagate 1.5TB : ST31500341AS
6x Samsung 1TB : HD103UJ
5x Samsung 750G : HD753LJ
4x Samsung 500G : HD501LJ
8x SSD : 60GB + 120GB Intel 330 , 128GB Crucial C300, 2x 256GB Crucial M4, 120GB + 480GB Crucial M500, 60GB Corsair.
7x SSD : 6x 1TB Crucial MX300, 500GB Crucial BX100


This table shows Linux kernel versions and ZFS/SPL versions used currently :
ZFS version (git zfs) kernelSPLZFS
atom644.4.75nonenone
riwilinux4.10.80.7.1-10.7.1-1
riwinas4.4.750.7.0-10.7.0-1
riwinas24.4.750.7.0-10.7.0-1
riwixeon4.4.750.7.1-10.7.1-1


This table shows the storage usage per pool:
drivetotalusedfree%graph bar
atom64:share217G110G107G51%
riwilinux:/pool325751G5012G20739G19%
riwinas:/pool443091G25341G17749G59%
riwinas:/pool543091G18910G24181G44%
riwinas2:/pool868933G34686G34247G50%
riwixeon:/pool03947G2175G1771G55%
total185030G86234G98794G47%


This table shows the health of each individual disk as well as some statistics.
devicevolumediskmodelserialtemphourspower on countreported_uncorrectcurrent_pending_sectoroffline_uncorrectablereallocated_sector_count
riwilinux:/dev/sda-noneC300-CTFDDAC128MAG00000000104602FF3866none61428810002048
riwilinux:/dev/sdbzfs-pool3ST3000DM001-1CH166Z1F1PTZ728 C600312250000
riwilinux:/dev/sdczfs-pool3ST3000DM001-1CH166Z1F1P72Z29 C601312330000
riwilinux:/dev/sddzfs-pool3ST3000DM001-1CH166W1F30SJX29 C516510190000
riwilinux:/dev/sdezfs-pool3ST3000DM001-1CH166Z1F31RN528 C511910250000
riwilinux:/dev/sdfzfs-pool3ST3000DM001-1CH166Z1F1PR6B29 C601212260000
riwilinux:/dev/sdgzfs-pool3ST3000DM001-1CH166Z1F1NLX929 C600312270000
riwilinux:/dev/sdhzfs-pool3ST3000DM001-1CH166Z1F1QAT829 C600912280000
riwilinux:/dev/sdizfs-pool3ST3000DM001-1CH166Z1F1MLHG29 C601012250000
riwilinux:/dev/sdjzfs-pool3ST3000DM001-1CH166W1F39TEE26 C42128600000
riwilinux:/dev/sdkzfs-pool3ST3000DM001-1CH166W1F39TEB27 C42038600000
riwilinux:/dev/sdlzfs-pool3ST3000DM001-1ER166Z501KWLN26 C10812720000
riwilinux:/dev/sdmzfs-pool3ST3000DM001-1ER166Z501H1Q725 C10812760000
devicevolumediskmodelserialtemphourspower on countreported_uncorrectcurrent_pending_sectoroffline_uncorrectablereallocated_sector_count
riwinas:/dev/sda-noneINTEL SSDSC2CT060A3CVMP215605Q1060AGNnone991012910000
riwinas:/dev/sdaazfs-pool5ST4000DM000-1F2168Z300V3KX27 C18202960000
riwinas:/dev/sdabzfs-pool5ST4000DM000-1F2168Z3013WLW27 C19022960000
riwinas:/dev/sdaczfs-pool4ST4000DM000-1F2168Z300K11N28 C526310320000
riwinas:/dev/sdbzfs-pool4ST4000DM000-1F2168Z301GP5Q26 C12802910000
riwinas:/dev/sdczfs-pool4ST4000DM000-1F2168Z301GE5S25 C12802910000
riwinas:/dev/sddzfs-pool4ST4000DM000-1F2168Z304WYTA25 C62770000
riwinas:/dev/sdezfs-pool4ST4000DM000-1F2168Z303Y4ZP25 C62740000
riwinas:/dev/sdfzfs-pool4ST4000DM000-1F2168Z300K08K29 C527810320000
riwinas:/dev/sdgzfs-pool5ST4000DM000-1F2168Z3013VNL28 C18722940000
riwinas:/dev/sdhzfs-pool5ST4000DM000-1F2168Z300V3G127 C19112950000
riwinas:/dev/sdizfs-pool5ST4000DM000-1F2168Z30146PF27 C18692980000
riwinas:/dev/sdjzfs-pool4ST4000DM000-1F2168Z300MC1Z28 C527010320000
riwinas:/dev/sdkzfs-pool4ST4000DM000-1F2168Z300MB1C28 C526710320000
riwinas:/dev/sdlzfs-pool4ST4000DM000-1F2168Z300MB1L28 C527110320000
riwinas:/dev/sdmzfs-pool4ST4000DM000-1F2168Z300K0PQ27 C527210320000
riwinas:/dev/sdnzfs-pool5ST4000DM000-1F2168Z301GNNK26 C14212260000
riwinas:/dev/sdozfs-pool5ST4000DM000-1F2168Z301GDD326 C14202260000
riwinas:/dev/sdpzfs-pool5ST4000DM000-1F2168Z301GRFN26 C14222260000
riwinas:/dev/sdqzfs-pool5ST4000DM005-2DP166ZDH1BGYF25 C4160000
riwinas:/dev/sdrzfs-pool4ST4000DM000-1F2168Z30156CH28 C41248280000
riwinas:/dev/sdszfs-pool4ST4000DM000-1F2168Z30147QZ28 C41228280000
riwinas:/dev/sdtzfs-pool4ST4000DM000-1F2168W300BMH028 C49719680000
riwinas:/dev/sduzfs-pool4ST4000DM000-1F2168W300G8KQ27 C49729680000
riwinas:/dev/sdvzfs-pool5ST4000DM000-1F2168Z3013VLC27 C18742950000
riwinas:/dev/sdwzfs-pool5ST4000DM000-1F2168Z3013W9T28 C18752950000
riwinas:/dev/sdxzfs-pool5ST4000DM000-1F2168Z3013YJL27 C18712960000
riwinas:/dev/sdyzfs-pool5ST4000DM000-1F2168Z3013XE428 C18262960000
riwinas:/dev/sdzzfs-pool5ST4000DM000-1F2168Z300V34227 C19092960000
devicevolumediskmodelserialtemphourspower on countreported_uncorrectcurrent_pending_sectoroffline_uncorrectablereallocated_sector_count
riwinas2:/dev/sda-noneINTEL SSDSC2CT120A3CVMP2152038G120BGNnone189992710000
riwinas2:/dev/sdbzfs-pool8ST8000NM0055-1RM112ZA174S1D32 C7640000
riwinas2:/dev/sdczfs-pool8ST8000NM0055-1RM112ZA16ZH1W30 C7740000
riwinas2:/dev/sddzfs-pool8ST8000NM0055-1RM112ZA174RC130 C7540000
riwinas2:/dev/sdezfs-pool8ST8000NM0055-1RM112ZA16ZE7L32 C7140000
riwinas2:/dev/sdfzfs-pool8ST8000NM0055-1RM112ZA174RLC32 C7540000
riwinas2:/dev/sdgzfs-pool8ST8000NM0055-1RM112ZA174RMR32 C7540000
riwinas2:/dev/sdhzfs-pool8ST8000NM0055-1RM112ZA174RDB30 C7240000
riwinas2:/dev/sdizfs-pool8ST8000NM0055-1RM112ZA16ZRXH31 C7140000
riwinas2:/dev/sdjzfs-pool8ST8000NM0055-1RM112ZA174RE631 C7240000
riwinas2:/dev/sdkzfs-pool8ST8000NM0055-1RM112ZA174SDG31 C7540000
riwinas2:/dev/sdlzfs-pool8ST8000NM0055-1RM112ZA15H4W831 C7540000
riwinas2:/dev/sdmzfs-pool8ST8000NM0055-1RM112ZA174RV231 C7640000
devicevolumediskmodelserialtemphourspower on countreported_uncorrectcurrent_pending_sectoroffline_uncorrectablereallocated_sector_count
riwixeon:/dev/sda-noneCrucial_CT120M500SSD11308092BD91E30 C14121540000
riwixeon:/dev/sdbzfs-pool0Crucial_CT1050MX300SSD1163813FCCF2432 C670660000
riwixeon:/dev/sdczfs-pool0Crucial_CT1050MX300SSD1163813FCD7FE31 C670750000
riwixeon:/dev/sddzfs-pool0Crucial_CT1050MX300SSD11631137A420531 C670860000
riwixeon:/dev/sdezfs-pool0Crucial_CT1050MX300SSD11631137A1D3831 C599250000
riwixeon:/dev/sdfzfs-pool0Crucial_CT1050MX300SSD1163813FCCD4D30 C599250000
devicevolumediskmodelserialtemphourspower on countreported_uncorrectcurrent_pending_sectoroffline_uncorrectablereallocated_sector_count
atom64:/dev/sda-noneCT500BX100SSD11449F000999E33 C229130000