標題: DIY 24Bay NAS (unRAID) [打印本頁]

---

作者: mwpmo    時間: 2012-6-11 09:52     標題: DIY 24Bay NAS (unRAID)

本帖最後由 mwpmo 於 2013-7-5 17:01 編輯

Since my old 15 Bay NAS was running out of space, I decided to upgrade it to 24 Bay.

My Old 15Bay NAS


New 24Bay Case


Inside View


Using 3 SATA card (8 Port x 2 + 4 Port X1) and 5 on-board SATA ports (Total 25 Ports)


Main cooling : 3 x Delta Fan with Speed Control to keep it silent.


Finished


======
System
Motherboard : ECS A885GM-A2 v1.1
CPU : AMD Athlon X4 605e (45W)
RAM : Kingston 4G DDR3-1333 x 2
PSU : Antac HX650 (650W)
SATA Card A - Supermicro AOC-SASLP-MV8 PCI-e 4x (8 Port)
SATA Card B - Supermicro AOC-SASLP-MV8 PCI-e 4x (8 Port)
SATA Card C - SYBA Sil3124 PCI-e 1x (4 Port)

Storage
System : Sony 4G USB Flash Disk
Data : Seagate 3TB x 6, Seagate 2TB x 5, Hitachi 2TB x 8 (44TB RAW) (41TB protected in one Volume)
Cache : OCZ agility 3 120GB SSD

OS : unRAID 5.0rc4

======

圖片附件: DSC00043.JPG (2012-6-11 09:37, 92.71 KB) / 下載次數 268
https://www.hkepc.com/forum/attachment.php?aid=1382522&k=f528f1551a7283a73b19531a3143680d&t=1782560834&sid=upzFzc0aos



圖片附件: DSC00044.JPG (2012-6-11 09:37, 107.76 KB) / 下載次數 210
https://www.hkepc.com/forum/attachment.php?aid=1382523&k=f8fb914b9397ed1c71b180fdaaa525fd&t=1782560834&sid=upzFzc0aos



圖片附件: DSC00045.JPG (2012-6-11 09:37, 110.71 KB) / 下載次數 304
https://www.hkepc.com/forum/attachment.php?aid=1382524&k=85dcc1b5458b960c5879f6c7a73ceb82&t=1782560834&sid=upzFzc0aos



圖片附件: DSC00046.JPG (2012-6-11 09:37, 106.07 KB) / 下載次數 268
https://www.hkepc.com/forum/attachment.php?aid=1382525&k=11387b48d365a33853b10858a2962e3a&t=1782560834&sid=upzFzc0aos



圖片附件: DSC00047.JPG (2012-6-11 09:37, 99.99 KB) / 下載次數 236
https://www.hkepc.com/forum/attachment.php?aid=1382526&k=259d6072461719469a611076015d1457&t=1782560834&sid=upzFzc0aos



圖片附件: DSC00048.JPG (2012-6-11 09:37, 71.31 KB) / 下載次數 178
https://www.hkepc.com/forum/attachment.php?aid=1382527&k=11e28720a870df9687463184cd4358a1&t=1782560834&sid=upzFzc0aos



圖片附件: DSC00049.JPG (2012-6-11 09:37, 73.54 KB) / 下載次數 262
https://www.hkepc.com/forum/attachment.php?aid=1382528&k=1633340ba842c2d7c71b12619fec01a4&t=1782560834&sid=upzFzc0aos



圖片附件: DSC00050.JPG (2012-6-11 09:37, 85.8 KB) / 下載次數 223
https://www.hkepc.com/forum/attachment.php?aid=1382529&k=72ee47c4e47802e64276f0f3dd968ecd&t=1782560834&sid=upzFzc0aos

---

作者: mwpmo    時間: 2012-6-11 09:52

本帖最後由 mwpmo 於 2012-6-13 00:09 編輯

UI of unRAID (with simple Feature Plugin)

I just capture some important page only

Array Management


System Setting


Disk Health


Disk Stats


System Stats


=====

圖片附件: unRAID01_resize.jpg (2012-6-13 00:05, 91.74 KB) / 下載次數 426
https://www.hkepc.com/forum/attachment.php?aid=1383629&k=b98851711829ae3a8a8d73acc63ed836&t=1782560834&sid=upzFzc0aos



圖片附件: unRAID02_resize.jpg (2012-6-13 00:05, 29.77 KB) / 下載次數 251
https://www.hkepc.com/forum/attachment.php?aid=1383630&k=ddc2d5899b3f35761a3227134640397e&t=1782560834&sid=upzFzc0aos



圖片附件: unRAID03_resize.jpg (2012-6-13 00:05, 36.23 KB) / 下載次數 200
https://www.hkepc.com/forum/attachment.php?aid=1383631&k=4fd3949cde6a30746c3a276ef935f37e&t=1782560834&sid=upzFzc0aos



圖片附件: unRAID04_resize.jpg (2012-6-13 00:05, 67.56 KB) / 下載次數 265
https://www.hkepc.com/forum/attachment.php?aid=1383632&k=7830b0311931bc4f2abcccf7f91c6ce7&t=1782560834&sid=upzFzc0aos



圖片附件: unRAID05_resize.jpg (2012-6-13 00:05, 39.62 KB) / 下載次數 222
https://www.hkepc.com/forum/attachment.php?aid=1383633&k=bdd54fac68b06c62d36eb9ba32ab34e4&t=1782560834&sid=upzFzc0aos

---

作者: mwpmo    時間: 2012-6-11 09:52

Reserved for further Posting (2)

---

作者: mwpmo    時間: 2012-6-11 09:52

Reserved for further Posting (3)

---

作者: 風聆草    時間: 2012-6-11 09:57

本帖最後由 風聆草 於 2012-6-11 16:27 編輯

Sorry 睇錯野 !

---

作者: bluecats    時間: 2012-6-11 10:48

Ching, What is your OS?

---

作者: mwpmo    時間: 2012-6-11 11:18



unRAID 5.0rc4

---

作者: fred2088    時間: 2012-6-11 13:20

C.Hing What kind of data to store ?!
Thanks

---

作者: mwpmo    時間: 2012-6-11 14:12

Media File

---

作者: cfsimon    時間: 2012-6-11 14:37

真係是強勁的media storage...............原來有d咁既機箱. ching 係 photographer?

---

作者: SEMAJ    時間: 2012-6-11 14:40

好強大喔, 會唔會好食電架??

---

作者: mwpmo    時間: 2012-6-11 14:41



No la! Just like to take photo.

---

作者: SEMAJ    時間: 2012-6-11 14:44

放曬24隻HD會唔會前排勁重, 會不會好容易翻筋斗呀??

---

作者: mwpmo    時間: 2012-6-11 14:49



Since the case itself is quite heavy, not a problem.

But when I move the case, it is better to remove all the harddisks from the hotswap bay first in order to reduce the weight.

---

作者: fatfatman    時間: 2012-6-11 16:21

好奇一問 , 家用 NAS 15 bay 都應該好夠用 , 還加建 24 bay , 放什麼 data ??

---

作者: 風聆草    時間: 2012-6-11 16:30

你隻火牛幾多 W ?

---

作者: mwpmo    時間: 2012-6-11 16:57



Not much.

All Harddisk will spin down in sleep mode, when no read/write activity for an hour, system loading just less than 100W.
(With the help of the low power AMD 605e CPU, 4 cores only need 45W max)

Even all harddisk spin up for read-wirte, it just less than 250W.

But, with the good design of the unRAID OS, only the data disk that have the data I access with spin-up, no need to spin up all drive.

---

作者: mwpmo    時間: 2012-6-11 16:58

本帖最後由 mwpmo 於 2012-6-11 16:59 編輯


Different kinds of Media file.

---

作者: mwpmo    時間: 2012-6-11 16:58




    650W

---

作者: liondog    時間: 2012-6-11 20:42

CHING, 好壯觀, 有冇行raid呀?  total 幾多gb?

---

作者: ltangleo    時間: 2012-6-11 20:53

C hing 你d files 有無encryption 保護到ga?

保護...
1. 係 外邊能否 access 到如 security hack, malware, virus etc.
咁呢個就要看個 OS + application
如 Linux 或 windows + antivirus etc
咁我end user... linux d 人居然話唔洗anti virus,
win7 我依靠 kasper.....

2. 人地用槍指住你攞走你部野,
佢得手后能否讀到你d file?
我自己有用truecrypt.

咁的話我先放心lor.
如果唔係咁大個目標。。。。。。

---

作者: mwpmo    時間: 2012-6-11 22:08



有行raid

RAID OS : unRAID 5.0rc4  

(44TB RAW) (41TB usable in one volume)

---

作者: fred2088    時間: 2012-6-11 22:51

how long does it requires to rebuild ?!

---

作者: mwpmo    時間: 2012-6-11 23:03



Tried to remove a 3TB harddisk and place it back, just take about 10 hours to rebuild.

---

作者: fred2088    時間: 2012-6-11 23:17

回復 24# mwpmo


    is that 3T HD really go bad ?!

---

作者: mwpmo    時間: 2012-6-11 23:34



No! I just want to test the rebuild process.
I remove a 3TB and replace it with another 3TB harddisk to let the system rebuild that member.

---

作者: tl0314    時間: 2012-6-12 01:28

師兄的 sas to 4 sata 的線邊到賣?

---

作者: jwschow    時間: 2012-6-12 05:00

1. HDD係唔係hot swap? 及自動rebuild?
2. 個case係咩牌子/型號?
3. 個HDD mount係跟case? 另買? 係咩牌子/型號?

---

作者: mwpmo    時間: 2012-6-12 06:48



Taobao

---

作者: mwpmo    時間: 2012-6-12 07:20

本帖最後由 mwpmo 於 2012-6-14 07:37 編輯


bought from Taobao
24盤位熱插拔 4U服務器機箱
RMB 2,100

---

作者: 炎冬    時間: 2012-6-12 09:18

會行什麼OS多? thanks

---

作者: mwpmo    時間: 2012-6-12 09:30



NAS itself have its own OS - unRAID 5.0rc4

For clients, I have windows, OSX & Linux on PC, iPhone & iPad and several media players like AppleTV, OPPO BD player, HiMedia and multimedia TV.

---

作者: 忌廉麻美    時間: 2012-6-12 10:50

回復 1# mwpmo

嘩 ! 好強 ! 留個名先。

見到你第六張圖 (Finished 圖) 左手面仲有幾隻 NAS ，真係 NAS 專家

我想問吓你隻舊 (15 Bay) 係現成買定係用 ATX 箱改裝 ? 可否 post 一些圖 ? Thanks !

---

作者: mwpmo    時間: 2012-6-12 11:12

本帖最後由 mwpmo 於 2012-6-12 11:19 編輯


I tried QNAP, Synology and even Intel NAS, finally I used unRAID and I find unRAID is the best for my usage.

For my old 15 Bay NAS, I bought 3 x 5Bay hot swap module from Taobao and put them in a Cooler Master Case with 9 x 5.25" Bay.

My friend bought 4 x 5Bay hot swap module and put them in a Antac Twelve Hundred to make a 20 Bay NAS.

No need to 改裝

---

作者: mwpmo    時間: 2012-6-12 11:30

本帖最後由 mwpmo 於 2012-6-12 11:31 編輯

The main problem for those NAS was that they have to use RAID5 (or RAID6 in some model) for 5 or more bays.
In case more that one harddisk fail (more than 2 in RAID6), I lost EVERYTHING on the RAID. (I tried once in my QNAP TS-509).

For unRAID, it a JBOD with parity protection.

If one hardisk failed, I can fully recover all the data within a few hours. (my QNAP TS-509 takes nearly 2 days to rebuild the RAID)

Even 2 harddisks failed at the same time in my disk array, I just lost the data on those failed disk, but I still can access all my data on other disks.

---

作者: 炎冬    時間: 2012-6-12 12:26




    unRAID個OS好用嗎? 有沒Screen Shot可以看下個UI, thanks

---

作者: harry935    時間: 2012-6-12 12:45

Is unRAID linux-based??

---

作者: thomasckau    時間: 2012-6-12 13:44

Ching, where can buy "Supermicro AOC-SASLP-MV8". Thx.

---

作者: mwpmo    時間: 2012-6-12 13:52

本帖最後由 mwpmo 於 2012-6-12 13:56 編輯


好用!
The Web Interface is quick simple and straight forward
(I think the UI is far more easier than other NAS OS like freenas)
(the screenshots were based on unRAID 4.7 Release but 5.0rc4 were similar but enhanced)
http://lime-technology.com/forum ... 0.msg17513#msg17513
(only the RAID setting page)

---

作者: mwpmo    時間: 2012-6-12 13:56



Yes! It is based on slackware. (now kernel version 3.0.33 in 5.0rc4)

---

作者: mwpmo    時間: 2012-6-12 14:06

本帖最後由 mwpmo 於 2012-6-12 14:10 編輯


Cannot found in HK, you can only get it from US (like Amazon or Newegg) (US100each)
I bought it 2 years ago because it is the only cheap 8 ports SATA card that can be supported by unRAID at that time.

It is a PCI-e 4X card and can support HD larger than 2TB (Many RAID card cannot support HD larger than 2TB).

But in the latest version 5.0rc4, many LSI based card were supported.
Like IBM M1015 (OEM version of LSI 9240-8i), you can easily get it from Taobao.
The only problem is that it is a PCI-e 8x card and may have compatibility problem with the first PCI-e 16x slot in some intel based motherboard (that normally for display card).

---

作者: thomasckau    時間: 2012-6-12 14:16

回復 41# mwpmo

Thx Ching information.

---

作者: yyhk    時間: 2012-6-12 15:53

強呀chinghaha::
我成日覺得用usb手指裝o/s 唔多穩陣......
我唔多熟果個o/s, 我見ching 用隻ssd 做cache, 其實可唔可以用ram 做cache o架?

另外好奇想問有冇電錶度用電, 後面2把風扇其實夠唔夠抽.....

---

作者: 小強    時間: 2012-6-12 16:29

MWPMO兄! 係咪用來聽RIP BD用三槍睇戲嫁? 好耐無見啦!

---

作者: mwpmo    時間: 2012-6-12 16:44

本帖最後由 mwpmo 於 2012-6-12 16:50 編輯

USB is quite reliable for unRAID, I use the same USB disk for 2 years, never have a problem.
=====
I use cache drive just to increase the write speed of RAID (by temporary put the file there before the system actually write them to the RAID), I don't think using RAM can cache the large file (bigger than 40GB) I will write to the RAID.
=====
I used the power meter to measure the actual power consumption.
=====
For air follow, those three fans (3 x 12cm) in the middle will provide the main "push" of the airflow.

The air will flow from the front, pass the HDD bay and then go out from the hole as the back, those 2 x 9cm just to ensure the air pass through the CPU heat sink is "faster".

Even I remove the fan at the back, the air pushed by the fan in the middle will still "go out" from the hole at the back.

(I tried to turn off those two 9cm fans at the back, the HDD are still 4X degree  under heavy read/write only)

For a good cooling design, the control the flow of air is much more important than the number of fan or power of the fan used.

You can see from the photo I posted I block the hole between the HDD bay and mainboard are after the cable were installed and rubber seal was used to seal the gap between the cover and the case.

It is to ensure all the air will flow from the HDD bay to mainboard area through the fan smoothly and no air will flow back from mainboard and HDD bay to "slow" down the overall volume of air flow in and out of the case.

---

作者: mwpmo    時間: 2012-6-12 17:15



I sold my Seleco 三槍 projector long time ago.
Now I just use a "very" large LCD monitor to watch movie.
Not only Rip my BD collection, I also rip my DVD and CD collection.

---

作者: joeylo    時間: 2012-6-12 17:27

提示: 作者被禁止或刪除 內容自動屏蔽

---

作者: mwpmo    時間: 2012-6-12 17:40



If you have time to read unRAID forum or another famous AV forum (AVS Froum), you can found some real Monster there.

Server Motherboard with IPMI (remote power management and KVM), 8 core Xeon CPU (real 8 core, no 4C / HT), 32GB ECC Ram, unRAID under VMWare ESX, 80TB storage (84TB RAW) + SSD for VM

---

作者: vc2010    時間: 2012-6-12 19:10

師兄

行raid 5 or 6 會唔會快過行JBOD

有無試過用 OpenMediaVault Virtual Machine (用USB手指開機)

---

作者: mwpmo    時間: 2012-6-12 20:18

本帖最後由 mwpmo 於 2012-6-12 20:21 編輯


Now my unRAID read speed nearly 50MB/s, much more than enough for media streaming, even BD ISO file.

For RAID 5 or 6, consider you have a raid of 20 drive, 2 (or 3 drive in raid 6) or more disk fail at the same time will KILL the RAID and you lose everything. But with unRAID at least you can recover the data for other drive.

Also with unRAID, I can

i) mix drives with difference size
ii) add a new drive easily when you running out of space. (or even remove harddisk if you want)
iii) if all the drive bay were full, I can upgrade a drive to a larger size one. (like 2TB to 3TB) (or even replace it with a smaller one if you want.)

Where you cannot do the same operation in normal RAID 5 or 6 volume.

For my case, I start with 8 x 2TB first, when the unRAID nearly full, I just add one more drive at a time, when 3TB is cheaper, I can add 3TB instead of 2TB,

Now I am running 13 x 2TB plus 6 x 3TB.

If I used normal RAID 5 or 6, I need to buy a lot of harddisk first, llike 20 x 3TB at the beginning in order to create the RAID.

======

For OMV, I tried it before, for RAID function, I don't think it can beat unRAID (also 用USB手指開機).

For media service, unRAID got tons of plugin , DLNA Server, Plex Server, Squeeze Server, iTune Server, or even AirVideo Server that can transcose and stream many differenct format to my iPhone & iPad.

http://lime-technology.com/wiki/index.php/UnRAID_Plugins

For UPS support, not only can shutdown unRAID, it can send shut down signal to all other server in the network like my ESX VM server. No need to buy a APC SmartUPS with Manage Card to do so.

---

作者: vc2010    時間: 2012-6-12 21:54

師兄

有冇行iSCSI呀?電腦抄野入NAS o唔ok? 幾多MB/s?

---

作者: mwpmo    時間: 2012-6-12 22:14

本帖最後由 mwpmo 於 2012-6-12 22:17 編輯


For me, iSCSI is not that useful at my home.

I am not running several ESX servers and use the NAS as share storage to allow VMotion or HA VM.

For PC, I prefer physical harddisk / SSD that is much faster than mount the iSCSI disk on NAS.

=====

For Samba performance,
with SSD as cache drive I can easily get about 100MB/s write speed.
with HDD as cache drive, I can got about 60MB/s
without cache drive, I can get about 40MB/s

Since normally I use BD Drive on my PC to Rip BD, DVD or CD and write the ISO file / uncompressed audio to unRAID, so the write speed is good enough for me.

---

作者: tl0314    時間: 2012-6-12 22:21

回復 29# mwpmo


    能否PM 師兄買sas to 4 sata 線的 taobao店舖

---

作者: vc2010    時間: 2012-6-12 22:35

師兄
unRAID 5.0rc4裝 ESX servers 掂唔掂?可唔可以config bandwidth/link aggregation 去食盡條線?

---

作者: mwpmo    時間: 2012-6-12 22:36



You can search it yourself from Taobao

Keyword : "SFF8087"

But be careful, for miniSAS to 4SATA, the are two types and not compatible  with each other.

Forward Type (正向線) : MiniSAS end connect to miniSAS port RAID/SATA Card (Signal Source), 4 SATA end connect to Harddisk.

Backward Type (反向線) : 4 SATA end connect to SATA port (like the SATA port on Motherboard or RAID card) (Signal Source), MiniSAS connect to Backplate (HDD Bay / Cage).

Don't mix up and  let the seller clearly know what you want.
(many seller don't know the difference between 2)

---

作者: mwpmo    時間: 2012-6-12 23:18



unRAID was designed for NAS (Samba, AFS, NFS), not for ESX's storage (iSCSI).

If you need share datastore for you to setup HA across several ESX hosts, you better find a SAN, not a low-end NAS (like atom CPU) that add iSCSI support.

It just for fun/testing, not for production.

Cause normally the bottleneck of ESX is not the CPU, not the memory, but the disk IO.

I don't think the the iSCSI support that added in SXXXX or QXXX NAS can give you a good performance than a physical hardisk.

(For better iSCSI, you need to have a server lan card that have iSCSI offload engine)

I tried the iSCSI is my QNAP TS-509 (a high end one using Celeron CPU, not ATOM or SoC chip)

Even I user a server lan card with iSCSI offload engine, the disk IO performance is still very poor, so I just simply disable it.

That's why my ESX at home is using a SSD as datastore.

======

But you can run unRAID as a VM gust under ESXi.

Many people in unRAID forum use 24 Bay case like mine to install ESXi, and then install unRAID under a VM guest.

Then use VT-d (they use SuperMicro X9SCM motherboard that support VT-d) to map
i) 3 x 8port raid cards,
ii) 22 hdd that attached to those raid cards
iii) USB port for the Boot Flash of unRAID

directly to unRAID VM

---

作者: mwpmo    時間: 2012-6-13 00:10

Updated post #2 with screen cap of Web UI

http://www.hkepc.com/forum/redir ... 00&pid=27728370

---

作者: wong888    時間: 2012-6-13 10:10

真係強

---

作者: yytse8    時間: 2012-6-13 12:37

Expert on NAS!!
Can add FTP on uuRAID?

---

作者: kimball    時間: 2012-6-13 13:27


求助啊師兄
小弟用緊Zyxel NBG-460N 型號既router
小弟岩岩上網睇，WAN-LAN能力得508Mb/s
即係得63.5MB/s
想問下Router WAN-LAN慢，會否令到抄野入NAS都慢埋？
定係抄野快定慢係睇隻hard disk快唔快？
如果換隻ASUS N56U/N66U
WAN-LAN行超過800Mb/s
會否令抄野入NAS快好多？

---

作者: mwpmo    時間: 2012-6-13 13:45

本帖最後由 mwpmo 於 2012-6-13 13:48 編輯


Yes!
But since main usage of unRAID is large volume NAS for media file, all those ready-made plugins were mainly on media service.

But since it is linux based, you can install ftp package yourself through console/telnet.

---

作者: mwpmo    時間: 2012-6-13 13:48



If you copy file from a PC at home, since it is on internal network, (both PC & NAS on LAN), the WAN/LAN speed of router will not affect the read/write speed of NAS.

---

作者: eel997    時間: 2012-6-13 22:45

c hing, I would like to ask the noise level of your NAS.
THX!

---

作者: mwpmo    時間: 2012-6-13 23:03



It is quite silent, I don't have a sound meter so I don't have the figure to tell you.

I put the NAS above 7 feet from floor level, distance from the NAS to my ears is about 8 feet but I cannot hear the noise from the NAS.

To reduce the noise level, I

i) use rubber screw to fix all fans
ii) put the main fans in the middle of the case.
iii) use speed control to adjust the fan speed to a suitable level
iv) put a 10mm think rubber sheet on the bottom of the case.
v) stick a thin rubber sheet on the inside face of the cover.

---

作者: patman    時間: 2012-6-13 23:10

提示: 作者被禁止或刪除 內容自動屏蔽

---

作者: eel997    時間: 2012-6-13 23:19



That sounds REALLY nice!
Cheers!

---

作者: eh    時間: 2012-6-13 23:30

點Backup

---

作者: mwpmo    時間: 2012-6-14 00:16



Please read post #41

---

作者: mwpmo    時間: 2012-6-14 00:33



No need to backup!

1) I only loss data when 2 or more harddisk2 fail at the same time and the data on the others harddisks are still readable. That's means I will just loss some data only, not all.

2) It just store the ISO image I rip from my Blu-Ray, DVD or uncompressed audio from my CD. I can always rip it again.

---

作者: fred2088    時間: 2012-6-14 01:38

huge media box

---

作者: qaz11    時間: 2012-6-14 02:55

想問問個case同harddisk case係咩牌子同幾銀?

---

作者: mwpmo    時間: 2012-6-14 07:38




  Please read post #30

---

作者: carlkyo    時間: 2012-6-14 12:14

good

---

作者: GbE    時間: 2012-6-14 16:19

Very good share post, many factor also consider .
So Green

---

作者: wilton    時間: 2012-6-14 18:51

Hi

Congratulations!!  I hope you enjoy your new power house.

I have some questions for you about unraid, the OS that you are using on your new baby.

For my understanding, the volume share concept is difference from other regular raid storage system.  If I have a system with unraid OS and 4 1T HDs, and if I create one volume only.  what is the maximum size of this volume?

If you have 24 HDs on your system, do you have to create 24 volumes to fully utilize your system?

Thanks in advance

---

作者: mwpmo    時間: 2012-6-14 19:18

本帖最後由 mwpmo 於 2012-6-14 19:28 編輯


No matter how many harddisks you installed, you can only create 1 Volume in unRAID only.

====

The RAID technology used in unRAID is "JBOD with parity".

In unRAID, you can mix different size of harddisks or even different interface type (SAS, SATA, IDE)

Then you assigned the biggest disk as parity disk and the sum of size of other harddisk will be the size of volume created (and usable)

For example, I have 4 disks
Disk A - 3TB SATA
Disk B - 2TB SATA
Disk C - 1TB SATA
Disk D - 320GB IDE

Then I assign 3TB as Parity, all the rest as Data Disk (1-3), then the size of volume created with be 2+1+0.32 = 3.32TB

======

My Array



圖片附件: Array.jpg (2012-6-14 19:27, 98.99 KB) / 下載次數 105
https://www.hkepc.com/forum/attachment.php?aid=1384574&k=493e6037f8ec3d1fe1f4158996b03294&t=1782560834&sid=upzFzc0aos

---

作者: vc2010    時間: 2012-6-14 20:39

師兄

行JBOD (裝SATA+SAS+IDE硬碟), IDE硬碟會影響成組硬碟表現/速度?會否令到抄野入NAS都慢埋？

唔知example 個total usable space=3.32TB or 6.32TB?

---

作者: mwpmo    時間: 2012-6-14 20:55

本帖最後由 mwpmo 於 2012-6-14 20:58 編輯


Yes! The speed of IO of hardisk will affect the read/write speed of Array.

So don't use IDE or old generation of SATA disk and PCI bus disk controller if you want fast read/write speed.

In my example, the useful speed of the raid is just 3.32TB cause the 3TB disk was used as parity disk.
(Just like in the case of RAID1 (mirror), 2 x 2TB just can give you 2TB usable, not 4TB usable)

We call it 4TB RAW, 2TB usable.

====

Just like my RAID, from the above screen capture 44TB RAW, 41TB usable (that's  mean it can store of 41TB data only)

You can see the Parity Disk (top row) will not be counted, that's why the "used space" & "free space" were empty.

---

作者: vc2010    時間: 2012-6-14 21:01

師兄

想問NAS粒CPU速度的重要性(硬碟>ram>唔係好差cpu)?裝 ATOM 掂唔掂(or 加i3 會好好多)?

---

作者: 炎冬    時間: 2012-6-14 21:19




    太強大了.....家用~~海量storage.

---

作者: chris28hk    時間: 2012-6-14 21:40

Thanks for your sharing...

可唔可以陣中較細容量的hard disk做parity?

---

作者: mwpmo    時間: 2012-6-14 22:16



For read write speed, most impotent is the speed of harddisk & disk controller, Ram & CPU is not that important.

Many unRAID users just use AMD Sempron 145 or Intel E2140  with 1GB RAM to reduce the overall power usage.

=====

I have another unRAID that have 8 disks only (Atom D510) (1GB RAM) to store backup of my personal Data that storage on QNAP NAS,

The speed is quite good

Case : Lian-li Q25 ITX Case
Motherboard : Supermicro X7SPA ITX board (Atom D510) (on board 6x SATA2 )
Disk Control : 1 x 2port ASM1601 SATA3 PCI-e 1x card.
RAM : 1GB
Harddisk : 2Tx 1, 1T x 6 (8TB RAW, 6TB usable) + 1  x 500GB (2.5") as cache disk

Read Speed : about 40MB/s
Write Speed : about 60MB/s (it is faster than read cause I use cache drive)

---

作者: mwpmo    時間: 2012-6-14 22:23



Can Not.

Parity Disk must be the BIGGEST drive..

Cause usable space on a drive member will not larger than the size of parity.

If you use a smaller drive like 1TB as parity, then the available dive space in a 2TB member will be reduce from 2TB to 1TB.

In my example,
Disk A : 3 TB
Disk B : 2TB
Disk C : 1TB
Disk D : 320GB

If you use 3TB as parity, usable space = 2+1+0.32 = 3.32TB
If you use 2TB as parity, usable space = 2+1+0.32 = 3.32TB
If you use 1TB as parity, usable space = 1+1+0.32 = 2.32TB
If you use 320GB as parity, usable space = 0.32+0.32+0.32 = 0.96TB

---

作者: vc2010    時間: 2012-6-14 22:33

師兄

想問問個harddisk邊隻牌子好D?

師兄裝好多死雞硬碟,死雞會唔會穩陣D? 想用死雞Green(慢少少o唔ok)or死雞XT硬碟會好D?

個NAS配WD green行JBOD/ raid會唔會有問題(因為wd green會變速冇恆速，行raid會唔會影響速度同壽命)?死雞Green會唔會有問題?

---

作者: mwpmo    時間: 2012-6-14 22:58

本帖最後由 mwpmo 於 2012-6-14 23:07 編輯


Now the price/size of 2TB & 3TB is nearly the same, so I will consider 3TB.

Hitachi 3TB's price is higher so I will not consider.

WD & Seagate 3TB is available and cheaper but from unRAID forum, many users reported that WD have some problem (but not the latest model) so I better not to buy WD.

So Seagate is my only choice now.

For recommends harddisk model, please go to unRAID forum to have a look.

=====

For  Hraddisk selection, I have some advice on Parity Disk.
Since the read write speed will be greatly depends on the speed of Parity Disk.

Try to get a faster drive (like 7200rpm) for Parity Disk.
(some user even setup a hardware RAID0 for Parity Disk.

When I upgrade my 2TB (7200rpm) parity disk to 3TB.
Since 3TB 7200rpm is not commonly available, finally I got a 5900rpm 3TB, the read/write speed was then reduced by about 10%.

---

作者: vc2010    時間: 2012-6-14 23:49

師兄

unraid行JBOD駁usb連接外置硬碟((慢少少)掂唔掂?

Network分開兩組管理(一組 set 晒192.168.0.xxx for data, 一組 set 晒10.0.0.xxx for storage)o唔ok?直接連線至家中的NAS會唔會有問題?屋企用會唔會一組set晒方便d?

有無試過用HP Microserver N40L.諗住搵部行unraid專責作為儲存/備份會+video streaming,粒u頂唔頂到?4GB ram o唔ok(1GB for unraid+3GB for os/video)?

另外,小弟買左部S記DS1812+連死雞3T.點樣set好？諗住行SHR RAID6裝vm o唔ok?用ssd會唔會好D?

---

作者: mwpmo    時間: 2012-6-15 00:34

本帖最後由 mwpmo 於 2012-6-15 00:35 編輯

> unraid行JBOD駁usb連接外置硬碟((慢少少)掂唔掂?
I don't think USB external harddisk as arrany member is support in unRAID.

> Network分開兩組管理(一組 set 晒192.168.0.xxx for data, 一組 set 晒10.0.0.xxx for storage)o唔ok?直接連線至家中的NAS會唔會有問題?屋企用會唔會一組set晒方便d?

unRAID just support 1 network card and one IP address

> 有無試過用HP Microserver N40L.諗住搵部行unraid專責作為儲存/備份會+video streaming,粒u頂唔頂到?4GB ram o唔ok(1GB for unraid+3GB for os/video)?

I am using an VM in my ESX server as streaming server (and access my video in unRAID via SMB) so I don't know whether N40L is fast enough to do the realtime transcode for streaming.
But if you use it as NAS only, I think it is fast enough but you have to test whether unRAID is support your hardware or not.

> 另外,小弟買左部S記DS1812+連死雞3T.點樣set好？諗住行SHR RAID6裝vm o唔ok?用ssd會唔會好D?

What RAID level to be used and how many volume you want to set is all depends on your usage.
For example
i ) For you important data, you can setup a RAID1 to store it and do a schedule backup to attached USB harddisk or another NAS.
ii) For other not that important data, RAID5 is good enough.

On VM
i) How you want to use DS1812 with your VM, iSCSI or SMB/NFS?
ii) What kind of VM you want to use, ESX? Hyper-V?
iii) What kind of application, database? video straming?

But my advice is that

i) for VM's system or critical data, you better use a SSD/Harddisk,

ii) for data that is not i/o critical, you can put it in NAS and access to via SMB/NFS.

iii) iSCSI in SXXX or QXXX NAS is functional but not fast, don't think those NAS w/ iSCSI can replace SAN.

====
8 bay DS1812 is so expensive, my 24 Bay NAS System (without Harddisk) just need half the price of it.
Will you buy 2 more DX510 module to make it 18 bay?

---

作者: lawlam0909    時間: 2012-6-15 04:51

師兄, unRAID係咪一定要行JBOD with parity嫁?
可唔可以每隻HD獨立咁行?
官網寫Basic得3個Array Width, 即係點? 只可以用3隻HD?
又冇User Level Security, 即係我唔可以set user?

---

作者: mwpmo    時間: 2012-6-15 07:14

> 師兄, unRAID係咪一定要行JBOD with parity嫁?
Yes

> 可唔可以每隻HD獨立咁行?
No. 1 volume only.
If 每隻HD獨立咁行, why you need a RAID?

> 官網寫Basic得3個Array Width, 即係點? 只可以用3隻HD?
You need to buy license
Basic (3 Disks) Free
Plus (7 Disks) USD69
Pro (22 Disks) USD119

I tried the basic version and run through a series of test like raid rebuild, large volume read write test, switch the motherboard to another model, switch controller card and ports, etc to ensure unRAID is reliable before I bought 2 Pro licese (just USD30 more for additional license)

> 又冇User Level Security, 即係我唔可以set user?
Not include in Free version (cause the purpose of free version just for evaluation)
Plus & Pro version of unRAID has User Level Security and pro version got AD support.

--
Reference http://lime-technology.com/wiki/ ... _unRAID_licensed.3F

---

作者: hkepckk    時間: 2012-6-15 08:51

強，想知放左d乜野好野

---

作者: bluecats    時間: 2012-6-15 09:16

Ching, could you share what is the cost without the harddisks?

---

作者: mwpmo    時間: 2012-6-15 09:47

本帖最後由 mwpmo 於 2012-6-15 09:50 編輯


Motherboard : ECS A885GM-A2 v1.1 ($500)
CPU : AMD Athlon X4 605e (45W) ($400) (actually Sempron 145 will be good enough)
RAM : Kingston 4G DDR3-1333 x 2 ($350) (actually 1GB RAM will be enough)
PSU : Antac HX650 (650W) ($750)
SATA Card A - Supermicro AOC-SASLP-MV8 PCI-e 4x (8 Port) ($800)
SATA Card B - Supermicro AOC-SASLP-MV8 PCI-e 4x (8 Port) ($800)
SATA Card C - SYBA Sil3124 PCI-e 1x (4 Port) ($300)

Case: $2800

unRAID Pro License ($800)

Total $7500

Cheaper than a 6Bay NAS from S or Q

====
Actually I just bought a new case and all the other parts was either from my old 15 Bay NAS or retired parts from my old computer.

---

作者: mwpmo    時間: 2012-6-15 09:54

The beauty of unRAID is the easy upgrade path.

You can start small and be big later.

Unlike those NAS from S or Q, I can upgrade the drive one by one

My friend started with a old motherboard with 6SATA port with 6 drive and when the six drives were full, he just spend a hundred for a cheap PCI-e 1x  2 ports SATA card to expend the capacity to 8 Bay and add 2 more harddisk to expand the RAID.

It is in-line upgrade, just spend a few hours to expand the Raid and resync.
No need to move out the data, delete the raid and recreate the raid with additional disk and then move back the data. (like the process in a traditional RAID 5)

---

作者: mcdull    時間: 2012-6-15 10:12

Do unraid support ICH RAID? I have no space slot for SATA adaptor. Is ICH (H61 chipset) capable of doing the parity job? I just need 4 SATA disk and I expect no cache disk.

---

作者: mwpmo    時間: 2012-6-15 10:29



I think those onboard SATA ports will be supported.
You can download the free version of unRAID, install it to a USB Flash.
and test check whether unRAID can "see" your harddisk plug in on-board SATA.

But I think the RAID create under the BIOS of the board (Intel Matrix RAID) will not be supported.
unRAID will see individual harddisk but not the matrix raid created in BIOS.

---

作者: bluecats    時間: 2012-6-15 10:42

Hi Ching, is UnRaid need at least 3 harddisk to setup?

---

作者: mwpmo    時間: 2012-6-15 11:16



No!
Even you can boot up the system w/o any harddisk.

No disk - you can boot up the unRAID system to check the compatibility fo motherboard.
1 disk - you can just setup 1 data disk without parity
2 disks - you can either setup 1 parity + 1 data (like RAID1) or 2 data (JBOD)

---

作者: mcdull    時間: 2012-6-15 12:23

有冇研究過 FlexRAID?
佢應該係同 unRAID 爭客, 但佢冇limit drives 喎.. 平d (for your case)

---

作者: mwpmo    時間: 2012-6-15 13:56

本帖最後由 mwpmo 於 2012-6-15 14:04 編輯


I have take a look on FlexRAID, it is much cheaper and no limitation in no of drive.
But after I read through the information on their web site I decided NOT to try it.
(Main reason is that it is not a standalone OS)

(I never install FlexRAID, so my information stated in here maybe wrong)

=====
Let me tell you what are the factors when I consider a software NAS solution.

Mainly on reliability.

1) Is it an OS or an application?

If it is an application, that's means it must be install on a OS like Windows/Linux.
Will it have compatibility problem?
Maybe not now, but what happens when the OS was updated or NAS application itself was updated?
In addition, there are many version of Windows and Linux (or even Linux distribution), how can software developer can ensure it will have no problem on different Host OS.

In addition, if the OS damaged, the application will also not working anymore, you need to spend a long time to reinstall OS & NAS Application in order to put the NAS online again.

unRAID is a standalone OS taht store on USB Flash
FlexRAID is a NAS application on Windows & Linux.


2) What happens if some hardware fail like motherboard or controller card?

If motherboard fail, in unRAID you can just switch to another Motherboard (no need to be the same model, same chipset or even same CPU family ( you can switch between AMD/Intel).

If you have spare motherboard on hand, you can switch it and the RAID will function in just 10 mins.

But for FlexRAID, if you switch motherboard, I think you need to reinstall OS and then reinstall FlexRAID, I don't think you can do it within a short time.

If controller card fail, same case for unRAID, you can switch to a different model of card with different chipset. (just within mins)

If don't have spare controller, you can just remove the broken controller and disconnected those harddisks link to that card, The you can start the raid for the rest of the disks and access the data on them (but of cause you cannot access data on disconnected disk). When a replacement is available, just put it back and reconnected those harddisks, then all the data will re-online again.

For FlexRAID, I don't think you can do it the same way.


3) What happen if everything go wrong, can I get the data back?

For unRAID, you can pull out any data disk, put in another PC and boot the PC with a Linux Live Disk like unbuntu, all the data stored on that data disk will be accessible and you can copy them out.

So data recovery is quite simple and quick.

But in FlexRAID, I don't think you can do it in that way.

---

作者: mcdull    時間: 2012-6-15 14:07

I think FlexRAID uses similar technology as parity bit but they are not centralize in a single drive.  In such case, recovery process should be similar to unRAID. For the concern of being an application, I think it is quite easy to pack with a tiny distribution of linux and make an image for recovery purpose.  To me, cost is very important and therefore I am still investigating FreeNAS.  iSCSI is also important to me where unRAID is lacking.