Starting and Sharing your Homelab Projects (Include 10G Network Upgrade)

[Mach3.2]

dual port connectx-4 Lx mcx4121 is around $30+ on taobao

newer lithography + you can flash it to 25GbE if you buy the 10GbE version.

you should still be able to saturate 10GbE even on a PCIe2 x4 slot for the x520

 

[TanKianW]

dual port connectx-4 Lx mcx4121 is around $30+ on taobao

newer lithography + you can flash it to 25GbE if you buy the 10GbE version.

you should still be able to saturate 10GbE even on a PCIe2 x4 slot for the x520

I think Intel X520 (DA1 & 2) is on PCIe 2.0 at x8 which amounts to about 32Gbps (4GB/s)

 

[Mach3.2]

I think Intel X520 (DA1 & 2) is on PCIe 2.0 at x8 which amounts to about 32Gbps (4GB/s)

I know, I'm just saying there shouldn't be any bottlenecks if you install it in an x4 slot because desktop platforms commonly only have a spare x4 slot from the chipset vs on server/workstation/HEDT platforms where x8/x16 slots are plentiful.

 

[morimorimori]

For me its a limitation of reusing consumer pc equipment. My ancient sandy bridge board has really limited pcie slots. One x16 one x1 and one legacy pci.

Modern NAS tower isnt much better with the only x4 eaten by the hba card. So it goes in the x16.

 

[xiaofan]

dual port connectx-4 Lx mcx4121 is around $30+ on taobao
newer lithography + you can flash it to 25GbE if you buy the 10GbE version.
you should still be able to saturate 10GbE even on a PCIe2 x4 slot for the x520

Looks like desktops can use these cheap 10G/25G server NICs. Then it is much more difficult for mini PCs -- very limited choices.

Just wondering what kind of CPU you are using for your latest ESXi+pfSense setup. And what kind of form factor (eg: ATX, MATX, ITX, etc). Thanks.

 

[Mach3.2]

For me its a limitation of reusing consumer pc equipment. My ancient sandy bridge board has really limited pcie slots. One x16 one x1 and one legacy pci.

Modern NAS tower isnt much better with the only x4 eaten by the hba card. So it goes in the x16.

Ya you want PCIe lanes you gotta pay the toll

Looks like desktops can use these cheap 10G/25G server NICs. Then it is much more difficult for mini PCs -- very limited choices.

Just wondering what kind of CPU you are using for your latest ESXi+pfSense setup. And what kind of form factor (eg: ATX, MATX, ITX, etc). Thanks.

using an ATX board paired with an i5 12500, all in a short depth 2U case.

 

[xiaofan]

For me its a limitation of reusing consumer pc equipment. My ancient sandy bridge board has really limited pcie slots. One x16 one x1 and one legacy pci.

Modern NAS tower isnt much better with the only x4 eaten by the hba card. So it goes in the x16.

I do not even buy any desktops since 2011 when I bought the Mac Mini 2011 (Core i5-2415M Sandy Bridge CPU). It was my main desktop from 2011 to 2019. Then I bought Mac Mini M1 in 2020 and it is still my main desktop now, one year after the previous Mac Mini was dead. Then I use a Windows laptop (2021 model). I also have quite a few low power Intel CPU based mini PC (4 of them based on N100).

No more PCI-E slots for me...

Most likely I will stick to Mini PC format due to space constraints. No gaming, no Windows VM, no NAS, no transcoding requirements, no interests in smart home devices -- my use case should be simpler. It will probably still run PVE + various VMs (pfSense/OpenWRT, Linux/BSDs) and Linux LxC containers, like my current two N100 mini PCs setup (one with quad 2.5G NICs and one with dual 2.5G NICs).

 

[Henry Ng]

SH just keep ignoring my complaint about slow down during peak hours. Lousy la. They do not even care to explain to me what happened.

 

[xiaofan]

Cheaper N305 mini PC with dual SFP+ 10G ports, MiniRoute R1 N305


Official Taobao shop
【淘宝】https://m.tb.cn/h.ggcKGgiYjXMW2H3?tk=SNYdWznWHIQ MF3543 「超迷R1万兆10G软路由原生板载双光双电四网迷你主机工控机82599ES」
点击链接直接打开 或者 淘宝搜索直接打开

The following Chinese reviewer claims that MiniRoute R1 with N100 CPU can already handle iperf3 at 10Gbps running OpenWRT variant (iStoreOS) and Linux. Windows may have a bit of issue with uploading. He has tested quite a few SFP+ modules. This is probably correct as it was mentioned that N6005 can handle 10Gbps routing and N100 is faster than N6005 in terms of CPU performance.

 

[Henry Ng]

The following Chinese reviewer claims that MiniRoute R1 with N100 CPU can already handle iperf3 at 10Gbps running OpenWRT variant (iStoreOS) and Linux. Windows may have a bit of issue with uploading. He has tested quite a few SFP+ modules. This is probably correct as it was mentioned that N6005 can handle 10Gbps routing and N100 is faster than N6005 in terms of CPU performance.

unless someone can verify this claim

 

[enig.ma]

The following Chinese reviewer claims that MiniRoute R1 with N100 CPU can already handle iperf3 at 10Gbps running OpenWRT variant (iStoreOS) and Linux. Windows may have a bit of issue with uploading. He has tested quite a few SFP+ modules. This is probably correct as it was mentioned that N6005 can handle 10Gbps routing and N100 is faster than N6005 in terms of CPU performance.

I'm looking for a box to install pfsense on to support my 10gbps network, but have now realised the options are all very painful on the wallet especially for 10gbe .

I think this is potentially a solution right? sitting between my modem and rest of network. Installing pfsense on this box and having it act as the router and firewall.

Modem - box - (1) switch (1gpbs) to rest of slower network, (2) 10gbe computer

then in future when prices fall can upgrade the switch to 10gbe and have other peripherals plex, nas etc run on it too for 10gbe bandwidth

 

[xiaofan]

I'm looking for a box to install pfsense on to support my 10gbps network, but have now realised the options are all very painful on the wallet especially for 10gbe.
I think this is potentially a solution right? sitting between my modem and rest of network. Installing pfsense on this box and having it act as the router and firewall.
Modem - box - (1) switch (1gpbs) to rest of slower network, (2) 10gbe computer
then in future when prices fall can upgrade the switch to 10gbe and have other peripherals plex, nas etc run on it too for 10gbe bandwidth

Indeed this Miniroute R1 N100/N305 version is the cheapest 10G capable low power Intel CPU based mini PC I know of now.

N100 version: RMB 998 without RAM and SSD.
N305 version: RMB 1658 without RAM and SSD.
Need to add shipment and GST as well.

I believe there is a technical limitation as well due to limited PCI-E lanes that you will not be able to get 10Gbps for both sending/receiving directions.
【淘宝】https://m.tb.cn/h.gT40vPferIgbFLg?tk=BE0vWAq3aAb HU9196 「超迷R1万兆10G软路由原生板载双光双电四网迷你主机工控机82599ES」
点击链接直接打开 或者 淘宝搜索直接打开

 

[hwzlite]

STH just did a nice review on on Qotom 1U Rackmount (Intel Atom C3758R) .
Got fanless version as well.

https://www.servethehome.com/everything-homelab-node-goes-1u-rackmount-qotom-intel-review/

Key Lessons Learned​

The Intel Atom C3758R is an interesting chip. Whenever we review these Atom C3000 series parts, we hear that they are too slow to be a homelab node, or that they do not have enough performance for storage.

Neither is really true. Netgate, for example, can push over 18Gbps of traffic through the same CPU and NIC setup in the Netgate 8200. Using TNSR, Netgate can get over 15Gbps on IPsec VPN and over 18Gbps with a firewall’s ACL rules using similar hardware. Achieving over 10Gbps on a $300 Qotom network device ($400 configured) is phenomenal.
...

 

[TanKianW]

STH just did a nice review on on Qotom 1U Rackmount (Intel Atom C3758R) .
Got fanless version as well.

This is a (R) revised chipset of C3758. Packs quite a lot of punch as a low-powered network appliance.

Comes build in with lots of NICs. Netgate 8200 running the same chipset too.​

 

[xiaofan]

This is a (R) revised chipset of C3758. Packs quite a lot of punch as a low-powered network appliance.
Comes build in with lots of NICs. Netgate 8200 running the same chipset too.

Qotom Atom C3758R version Q20331G9, Taobao price from their shop: RMB 1970, without RAM and SSD.

C3758 version without RAM and SSD is a bit cheaper at RMB 1830.

They have C3808 version as well but you need to contact them for more details.

【淘宝】https://m.tb.cn/h.gTZlkG0TzLZiYzk?tk=ADv4WAwflOs MF7997 「凌动C3758多网口机器视觉 光口 万兆网口SFP+家庭服务器 Q20332G9」
点击链接直接打开 或者 淘宝搜索直接打开

1U C3758R version without RAM and SSD is at RMB 1999.

【淘宝】https://m.tb.cn/h.ggpTSu9ROiq71iv?tk=FVnIWAwhfj7 CZ0000 「1U机箱凌动C3758多网口机器光口 万兆网口SFP+家庭服务器Q20332G9」
点击链接直接打开 或者 淘宝搜索直接打开

 

[xiaofan]

ZimaBoard seems to be popular as well.

It has PCI-E 2.0 x 4 expansion slot and the reviewer adds a 10G NIC and actually he can get full throughput from the pre-installed CasaOS (Linux), even though the CPU is quite slow ( Intel Celeron N3450 Quad Core 1.1-2.2GHz).

Take note this is not a good candidate to run pfSense/OPNsense, it is probably only good for 1Gbps Fibre internet and you may need to add a 4-port 1G or 2.5G card.

 

[xiaofan]

The above reviewer's latest review of an Atom C3758R based fanless system with 4 SFP+ ports. In terms of networking use cases, we can see Intel Atom C3758R is still quite good, better than Intel N100/N305 based system (more PCI-E lanes).
Product Spec:
https://www.tometek.com/product/tc300-ttg/

 

[kukathe]

I also collect a list of 10g*2 devices for x86 router

凌动C3758多网口机器视觉 光口 万兆网口SFP+家庭服务器 Q20332G9
CPU: C3338R/C3558R/C3758R/C3758
SPF+: Intel X553
Ports: 10g*4 + 2.5g*4
https://item.taobao.com/item.htm?id=749044449757

飞速讯13代4口2.5G网口i3i5i7-1365U万兆软路由爱快x86企业路由器
CPU: 1315U/1345U/1365U
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*4
https://item.taobao.com/item.htm?id=807164705243

飞速讯13寸12代4口2.5G万兆软路由i3/i5/i7-1365U爱快企业路由器
CPU: 8505/1215U/1245U/1265U
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*4
https://item.taobao.com/item.htm?id=800293667441

超迷R1万兆10G软路由原生板载双光双电四网迷你主机工控机82599ES
CPU: N100/N305
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*2
https://item.taobao.com/item.htm?id=804151060728

双万兆软路由10G光口8网4网迷你主机1213代CPU万兆局域网SFP+网关
CPU: 8505/U300E/1240P
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*4
https://item.taobao.com/item.htm?id=722187583654

畅网N100/N200/N305八网/四电双万兆迷你主机软路由工控机爱快
CPU: N100/N200/N305
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*4
https://item.taobao.com/item.htm?id=774501766875

 

[xiaofan]

I also collect a list of 10g*2 devices for x86 router

凌动C3758多网口机器视觉 光口 万兆网口SFP+家庭服务器 Q20332G9
CPU: C3338R/C3558R/C3758R/C3758
SPF+: ??
Ports: 10g*4 + 2.5g*4
https://item.taobao.com/item.htm?id=749044449757

飞速讯13代4口2.5G网口i3i5i7-1365U万兆软路由爱快x86企业路由器
CPU: 1315U/1345U/1365U
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*4
https://item.taobao.com/item.htm?id=807164705243

飞速讯13寸12代4口2.5G万兆软路由i3/i5/i7-1365U爱快企业路由器
CPU: 8505/1215U/1245U/1265U
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*4
https://item.taobao.com/item.htm?id=800293667441

超迷R1万兆10G软路由原生板载双光双电四网迷你主机工控机82599ES
CPU: N100/N305
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*2
https://item.taobao.com/item.htm?id=804151060728

双万兆软路由10G光口8网4网迷你主机1213代CPU万兆局域网SFP+网关
CPU: 8505/U300E/1240P
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*4
https://item.taobao.com/item.htm?id=722187583654

畅网N100/N200/N305八网/四电双万兆迷你主机软路由工控机爱快
CPU: N100/N200/N305
SPF+: Intel 82599ES
Ports: 10g*2 + 2.5g*4
https://item.taobao.com/item.htm?id=774501766875

Just wondering which one are you going to buy?

Interestingly you did not list R86S series (eg: R86S-N series and R86S-U4).

The first one is from Qotom. It is said that the SFP+ NIC is based on Intel X553 chipset.
https://www.servethehome.com/the-ev...outer-and-nas-appliance-qotom-qnap-teamgroup/

 

[xiaofan]

Indeed this Miniroute R1 N100/N305 version is the cheapest 10G capable low power Intel CPU based mini PC I know of now.

N100 version: RMB 998 without RAM and SSD.
N305 version: RMB 1658 without RAM and SSD.
Need to add shipment and GST as well.

I believe there is a technical limitation as well due to limited PCI-E lanes that you will not be able to get 10Gbps for both sending/receiving directions.
【淘宝】https://m.tb.cn/h.gT40vPferIgbFLg?tk=BE0vWAq3aAb HU9196 「超迷R1万兆10G软路由原生板载双光双电四网迷你主机工控机82599ES」
点击链接直接打开 或者 淘宝搜索直接打开

The following Chinese reviewer claims that MiniRoute R1 with N100 CPU can already handle iperf3 at 10Gbps running OpenWRT variant (iStoreOS) and Linux. Windows may have a bit of issue with uploading. He has tested quite a few SFP+ modules. This is probably correct as it was mentioned that N6005 can handle 10Gbps routing and N100 is faster than N6005 in terms of CPU performance.

unless someone can verify this claim

I have placed an order for the N100 version and let's see how it goes. It should arrive by end of next month.

The intention here is not to run PVE + pfSense/OPNsense/OpenWRT like my CWWK N100 box with quad 2.5G LAN ports, but rather using it as a Linux machine (most likely running Debian 12) where I can use it as a server (eg: speedtest server: iperf3, Crusader, etc) and docker containers.