virtualization server build

[dryteletubby]

Having to share my PC with family and friends to use certain software has become increasingly inconvenient.

I am also looking to roll my current proxmox server into 1

Current requirements will be to run 7+ windows VMs at once, some requiring GPU passthrough. ( davinci resolve & capture one)
and the rest will be Debian VMs from my current hypervisor.

I am looking to spend under $1k on the server so probably going to be using 2nd hand hardware.

I have seen a Dell R720 with specs that should meet my requirements however it seems that a average size GPU (gtx 1060, rx 580) will not fit.

An alternative will be to use a standard desktop chassis, after a little searching, I come across the Dell Precision T5600. Are there any other systems that I should look out for, or is there any other place I can buy a used server?
If i were to buy a new unit how much would $1k get me?

 

[Ark Law]

I'm not too sure about your VM needs and its corresponding hardware requirements, but for the T5600, there's quite a few variants of it by the same (Lazada) seller;

$1088 | 2x 2630L [12C/24T] | 64GB | GT630 - https://sg.carousell.com/p/🚚-dell-p...d-2gb-graphics-win-10-pro-warranty-171580669/
$1078 | 2x 2650L [16C/32T] | 16GB | Quadro K2000 - https://sg.carousell.com/p/🚚-dell-p...rranty-7-days-money-back-guarantee-170197239/

 

[dryteletubby]

I'm not too sure about your VM needs and its corresponding hardware requirements, but for the T5600, there's quite a few variants of it by the same (Lazada) seller;

$1088 | 2x 2630L [12C/24T] | 64GB | GT630 - https://sg.carousell.com/p/🚚-dell-p...d-2gb-graphics-win-10-pro-warranty-171580669/
$1078 | 2x 2650L [16C/32T] | 16GB | Quadro K2000 - https://sg.carousell.com/p/🚚-dell-p...rranty-7-days-money-back-guarantee-170197239/

Hmm those are much better than what I found on Lazada... I need to up my game

 

[dryteletubby]

Finally decided on a system. After initial setup, it now resides at my friend's house.

Managed to spend $0 on the software by using a combination of windows server 2016 trials, extra software lisence from friends and mostly foss software.

Installing windows was a pain under proxmox having to install virtualized drivers for networking etc.

Overall it runs 3 windows server VMs and 5+ Linux VMs concurrently without going over 20gb of ram

 

[Kegler]

If it’s not a test lab, run on aws or azure will be more economical

 

[Bumiputera]

Finally decided on a system. After initial setup, it now resides at my friend's house.

Managed to spend $0 on the software by using a combination of windows server 2016 trials, extra software lisence from friends and mostly foss software.

Installing windows was a pain under proxmox having to install virtualized drivers for networking etc.

Overall it runs 3 windows server VMs and 5+ Linux VMs concurrently without going over 20gb of ram

Can briefly share the spec of your build n build cost?

 

[dryteletubby]

Can briefly share the spec of your build n build cost?

It's one of these

https://sg.carousell.com/p/171580669

With a older gtx 950 from a friend and a dual port NIC from my spares.

 

[Ark Law]

Ah, that sweet sweet 64GB ram

Are you a sysadmin?

 

[dryteletubby]

If it’s not a test lab, run on aws or azure will be more economical

It probably is , my friends original idea was to buy a new PC and share with his 3 roommates/classmates for the purpose of video editing (apparently the video encoding stuff can be queued up to encode later) sometimes when they are on tight schedule, they will ask me to encode for them with my PC.

I suggested the idea of having a dedicated virtualization server that can be remote in from their laptops all at once and they agreed. Apart from the windows VMs there are some Linux VMs for VPN server, nextcloud, Pihole, Plex etc.

 

[dryteletubby]

Ah, that sweet sweet 64GB ram

Are you a sysadmin?

Nope, just a guy who likes messing around with those stuff

 

[Koonlax]

Finally decided on a system. After initial setup, it now resides at my friend's house.

Managed to spend $0 on the software by using a combination of windows server 2016 trials, extra software lisence from friends and mostly foss software.

Installing windows was a pain under proxmox having to install virtualized drivers for networking etc.

Overall it runs 3 windows server VMs and 5+ Linux VMs concurrently without going over 20gb of ram

Actually, what's the reason why Proxmox is used in this case? Won't Vmware ESXi (free) be better without having to get those driver headaches?

 

[gld998]

I am running esxi at home as well. All my VMs on my ssd. Running HP 620 x2
Use synology NAS with iscsi to run my VMs

Sent from Old Man Pressing For Retirement using GAGT

 

[dryteletubby]

Actually, what's the reason why Proxmox is used in this case? Won't Vmware ESXi (free) be better without having to get those driver headaches?

the free version of esxi has many enterprise features cut out of it unlike proxmox.

Also I am not a fan of using proprietary software and would rather use a free open source solution. ESXI makes sense if you are studying it for experience for you job.

Also the virtual drivers are not that problematic to install, proxmox has a video guide on their YouTube page

There is a reddit thread on this

https://www.reddit.com/r/homelab/comments/5m9x1f/honest_question_why_use_proxmox/

 

[Rock-kun]

the free version of esxi has many enterprise features cut out of it unlike proxmox.

Also I am not a fan of using proprietary software and would rather use a free open source solution. ESXI makes sense if you are studying it for experience for you job.

Also the virtual drivers are not that problematic to install, proxmox has a video guide on their YouTube page

There is a reddit thread on this

https://www.reddit.com/r/homelab/comments/5m9x1f/honest_question_why_use_proxmox/

Then why even bother with Proxmox? Just compile a kernel with Xen extensions and use aby distribution as a dom0.

Or even better, use the kernel's own KVM and create the VMs with hand written scripts.

 

[dryteletubby]

Then why even bother with Proxmox? Just compile a kernel with Xen extensions and use aby distribution as a dom0.
Or even better, use the kernel's own KVM and create the VMs with hand written scripts.

Because I don't have all day and proxmox works perfectly well for its use case.


Also it will be managed by my friends most who never heard of linux before.

 

[weiyang76]

sounds like what you're doing involves some form of video, sharing for entertainment. have you interconnected your homes together so that each other's television or players can read from your plex?

 

[dryteletubby]

sounds like what you're doing involves some form of video, sharing for entertainment. have you interconnected your homes together so that each other's television or players can read from your plex?

Plex can be accessed outside its network. By default it uses upnp to port forward itself and you can share your server with your friends via their username or email.

 

[Soft Shell Crab]

wah interesting thread..

i was contemplating on rebuilding my lab until the high ram price put me off.. 1088 for dual xean and 64gb ram is kind of neat..

so u did the gpu passthrough??

 

[dryteletubby]

wah interesting thread..

i was contemplating on rebuilding my lab until the high ram price put me off.. 1088 for dual xean and 64gb ram is kind of neat..

so u did the gpu passthrough??

The GPU passthorugh only works for 1 VM at a time. Although currently not an issue, I may consider adding another GPU to the system in the future.

 

[Soft Shell Crab]

The GPU passthorugh only works for 1 VM at a time. Although currently not an issue, I may consider adding another GPU to the system in the future.

Hate it when vmware only allows gpu virtualization with nvidia k2, k3 graphics card.. which is out of reach for most home labs..