Difference between revisions of "Home Lab"

From Review or Discard at Will
Jump to: navigation, search
(Add in HP Z840)
(→‎resources: add link to Realtek drive install that worked for me)
 
(5 intermediate revisions by the same user not shown)
Line 12: Line 12:
 
===Dell Precision T7600 Workstation===
 
===Dell Precision T7600 Workstation===
 
Swapped out the Xeon E5-2620 for a pair of Xeon QBEB Confidential CPU E5-2680 2.7 GHz 20MB 8-Cores LGA 2011 and 64gig Memory.
 
Swapped out the Xeon E5-2620 for a pair of Xeon QBEB Confidential CPU E5-2680 2.7 GHz 20MB 8-Cores LGA 2011 and 64gig Memory.
 +
===HP EliteDesk 800 G1 TWR Intel i7-4770 3.4GHz===
 +
====Pfsense====
 +
I wanted to experiment with pfsense because I bought a new DOCSIS 3.1 modem that supports 2500 Mbpx on the ethernet port, unlike my current Asus RT-N66U and wanted a more generalized server than my existing cluster. One that would be physically smaller and consume less power.
 +
I started this experiment with Proxmox version 7.3. I bought a dual port Realtek RTL8125B chipset nic from Amazon for rapid delivery while I look for a Broadcom or Intel chipset NIC. The Realtek came up in Proxmox 7.3 without loading additional drivers. However although I was able to PCI passthrough to the Pfsense VM, the VM didn't see the NICs.
 +
 +
=====resources=====
 +
* The NIC https://smile.amazon.com/gp/product/B0B4V6MPHD/ref=ppx_yo_dt_b_asin_title_o03_s02?ie=UTF8&psc=1
 +
* Post about how to use the Realtek as passthrough https://forum.proxmox.com/threads/install-pfsense-with-passthrough-2-nic-doesnt-work.107639/
 +
* STH article https://www.servethehome.com/how-to-pass-through-pcie-nics-with-proxmox-ve-on-intel-and-amd/
 +
* ROM firmware for HP EliteDesk 800 G1 TWR Intel i7-4770 [[:File:Sp103785.zip|Sp103785.zip]]
 +
* uTube re FreeBSD drive update for Realtek for Pfsense https://youtu.be/49OC82Z4qG8
 +
* This is the ticket that worked for me. I can now see the Realtek via pci passthrough in the virtualized pfsense in my proxmox. https://administrator.de/knowledge/realtek-treiber-1-97-00-fuer-pfsense-2-60-ce-und-22-01-oder-22-05-plus-3352223154.html
  
 
===Parts List===
 
===Parts List===
Line 26: Line 38:
  
 
<syntaxhighlight lang="bash" line start="1" highlight="2-3">
 
<syntaxhighlight lang="bash" line start="1" highlight="2-3">
−
root@prox2:~# lspci | grep -i --color 'vga\|3d\|2d'
+
root@pve2:~# lspci | grep -i --color 'vga\|3d\|2d'
−
03:00.0 VGA compatible controller: NVIDIA Corporation GT218 [GeForce 210] (rev a2)
+
03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Cedar [Radeon HD 5000/6000/7350/8350 Series]
 
84:00.0 VGA compatible controller: NVIDIA Corporation GK107GL [Quadro 410] (rev a1)
 
84:00.0 VGA compatible controller: NVIDIA Corporation GK107GL [Quadro 410] (rev a1)
−
root@prox2:~#  
+
root@pve2:~#  
 
</syntaxhighlight>
 
</syntaxhighlight>
  
Line 38: Line 50:
 
[...]
 
[...]
 
root@prox2:~#  
 
root@prox2:~#  
 +
</SyntaxHighlight>
 +
 +
====Passthrough USB (face)====
 +
<syntaxhighlight lang="bash" line start="1" highlight="1,3,5,7">
 +
root@pve2:~# qm set 100 -usb0 host=2-10,usb3=1
 +
update VM 100: -usb0 host=2-10,usb3=1
 +
root@pve2:~# qm set 100 -usb1 host=2-13.1,usb3=1
 +
update VM 100: -usb0 host=2-13.1,usb3=1
 +
root@pve2:~# qm set 100 -usb2 host=2-14,usb3=1
 +
update VM 100: -usb0 host=2-14,usb3=1
 +
root@pve2:~# qm set 100 -usb3 host=2-9,usb3=1
 +
update VM 100: -usb0 host=2-9,usb3=1
 +
root@pve2:~#
 
</SyntaxHighlight>
 
</SyntaxHighlight>
  
 
=====HP Z840 Resources=====
 
=====HP Z840 Resources=====
 
[https://www.youtube.com/watch?v=HKSc5l0cvsw How to upgrade the power supply in HP Z840 to 1125W PSU | Don't make my mistake!] from Art of Server
 
[https://www.youtube.com/watch?v=HKSc5l0cvsw How to upgrade the power supply in HP Z840 to 1125W PSU | Don't make my mistake!] from Art of Server

Latest revision as of 22:35, 10 December 2022

Truenas

Parts List

  • SilverStone Case Storage Series SST-CS380 Black Plastic front door, steel body ATX Mid Tower Computer Case Standard PS2(ATX) Power Supply 8 hot swap SATA bays
  • Supermicro Motherboard MBD-X11SSM-F-B Xeon E3-1200 v5 LGA1151 Socket H4 C236 PCI Express SATA MicroATX
  • Intel Xeon E3-1230 Processors BX80677E31230V6
  • Supermicro 16GB 288-Pin DDR4 2666 (PC4-21300) Server Memory (MEM-DR416L-CV02-EU26) * 2 for 32gig memory
  • Hitachi Deskstar (0F12450) 3TB 64MB 7200RPM SATA 6.0Gb/s 3.5" Desktop Hard Drive 8 of these. I'll swap in some WD Red when I'm done experimenting.

I had a SUPERMICRO MBD-X9SCL LGA1155 Intel C202 Micro ATX Motherboard XEON E3-1230V2 which seemed adequate but I had some strange problems. In the Truenas forums see; Add user results in KDB: enter: panic

Proxmox

Dell Precision T7600 Workstation

Swapped out the Xeon E5-2620 for a pair of Xeon QBEB Confidential CPU E5-2680 2.7 GHz 20MB 8-Cores LGA 2011 and 64gig Memory.

HP EliteDesk 800 G1 TWR Intel i7-4770 3.4GHz

Pfsense

I wanted to experiment with pfsense because I bought a new DOCSIS 3.1 modem that supports 2500 Mbpx on the ethernet port, unlike my current Asus RT-N66U and wanted a more generalized server than my existing cluster. One that would be physically smaller and consume less power. I started this experiment with Proxmox version 7.3. I bought a dual port Realtek RTL8125B chipset nic from Amazon for rapid delivery while I look for a Broadcom or Intel chipset NIC. The Realtek came up in Proxmox 7.3 without loading additional drivers. However although I was able to PCI passthrough to the Pfsense VM, the VM didn't see the NICs.

resources

Parts List

  • Dell Precision T7600 Workstation
  • Pair of Intel Xeon QBEB Confidential CPU E5-2680 2.7 GHz 20MB 8-Cores LGA 2011

Documentation

HP Z840

24 x Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz (2 Sockets)

64 gig RAM 

1 root@pve2:~#  lspci | grep -i --color 'vga\|3d\|2d'
2 03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Cedar [Radeon HD 5000/6000/7350/8350 Series]
3 84:00.0 VGA compatible controller: NVIDIA Corporation GK107GL [Quadro 410] (rev a1)
4 root@pve2:~#

1 root@prox2:~# dmesg | grep -e DMAR -e IOMMU
2 [...]
3 [    0.261560] DMAR: IOMMU enabled
4 [...]
5 root@prox2:~#

Passthrough USB (face)

1 root@pve2:~# qm set 100 -usb0 host=2-10,usb3=1
2 update VM 100: -usb0 host=2-10,usb3=1
3 root@pve2:~# qm set 100 -usb1 host=2-13.1,usb3=1
4 update VM 100: -usb0 host=2-13.1,usb3=1
5 root@pve2:~# qm set 100 -usb2 host=2-14,usb3=1
6 update VM 100: -usb0 host=2-14,usb3=1
7 root@pve2:~# qm set 100 -usb3 host=2-9,usb3=1
8 update VM 100: -usb0 host=2-9,usb3=1
9 root@pve2:~#
HP Z840 Resources

How to upgrade the power supply in HP Z840 to 1125W PSU | Don't make my mistake! from Art of Server

Retrieved from "https://wiki.rodaw.com/w/index.php?title=Home_Lab&oldid=1076"