Difference between revisions of "Home Lab"
(→Passthrough USB (face): correct usbx [0..3]) |
(→resources: add link to Realtek drive install that worked for me) |
||
(3 intermediate revisions by the same user not shown) | |||
Line 12: | Line 12: | ||
===Dell Precision T7600 Workstation=== | ===Dell Precision T7600 Workstation=== | ||
Swapped out the Xeon E5-2620 for a pair of Xeon QBEB Confidential CPU E5-2680 2.7 GHz 20MB 8-Cores LGA 2011 and 64gig Memory. | Swapped out the Xeon E5-2620 for a pair of Xeon QBEB Confidential CPU E5-2680 2.7 GHz 20MB 8-Cores LGA 2011 and 64gig Memory. | ||
+ | ===HP EliteDesk 800 G1 TWR Intel i7-4770 3.4GHz=== | ||
+ | ====Pfsense==== | ||
+ | I wanted to experiment with pfsense because I bought a new DOCSIS 3.1 modem that supports 2500 Mbpx on the ethernet port, unlike my current Asus RT-N66U and wanted a more generalized server than my existing cluster. One that would be physically smaller and consume less power. | ||
+ | I started this experiment with Proxmox version 7.3. I bought a dual port Realtek RTL8125B chipset nic from Amazon for rapid delivery while I look for a Broadcom or Intel chipset NIC. The Realtek came up in Proxmox 7.3 without loading additional drivers. However although I was able to PCI passthrough to the Pfsense VM, the VM didn't see the NICs. | ||
+ | |||
+ | =====resources===== | ||
+ | * The NIC https://smile.amazon.com/gp/product/B0B4V6MPHD/ref=ppx_yo_dt_b_asin_title_o03_s02?ie=UTF8&psc=1 | ||
+ | * Post about how to use the Realtek as passthrough https://forum.proxmox.com/threads/install-pfsense-with-passthrough-2-nic-doesnt-work.107639/ | ||
+ | * STH article https://www.servethehome.com/how-to-pass-through-pcie-nics-with-proxmox-ve-on-intel-and-amd/ | ||
+ | * ROM firmware for HP EliteDesk 800 G1 TWR Intel i7-4770 [[:File:Sp103785.zip|Sp103785.zip]] | ||
+ | * uTube re FreeBSD drive update for Realtek for Pfsense https://youtu.be/49OC82Z4qG8 | ||
+ | * This is the ticket that worked for me. I can now see the Realtek via pci passthrough in the virtualized pfsense in my proxmox. https://administrator.de/knowledge/realtek-treiber-1-97-00-fuer-pfsense-2-60-ce-und-22-01-oder-22-05-plus-3352223154.html | ||
===Parts List=== | ===Parts List=== | ||
Line 26: | Line 38: | ||
<syntaxhighlight lang="bash" line start="1" highlight="2-3"> | <syntaxhighlight lang="bash" line start="1" highlight="2-3"> | ||
− | root@ | + | root@pve2:~# lspci | grep -i --color 'vga\|3d\|2d' |
− | 03:00.0 VGA compatible controller: | + | 03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Cedar [Radeon HD 5000/6000/7350/8350 Series] |
84:00.0 VGA compatible controller: NVIDIA Corporation GK107GL [Quadro 410] (rev a1) | 84:00.0 VGA compatible controller: NVIDIA Corporation GK107GL [Quadro 410] (rev a1) | ||
− | root@ | + | root@pve2:~# |
</syntaxhighlight> | </syntaxhighlight> | ||
Latest revision as of 22:35, 10 December 2022
Contents
Truenas
Parts List
- SilverStone Case Storage Series SST-CS380 Black Plastic front door, steel body ATX Mid Tower Computer Case Standard PS2(ATX) Power Supply 8 hot swap SATA bays
- Supermicro Motherboard MBD-X11SSM-F-B Xeon E3-1200 v5 LGA1151 Socket H4 C236 PCI Express SATA MicroATX
- Intel Xeon E3-1230 Processors BX80677E31230V6
- Supermicro 16GB 288-Pin DDR4 2666 (PC4-21300) Server Memory (MEM-DR416L-CV02-EU26) * 2 for 32gig memory
- Hitachi Deskstar (0F12450) 3TB 64MB 7200RPM SATA 6.0Gb/s 3.5" Desktop Hard Drive 8 of these. I'll swap in some WD Red when I'm done experimenting.
I had a SUPERMICRO MBD-X9SCL LGA1155 Intel C202 Micro ATX Motherboard XEON E3-1230V2 which seemed adequate but I had some strange problems. In the Truenas forums see; Add user results in KDB: enter: panic
Proxmox
Dell Precision T7600 Workstation
Swapped out the Xeon E5-2620 for a pair of Xeon QBEB Confidential CPU E5-2680 2.7 GHz 20MB 8-Cores LGA 2011 and 64gig Memory.
HP EliteDesk 800 G1 TWR Intel i7-4770 3.4GHz
Pfsense
I wanted to experiment with pfsense because I bought a new DOCSIS 3.1 modem that supports 2500 Mbpx on the ethernet port, unlike my current Asus RT-N66U and wanted a more generalized server than my existing cluster. One that would be physically smaller and consume less power. I started this experiment with Proxmox version 7.3. I bought a dual port Realtek RTL8125B chipset nic from Amazon for rapid delivery while I look for a Broadcom or Intel chipset NIC. The Realtek came up in Proxmox 7.3 without loading additional drivers. However although I was able to PCI passthrough to the Pfsense VM, the VM didn't see the NICs.
resources
- The NIC https://smile.amazon.com/gp/product/B0B4V6MPHD/ref=ppx_yo_dt_b_asin_title_o03_s02?ie=UTF8&psc=1
- Post about how to use the Realtek as passthrough https://forum.proxmox.com/threads/install-pfsense-with-passthrough-2-nic-doesnt-work.107639/
- STH article https://www.servethehome.com/how-to-pass-through-pcie-nics-with-proxmox-ve-on-intel-and-amd/
- ROM firmware for HP EliteDesk 800 G1 TWR Intel i7-4770 Sp103785.zip
- uTube re FreeBSD drive update for Realtek for Pfsense https://youtu.be/49OC82Z4qG8
- This is the ticket that worked for me. I can now see the Realtek via pci passthrough in the virtualized pfsense in my proxmox. https://administrator.de/knowledge/realtek-treiber-1-97-00-fuer-pfsense-2-60-ce-und-22-01-oder-22-05-plus-3352223154.html
Parts List
- Dell Precision T7600 Workstation
- Pair of Intel Xeon QBEB Confidential CPU E5-2680 2.7 GHz 20MB 8-Cores LGA 2011
Documentation
HP Z840
24 x Intel(R) Xeon(R) CPU E5-2620 v3 @ 2.40GHz (2 Sockets)
64 gig RAM
1 root@pve2:~# lspci | grep -i --color 'vga\|3d\|2d'
2 03:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Cedar [Radeon HD 5000/6000/7350/8350 Series]
3 84:00.0 VGA compatible controller: NVIDIA Corporation GK107GL [Quadro 410] (rev a1)
4 root@pve2:~#
1 root@prox2:~# dmesg | grep -e DMAR -e IOMMU
2 [...]
3 [ 0.261560] DMAR: IOMMU enabled
4 [...]
5 root@prox2:~#
Passthrough USB (face)
1 root@pve2:~# qm set 100 -usb0 host=2-10,usb3=1
2 update VM 100: -usb0 host=2-10,usb3=1
3 root@pve2:~# qm set 100 -usb1 host=2-13.1,usb3=1
4 update VM 100: -usb0 host=2-13.1,usb3=1
5 root@pve2:~# qm set 100 -usb2 host=2-14,usb3=1
6 update VM 100: -usb0 host=2-14,usb3=1
7 root@pve2:~# qm set 100 -usb3 host=2-9,usb3=1
8 update VM 100: -usb0 host=2-9,usb3=1
9 root@pve2:~#
HP Z840 Resources
How to upgrade the power supply in HP Z840 to 1125W PSU | Don't make my mistake! from Art of Server