-= > PROXMOX NOTES < =- a) Disable Ceph Repository: Updates -> Repositories -> ceph-quincy b) Enable Test Repository: Updates -> Repositories -> Add -> Test c) Disable Unnecessary Services: Postfix Mail Transport Agent: systemctl disable postfix Proxmox VE Firewall: systemctl disable pve-firewall Proxmox VE Firewall Logger: systemctl disable pvefw-logger systemctl edit --full pve-manager.service Comment Out: pve-firewall d) Mount Server Proxmox Share e) Install pve-nagbuster f) Modify GRUB loader for PCIe / GPU Passthrough nano /etc/default/grub Add/Modify one of the following lines depending on necessity and CPU type: GRUB_CMDLINE_LINUX_DEFAULT="quiet amd_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb:off,efifb:off initcall_blacklist=sysfb_init" GRUB_CMDLINE_LINUX_DEFAULT="quiet amd_iommu=on iommu=pt pcie_acs_override=downstream,multifunction video=vesafb:off,efifb:off" GRUB_CMDLINE_LINUX_DEFAULT="quiet intel_iommu=on iommu=pt pcie_acs_override=downstream,multifunction nofb nomodeset video=vesafb:off,efifb:off" Add/Modify the following line: GRUB_CMDLINE_LINUX="kvm.ignore_msrs=1" update-grub g) Add VFIO Modules to Proxmox nano /etc/modules Add the following lines: vfio vfio_iommu_type1 vfio_pci vfio_virqfd h) IOMMU interrupt remapping nano /etc/modprobe.d/iommu_unsafe_interrupts.conf Add the following line(s): options vfio_iommu_type1 allow_unsafe_interrupts=1 nano /etc/modprobe.d/kvm.conf Add the following line(s): options kvm ignore_msrs=1 i) Blacklist GPU Drivers echo "blacklist radeon" >> /etc/modprobe.d/blacklist.conf echo "blacklist nouveau" >> /etc/modprobe.d/blacklist.conf echo "blacklist nvidia" >> /etc/modprobe.d/blacklist.conf j) Add PCIe devices to VFIO driver lspci -v lspci -nn lspci -k nano /etc/modprobe.d/vfio.conf Add the following lines replacing abcd:efgh and ijkl:mnop with corresponding device(s) separated by commas from lspci command: options vfio-pci ids=abcd:efgh,ijkl:mnop update-initramfs -u reboot k) Create VM, Use Machine type "Q35", edit VM configuration settings nano /etc/pve/qemu-server/.conf Modify following lines: cpu: host, hidden=1, flags=+pcid args: -cpu 'host,+kvm_pv_unhalt,+kvm_pv_eoi,hv_vendor_id=NV43FIX,kvm=off' Add PCIe Devices to VM All Functions: Enabled ROM-Bar: Enabled Primary GPU: Enabled PCI-Express: Enabled l) Extract GPU ROM file or download from https://www.techpowerup.com/vgabios/ Move extracted .rom file to /usr/share/kvm/ m) Add ROM file to VM configuration settings nano /etc/pve/qemu-server/.conf Example: hostpci0: 01:00,pcie=1,romfile=.rom,x-vga=1 ----------------------------------------------------------------------------------------------- Get-VirtualDisk | Select-Object * New-VirtualDisk -StoragePoolFriendlyName "The Nigger Pool" -ProvisioningType Thin -Interleave 256KB -ResiliencySettingName Parity -FriendlyName "The Nigger Drive" -Size 3.33TB -NumberOfColumns 3 -PhysicalDiskRedundancy 1 New-VirtualDisk -StoragePoolFriendlyName "The Nigger Pool" -ProvisioningType Thin -Interleave 32KB -ResiliencySettingName Parity -FriendlyName "The Nigger Drive" -Size 3.33TB -NumberOfColumns 3 -PhysicalDiskRedundancy 1 scsi1: /dev/disk/by-id/ata-WDC_WD40EFRX-68WT0N0_WD-WCC4E6PJYYL4,backup=0,discard=on,iothread=1,size=3907018584K,ssd=1 scsi2: /dev/disk/by-id/ata-WDC_WD10EZEX-00KUWA0_WD-WCC1S5977121,backup=0,discard=on,iothread=1,size=976762584K,ssd=1 scsi3: /dev/disk/by-id/ata-ST9500420AS_5VJ8Q0AN,backup=0,discard=on,iothread=1,size=488386584K,ssd=1 scsi4: /dev/disk/by-id/ata-WDC_WD5000AAVS-00N7B0_WD-WCAV91667104,backup=0,discard=on,iothread=1,size=488386584K,ssd=1 Western Digital Red 4TB ATTO Disk Benchmark: Read - 149 MB/sec Write - 142 MB/sec File Write: 140 MB/sec Western Digital Black 1TB ATTO Disk Benchmark: Read - 204 MB/sec Write - 180 MB/sec File Write: 180 MB/sec Western Digital Green 500GB ATTO Disk Benchmark: Read - 100 MB/sec Write - 101 MB/sec File Write: 103 MB/sec Seagate 500GB ATTO Disk Benchmark: Read - 102 MB/sec Write - 101 MB/sec File Write: 101 MB/sec # Windows Shares # === TBO SHARES === //192.168.100.1/h/TBO/-=MOVIES=- /mnt/movies/TBO-H cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 //192.168.100.1/i/TBO/-=MOVIES=- /mnt/movies/TBO-I cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 //192.168.100.1/j/TBO/-=MOVIES=- /mnt/movies/TBO-J cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 //192.168.100.1/k/TBO/-=MOVIES=- /mnt/movies/TBO-K cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 //192.168.100.1/l/TBO/-=MOVIES=- /mnt/movies/TBO-L cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 //192.168.100.1/w/TBO/-=MOVIES=- /mnt/movies/TBO-W cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 # === TBO-SERVER SHARES === //192.168.100.2/e/TBO/-=MOVIES=- /mnt/movies/TBO-SERVER-E cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 //192.168.100.2/f/TBO/-=MOVIES=- /mnt/movies/TBO-SERVER-F cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 //192.168.100.2/g/TBO/-=MOVIES=- /mnt/movies/TBO-SERVER-G cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 //192.168.100.2/h/TBO/-=MOVIES=- /mnt/movies/TBO-SERVER-H cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 //192.168.100.2/i/TBO/-=MOVIES=- /mnt/movies/TBO-SERVER-I cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 # === TBO-TESTBENCH SHARES === //192.168.100.5/e/TBO/-=MOVIES=- /mnt/movies/TBO-TESTBENCH-E cifs ro,vers=3.1.1,credentials=/root/.smbpasswd >//192.168.100.2/g/TBO/SORT /mnt/movies/TBO-SERVER-SORT cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0 # === TBO VIDEOS, MUSIC, ETC SHARES === //192.168.100.1/h/TBO/-=THE BIG ONE Videos=- /mnt/videos/TBO-VIDEOS cifs ro,vers=3.1.1,credentials=/root/.smb>//192.168.100.1/h/TBO/-=MUSIC=- /mnt/music/TBO-MUSIC cifs ro,vers=3.1.1,credentials=/root/.smbpasswd 0 0