ACS

From HPCWIKI
Revision as of 17:33, 18 March 2023 by Admin (talk | contribs)
Jump to navigation Jump to search


PCI Access Control Services (ACS) used for IO virtualization (also known as, VT-d or IOMMU).

PLX PCI Bridge

You can check whether ACS is enabled on PCI bridges by running:

sudo lspci -vvv | grep ACSCtl


If lines show “ACSCtl: SrcValid+”, then ACS might be enabled. Looking at the full output of lspci, one can check if a PCI bridge has ACS enabled.

sudo lspci -vvv 

If PCI switches have ACS enabled, it needs to be disabled. On some systems this can be done from the BIOS by disabling IO virtualization or VT-d. For Broadcom PLX devices, it can be done from the OS but needs to be done again after each reboot.

Use the command below to find the PCI bus IDs of PLX PCI bridges:

sudo lspci -vvv | grep ACSCtrl

Next, use setpci to disable ACS with the command below, replacing 03:00.0 by the PCI bus ID of each PCI bridge.

run "setpci -s bus#:slot#.func# f2a.w=0000" to disable ACSCtl on the PLX switch.

e.g.

#setpci -s 03:08.0 f2a.w=0000 *assume 03:08.0 is the PLX pcie switch*

run lspci -vvv to confirm ACSCtrl is disabled on PLX switch.

sudo setpci -s 03:00.0 f2a.w=0000

AMD CPU

disabling IOMMU in bios or GRU

  1. sudo nano /etc/default/grub
  2. GRUB_CMDLINE_LINUX_DEFAULT="amd_iommu=soft"
  3. sudo update-grub
  4. reboot