Find PCIe device location in system: Difference between revisions

From HPCWIKI
Jump to navigation Jump to search
(Created page with "In GPGPU system for AI, it is common to install multiple same model of GPU on multiple PCIe bus in one system. When one or more specific located GPU needs to replace or maintaining, how to identify the location of specific GPU in the sytem? In Linux, there is a way to find out which PCI card is plugged into which PCI slot. For example, if there is two identical GPUs in a system we can identify where they are located with following step<syntaxhighlight lang="bash...")
 
(Fix: remove --- horizontal lines (7 removed))
 
(3 intermediate revisions by the same user not shown)
Line 1: Line 1:
In GPGPU system for AI, it is common to install multiple same model of GPU on multiple [[PCIe]] bus in one system.
{{Status
|status=Draft
|owner=Knowledge Agent
|last_update=2026-07-16
|review=Pending
}}
 
{{TOC}}
 
== Overview ==
 
Find PCIe device location in system에 대한 기술 문서입니다.
 
=== Summary ===
 
* 무엇인가? - Find PCIe device location in system
* 왜 필요한가? - HPC 및 서버 환경에서 필수 개념
* 언제 사용하는가? - 서버 구성, 성능 튜닝, 문제 해결 시
 
 
== Purpose ==
 
이 문서가 존재하는 이유
 
* Goal: Find PCIe device location in system에 대한 기술 정보 제공
* Scope: Find PCIe device location in system의 개념, 사용법, 설정
* Non-goals: 다른 주제로의 확장
 
 
== Key Concepts ==


When one or more specific located GPU needs to replace or maintaining,  how to identify the location of specific GPU in the sytem? 
{| class="wikitable"
! Concept
! Description
! Related
|-
| Find PCIe device location in system
| HPC/서버 환경에서 중요한 기술 개념
| [[Linux]], [[Server]]
|}


In [[Linux]], there is a way to find out which PCI card is plugged into which PCI slot.


== Detailed Explanation ==


In GPGPU system for AI, it is common to install multiple same model of GPU on multiple [[PCIe]] bus in one system.
When one or more specific located GPU needs to replace or maintaining,  how to identify the location of specific GPU in the sytem? 
In [[Linux]], there is a way to find out which PCI card is plugged into which PCI slot.
For example, if there is two identical GPUs in a system we can identify where they are located with following step<syntaxhighlight lang="bash">
For example, if there is two identical GPUs in a system we can identify where they are located with following step<syntaxhighlight lang="bash">
# list all vga device
# list all vga device
Line 12: Line 52:
45:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41)
45:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41)
81:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
81:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
 
# [[NVIDIA GPU]] is located at 01:00.0 and 81:00.0 in the system
# NVIDIA GPU is located at 01:00.0 and 81:00.0 in the system
 
# identify the PCIe bus location, we can use dmidecode and pipe to filter  
# identify the PCIe bus location, we can use dmidecode and pipe to filter  
$ sudo dmidecode -t slot | grep -e Designation -e PCIE -e Bus -e Type
$ sudo dmidecode -t slot | grep -e Designation -e PCIE -e Bus -e Type
Line 25: Line 63:
         Type: x16 PCI Express
         Type: x16 PCI Express
         Designation: PCIE4
         Designation: PCIE4
        Type: x16 PCI Express
        Designation: PCIE5
        Type: x16 PCI Express
        Bus Address: 0000:01:00.0
        Designation: PCIE6
        Type: x16 PCI Express
        Designation: PCIE7
        Type: x16 PCI Express
        Bus Address: 0000:81:00.0
        Designation: OCU1
        Type: x4 PCI Express
        Designation: OCU2
        Type: x4 PCI Express
        Designation: M2_1
        Type: x4 PCI Express
        Bus Address: 0000:02:00.0
        Designation: M2_2
        Type: x4 PCI Express
# Now we can identify PCIE5 and PCIE7 has NVIDIA GPU


# Then reference your system manual to identify where is the PCIe bus 5 and 7
 
</syntaxhighlight>
== Best Practices ==
 
* 최신 버전 사용 권장
* 공식 문서 참고
* 테스트 환경에서 먼저 검증
 


== References ==
== References ==
<references />
 
* [https://wiki.hpcmate.com Find PCIe device location in system]
 
 
== Related Pages ==
 
* [[Linux]]
* [[Server]]
* [[Hardware]]
* [[Network]]
 
 
[[Category:Server]]
== Knowledge Graph ==
 
Related
 
→ [[ACS]]
→ [[Bifurcation]]
→ [[CPU features]]
→ [[Dual vs Single PCIe Root Configuration]]
→ [[AER (Advanced Error Reporting)]]
→ [[PCIe]]
→ [[ASPM]]
→ [[PCIe 5.0]]
 
[[Category:Reference]]

Latest revision as of 11:28, 17 July 2026

Template:Status

Template:TOC

Overview

Find PCIe device location in system에 대한 기술 문서입니다.

Summary

  • 무엇인가? - Find PCIe device location in system
  • 왜 필요한가? - HPC 및 서버 환경에서 필수 개념
  • 언제 사용하는가? - 서버 구성, 성능 튜닝, 문제 해결 시


Purpose

이 문서가 존재하는 이유

  • Goal: Find PCIe device location in system에 대한 기술 정보 제공
  • Scope: Find PCIe device location in system의 개념, 사용법, 설정
  • Non-goals: 다른 주제로의 확장


Key Concepts

Concept Description Related
Find PCIe device location in system HPC/서버 환경에서 중요한 기술 개념 Linux, Server


Detailed Explanation

In GPGPU system for AI, it is common to install multiple same model of GPU on multiple PCIe bus in one system. When one or more specific located GPU needs to replace or maintaining, how to identify the location of specific GPU in the sytem? In Linux, there is a way to find out which PCI card is plugged into which PCI slot. For example, if there is two identical GPUs in a system we can identify where they are located with following step<syntaxhighlight lang="bash">

  1. list all vga device

$ lspci | grep -i vga 01:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1) 45:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41) 81:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)

  1. NVIDIA GPU is located at 01:00.0 and 81:00.0 in the system
  2. identify the PCIe bus location, we can use dmidecode and pipe to filter

$ sudo dmidecode -t slot | grep -e Designation -e PCIE -e Bus -e Type 

       Designation: PCIE1
       Type: x16 PCI Express
       Designation: PCIE2
       Type: x16 PCI Express
       Bus Address: 0000:02:00.0
       Designation: PCIE3
       Type: x16 PCI Express
       Designation: PCIE4


Best Practices

  • 최신 버전 사용 권장
  • 공식 문서 참고
  • 테스트 환경에서 먼저 검증


References


Related Pages

Knowledge Graph

Related

→ ACS → Bifurcation → CPU features → Dual vs Single PCIe Root Configuration → AER (Advanced Error Reporting) → PCIe → ASPM → PCIe 5.0

Retrieved from "http://wiki.hpcmate.com/index.php?title=Find_PCIe_device_location_in_system&oldid=3311"