Find PCIe device location in system
Overview
Find PCIe device location in system에 대한 기술 문서입니다.
Summary
- 무엇인가? - Find PCIe device location in system
- 왜 필요한가? - HPC 및 서버 환경에서 필수 개념
- 언제 사용하는가? - 서버 구성, 성능 튜닝, 문제 해결 시
Purpose
이 문서가 존재하는 이유
- Goal: Find PCIe device location in system에 대한 기술 정보 제공
- Scope: Find PCIe device location in system의 개념, 사용법, 설정
- Non-goals: 다른 주제로의 확장
Key Concepts
| Concept | Description | Related |
|---|---|---|
| Find PCIe device location in system | HPC/서버 환경에서 중요한 기술 개념 | Linux, Server |
Detailed Explanation
In GPGPU system for AI, it is common to install multiple same model of GPU on multiple PCIe bus in one system. When one or more specific located GPU needs to replace or maintaining, how to identify the location of specific GPU in the sytem? In Linux, there is a way to find out which PCI card is plugged into which PCI slot. For example, if there is two identical GPUs in a system we can identify where they are located with following step<syntaxhighlight lang="bash">
- list all vga device
$ lspci | grep -i vga 01:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1) 45:00.0 VGA compatible controller: ASPEED Technology, Inc. ASPEED Graphics Family (rev 41) 81:00.0 VGA compatible controller: NVIDIA Corporation GA102GL [RTX A6000] (rev a1)
- NVIDIA GPU is located at 01:00.0 and 81:00.0 in the system
- identify the PCIe bus location, we can use dmidecode and pipe to filter
$ sudo dmidecode -t slot | grep -e Designation -e PCIE -e Bus -e Type
Designation: PCIE1
Type: x16 PCI Express
Designation: PCIE2
Type: x16 PCI Express
Bus Address: 0000:02:00.0
Designation: PCIE3
Type: x16 PCI Express
Designation: PCIE4
Best Practices
- 최신 버전 사용 권장
- 공식 문서 참고
- 테스트 환경에서 먼저 검증
References
Related Pages
Knowledge Graph
Related
→ ACS → Bifurcation → CPU features → Dual vs Single PCIe Root Configuration → AER (Advanced Error Reporting) → PCIe → ASPM → PCIe 5.0