TensorFlow for AMD ROCm GPU
Overview
TensorFlow for AMD ROCm GPU에 대한 기술 문서입니다.
Summary
- 무엇인가? - TensorFlow for AMD ROCm GPU
- 왜 필요한가? - HPC 및 서버 환경에서 필수 개념
- 언제 사용하는가? - 서버 구성, 성능 튜닝, 문제 해결 시
Purpose
이 문서가 존재하는 이유
- Goal: TensorFlow for AMD ROCm GPU에 대한 기술 정보 제공
- Scope: TensorFlow for AMD ROCm GPU의 개념, 사용법, 설정
- Non-goals: 다른 주제로의 확장
Key Concepts
| Concept | Description | Related |
|---|---|---|
| TensorFlow for AMD ROCm GPU | HPC/서버 환경에서 중요한 기술 개념 | Linux, Server |
Detailed Explanation
In brief : ROCm - The Radeon Open Ecosystem - Google Tensorflow announced (on Aug 27, 2018) the release of TensorFlow v1.8 for ROCm-enabled GPUs including the Radeon Instinct™ MI25 GPU by leveraging MIOpen , a library of highly optimized GPU routines for deep learning. This is a major milestone in AMD’s ongoing work to accelerate deep learning. ROCm is an open-source software foundation for GPU computing on Linux. For a long time, AMD has avoided competing with Nvidia. with AMD products in 2019. Specifically, Computex 2019 should be the place and time when we become familiar with AMD GPU products that are competitive with Nvidia RTX. ROCm is a place where AMD is trying to get in the GPU computing domain. AMD start to provide a pre-built whl package, allowing a simple install akin to the installation of generic TensorFlow for Linux. AMD published installation instructions and also a pre-built Docker image including upstreaming all the ROCm-specific enhancements to the TensorFlow master repository. AMD's the open source effrots has been also highlighted by selection as a Google Stadia’s Building Blocks. Google has chosen Linux as a base for Stadia. Moreover, it has used the open source Vulkan API for 3D graphics and computing. Some of the other critical open source components being used for Stadia are LLVM, DirectX Shaper Compiler, GAPID, Radeon GPU Profiler, And RenderDoc. Google has also mentioned that a big reason for choosing AMD as its GPU partner is the availability of open source drivers and tools. The other specs of the AMD GPU are 16GB of video memory and 9.5 MB of L2 + L3 cache.
Linus tech tips reviewed it so yeah, i would say it is compting with NVIDIA especially if you look compared to the 1080 ti (it outperforms the 2080 by about 2 percent) ROCm is the first open-source HPC/Hyperscale-class platform for GPU computing that’s also programming-language independent. The ROCr System Runtime is language independent and makes heavy use of the Heterogeneous System Architecture (HSA) Runtime API. This approach provides a rich foundation to exectute programming languages such as HCC C++ and HIP, the Khronos Group’s OpenCL, and Continuum’s Anaconda Python.
- Multi-GPU coarse-grain shared virtual memory
- Process concurrency and preemption
- Large memory allocations
- HSA signals and atomics
- User-mode queues and DMA
- Standardized loader and code-object format
- Dynamic and offline-compilation support
- Peer-to-peer multi-GPU operation with RDMA support
- Profiler trace and event-collection API
- Systems-management API and tools
Best Practices
- 최신 버전 사용 권장
- 공식 문서 참고
- 테스트 환경에서 먼저 검증
References
Related Pages
Knowledge Graph
Related
→ CUDA → GPU → NVIDIA GPU → NVLink → AMD GPUs → MIG → NVIDIA GPUs → Tensor Core