All public logs
Jump to navigation
Jump to search
Combined display of all available logs of HPCWIKI. You can narrow down the view by selecting a log type, the username (case-sensitive), or the affected page (also case-sensitive).
- 13:25, 18 June 2024 Admin talk contribs created page Transformer Engine (Created page with "== What is (TE) Transfermer Engine == Most deep learning frameworks train with FP32 by default. This is not essential, however, to achieve full accuracy for many deep learning models. Using mixed-precision training, which combines <u>single-precision (FP32)</u> with <u>lower precision (FP16)</u> format when training a model, results in significant speedups with minimal differences in accuracy as compared to FP32 training. With Hopper and Ada GPU architecture <u>FP8 preci...") Tag: Visual edit