Deep Learning Frameworks: Difference between revisions

From HPCWIKI
Jump to navigation Jump to search
No edit summary
Line 8: Line 8:
{| class="wikitable"
{| class="wikitable"
!Framework
!Framework
!Notice
!Developer
!Developer
!Language
!Language
Line 18: Line 19:
|-
|-
|TensorFlow
|TensorFlow
|
|Google
|Google
|Python
|Python
Line 28: Line 30:
|-
|-
|PyTorch
|PyTorch
|Pytorch version 2.0<ref>https://github.com/pytorch/pytorch/releases</ref> released as of 12/2/22
|Facebook
|Facebook
|Python
|Python
Line 38: Line 41:
|-
|-
|Keras
|Keras
|
|Google
|Google
|Python
|Python
Line 48: Line 52:
|-
|-
|MXNet
|MXNet
|
|Apache
|Apache
|Multiple
|Multiple
Line 58: Line 63:
|-
|-
|Caffe
|Caffe
|
|Berkeley AI Research
|Berkeley AI Research
|C++
|C++
Line 68: Line 74:
|-
|-
|Theano
|Theano
|
|Université de Montréal
|Université de Montréal
|Python
|Python
Line 78: Line 85:
|-
|-
|Torch
|Torch
|
|Facebook AI Research
|Facebook AI Research
|Lua
|Lua

Revision as of 12:27, 26 March 2023

There have been many Deep Learning (DL) frameworks, like Theano, CNTK, Caffe2, and MXNet. Nowadays, they appear to be dead or dying, as just two frameworks heavily dominate the DL scene: Google TensorFlow (TF), which includes Keras and PyTorch from Meta aka FaceBook.

However, there is no reason to believe such a duopoly will persist forever. All the time, new DL frameworks are proposed. We have no idea which DL framework will be popular in, say, ten years.

Google has at least two (perhaps more) competing AI teams: Google Brain and DeepMind. Even in the TensorFlow era, DeepMind used their own layer API called Sonnet (instead of the usual Keras)

Popular Deep Learning Framework

Framework Notice Developer Language GPU Support Distributed Computing Auto-differentiation Pre-trained models Visualization Deployment
TensorFlow Google Python Yes Yes Yes Yes Yes Yes
PyTorch Pytorch version 2.0[1] released as of 12/2/22 Facebook Python Yes Yes Yes Yes Yes Yes
Keras Google Python Yes Yes Yes Yes Yes Yes
MXNet Apache Multiple Yes Yes Yes Yes Yes Yes
Caffe Berkeley AI Research C++ Yes No Yes Yes No Yes
Theano Université de Montréal Python Yes No Yes Yes No No
Torch Facebook AI Research Lua Yes No Yes Yes No No

Reference

<reference/>