Deep Learning Frameworks: Difference between revisions
| Line 8: | Line 8: | ||
!HPCMATE custom build<ref>HPCMATE supports custom build service to optimize binary performance on given system based on customer requirements </ref> | !HPCMATE custom build<ref>HPCMATE supports custom build service to optimize binary performance on given system based on customer requirements </ref> | ||
!Developer | !Developer | ||
!Status as of 2023 | |||
!Language | !Language | ||
!GPU [[Support]] | !GPU [[Support]] | ||
| Line 19: | Line 20: | ||
|Yes | |Yes | ||
|Google | |Google | ||
| | |||
|Python | |Python | ||
|Yes | |Yes | ||
| Line 29: | Line 31: | ||
|[https://pytorch.org PyTorch] | |[https://pytorch.org PyTorch] | ||
|Yes | |Yes | ||
|Facebook | |Facebook | ||
Caffe2 has been merged into PyTorch as of Apr'2018 <ref>https://synced.medium.com/caffe2-merges-with-pytorch-a89c70ad9eb7</ref> | | | ||
* Pytorch version 2.0<ref>https://github.com/pytorch/pytorch/releases</ref> released as of 12/2/22 | |||
* | |||
* Caffe2 has been merged into PyTorch as of Apr'2018 <ref>https://synced.medium.com/caffe2-merges-with-pytorch-a89c70ad9eb7</ref> | |||
|Python | |Python | ||
|Yes | |Yes | ||
| Line 41: | Line 46: | ||
|- | |- | ||
|Keras | |Keras | ||
| | |NA | ||
|Google | |Google | ||
|Merged into TensorFlow | |||
|Python | |Python | ||
|Yes | |Yes | ||
| Line 54: | Line 60: | ||
| | | | ||
|Apache | |Apache | ||
| | |||
|Multiple | |Multiple | ||
|Yes | |Yes | ||
| Line 63: | Line 70: | ||
|- | |- | ||
|Caffe | |Caffe | ||
| | |NA | ||
|Berkeley AI Research | |Berkeley AI Research | ||
|Caffe2 is built on Caffe and is merged into Meta’s PyTorch | |||
Yahoo has also integrated Caffe with Apache Spark to create CaffeOnSpark, which brings deep learning to Hadoop and Spark clusters | |||
|C++ | |C++ | ||
|Yes | |Yes | ||
| Line 76: | Line 85: | ||
| | | | ||
|Université de Montréal | |Université de Montréal | ||
|'''Theano is dead now but''' the other open-source deep libraries which are built on top of Theano are still functioning; these include Keras, Lasagne, and Blocks | |||
|Python | |Python | ||
|Yes | |Yes | ||
|No | |No | ||
Revision as of 17:07, 27 March 2023
There have been many Deep Learning (DL) frameworks, like Theano, CNTK, Caffe2, and MXNet. Nowadays, some of them appear to be dead or dying, as just two frameworks heavily dominate the DL scene: Google TensorFlow (TF) and PyTorch from Meta aka FaceBook.
However, there is no reason to believe such a duopoly will persist forever. Cause new DL frameworks are proposed here and there. So it is hard to say which DL framework will be popular in ten years later..., for example, Google has at least two (perhaps more) competing AI teams: Google Brain and DeepMind. Even in the TensorFlow era, DeepMind used their own layer API called Sonnet (instead of the usual Keras)
Popular Deep Learning Framework
| Framework | HPCMATE custom build[1] | Developer | Status as of 2023 | Language | GPU Support | Distributed Computing | Auto-differentiation | Pre-trained models | Visualization | Deployment |
|---|---|---|---|---|---|---|---|---|---|---|
| TensorFlow | Yes | Python | Yes | Yes | Yes | Yes | Yes | Yes | ||
| PyTorch | Yes | Python | Yes | Yes | Yes | Yes | Yes | Yes | ||
| Keras | NA | Merged into TensorFlow | Python | Yes | Yes | Yes | Yes | Yes | Yes | |
| MXNet | Apache | Multiple | Yes | Yes | Yes | Yes | Yes | Yes | ||
| Caffe | NA | Berkeley AI Research | Caffe2 is built on Caffe and is merged into Meta’s PyTorch
Yahoo has also integrated Caffe with Apache Spark to create CaffeOnSpark, which brings deep learning to Hadoop and Spark clusters |
C++ | Yes | No | Yes | Yes | No | Yes |
| Theano | Université de Montréal | Theano is dead now but the other open-source deep libraries which are built on top of Theano are still functioning; these include Keras, Lasagne, and Blocks | Python | Yes | No | Yes | Yes | No | No |
Reference
<references/>
- ↑ HPCMATE supports custom build service to optimize binary performance on given system based on customer requirements
- ↑ https://github.com/pytorch/pytorch/releases
- ↑ https://synced.medium.com/caffe2-merges-with-pytorch-a89c70ad9eb7