Deep Learning Frameworks

There have been many Deep Learning (DL) frameworks, like Theano, CNTK, Caffe2, and MXNet. Nowadays, they appear to be dead or dying, as just two frameworks heavily dominate the DL scene: Google TensorFlow (TF), which includes Keras and PyTorch from Meta aka FaceBook.

However, there is no reason to believe such a duopoly will persist forever. All the time, new DL frameworks are proposed. We have no idea which DL framework will be popular in, say, ten years.

Google has at least two (perhaps more) competing AI teams: Google Brain and DeepMind. Even in the TensorFlow era, DeepMind used their own layer API called Sonnet (instead of the usual Keras)

Popular Deep Learning Framework

Framework	Notice	Developer	Language	GPU Support	Distributed Computing	Auto-differentiation	Pre-trained models	Visualization	Deployment
TensorFlow		Google	Python	Yes	Yes	Yes	Yes	Yes	Yes
PyTorch	Pytorch version 2.0 released as of 12/2/22	Facebook	Python	Yes	Yes	Yes	Yes	Yes	Yes
Keras		Google	Python	Yes	Yes	Yes	Yes	Yes	Yes
MXNet		Apache	Multiple	Yes	Yes	Yes	Yes	Yes	Yes
Caffe		Berkeley AI Research	C++	Yes	No	Yes	Yes	No	Yes
Theano		Université de Montréal	Python	Yes	No	Yes	Yes	No	No
Torch		Facebook AI Research	Lua	Yes	No	Yes	Yes	No	No

Reference

<reference/>