Deep Learning Frameworks

There have been many Deep Learning (DL) frameworks, like Theano, CNTK, Caffe2, and MXNet. Nowadays, they appear to be dead or dying, as just two frameworks heavily dominate the DL scene: Google TensorFlow (TF), which includes Keras and PyTorch from Meta aka FaceBook.

However, there is no reason to believe such a duopoly will persist forever. All the time, new DL frameworks are proposed. We have no idea which DL framework will be popular in, say, ten years.

Google has at least two (perhaps more) competing AI teams: Google Brain and DeepMind. Even in the TensorFlow era, DeepMind used their own layer API called Sonnet (instead of the usual Keras)

Popular Deep Learning Framework

Framework	Developer	Language	GPU Support	Distributed Computing	Auto-differentiation	Pre-trained models	Visualization	Deployment
TensorFlow	Google	Python	Yes	Yes	Yes	Yes	Yes	Yes
PyTorch	Facebook	Python	Yes	Yes	Yes	Yes	Yes	Yes
Keras	Google	Python	Yes	Yes	Yes	Yes	Yes	Yes
MXNet	Apache	Multiple	Yes	Yes	Yes	Yes	Yes	Yes
Caffe	Berkeley AI Research	C++	Yes	No	Yes	Yes	No	Yes
Theano	Université de Montréal	Python	Yes	No	Yes	Yes	No	No
Torch	Facebook AI Research	Lua	Yes	No	Yes	Yes	No	No

Reference

<reference/>