Working group on Deep Learning
Contact persons:Purpose and Topics
The goal of this working group is to enhance expertise of WIAS in the emerging field of deep learning. The main focus is intended to be on theoretical understanding of universal efficiency of deep learning approach for different classes of practical problems.
List of talks
Archive of talks26.01.2018, 15:00 | MS 39, room 406 | Carlo Michaelis | A MCMC perspective on self-organizing recurrent neural networks (SORN) |
02.02.2018, 15:00 | MS 39, room 406 | Christian Bayer | Deep Learning for solving PDEs |
Reading list
- Ian Goodfellow, Yoshua Bengio and Aaron Courville
Deep Learning
2016, Book in preparation for MIT Press, http://www.deeplearningbook.org - Jurgen Schmidhuber
Deep Learning in Neural Networks: An Overview
2014, ArXiV:1404.7828 - Most cited deep learning papers
https://github.com/terryum/awesome-deep-learning-papers - Reading list from deeplearning.net
http://deeplearning.net/reading-list/
Software and Tutorials
- Deep Learning Tutorials The tutorials presented here will introduce you to some of the most important deep learning algorithms and will also show you how to run them using Theano. Theano is a python library that makes writing deep learning models easy, and gives the option of training them on a GPU.
- Theano: A Python framework for fast computation of mathematical expressions
Theano is a Python library that allows you to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently. - Keras: Deep Learning library for Theano and TensorFlow
Keras is a minimalist, highly modular neural networks library, written in Python and capable of running on top of either TensorFlow or Theano. It was developed with a focus on enabling fast experimentation. Being able to go from idea to result with the least possible delay is key to doing good research. - TensorFlow (google)
TensorFlow is an open source software library for numerical computation using data flow graphs. Nodes in the graph represent mathematical operations, while the graph edges represent the multidimensional data arrays (tensors) communicated between them. The flexible architecture allows you to deploy computation to one or more CPUs or GPUs in a desktop, server, or mobile device with a single API. TensorFlow was originally developed by researchers and engineers working on the Google Brain Team within Google's Machine Intelligence research organization for the purposes of conducting machine learning and deep neural networks research, but the system is general enough to be applicable in a wide variety of other domains as well. - TensorFlow Playground
One can try here to construct a Neural Network without any programming, just using a graphical interface.