Working group on Deep Learning

Contact persons:

Purpose and Topics

The goal of this working group is to enhance expertise of WIAS in the emerging field of deep learning. The main focus is intended to be on theoretical understanding of universal efficiency of deep learning approach for different classes of practical problems.

List of talks

Archive of talks
26.01.2018, 15:00MS 39, room 406Carlo MichaelisA MCMC perspective on self-organizing recurrent neural networks (SORN)
02.02.2018, 15:00MS 39, room 406Christian BayerDeep Learning for solving PDEs

Reading list

Software and Tutorials

  • Deep Learning Tutorials
    The tutorials presented here will introduce you to some of the most important deep learning algorithms and will also show you how to run them using Theano. Theano is a python library that makes writing deep learning models easy, and gives the option of training them on a GPU.
  • Theano: A Python framework for fast computation of mathematical expressions
    Theano is a Python library that allows you to define, optimize, and evaluate mathematical expressions involving multi-dimensional arrays efficiently.
  • Keras: Deep Learning library for Theano and TensorFlow
    Keras is a minimalist, highly modular neural networks library, written in Python and capable of running on top of either TensorFlow or Theano. It was developed with a focus on enabling fast experimentation. Being able to go from idea to result with the least possible delay is key to doing good research.
  • TensorFlow (google)
    TensorFlow is an open source software library for numerical computation using data flow graphs. Nodes in the graph represent mathematical operations, while the graph edges represent the multidimensional data arrays (tensors) communicated between them. The flexible architecture allows you to deploy computation to one or more CPUs or GPUs in a desktop, server, or mobile device with a single API. TensorFlow was originally developed by researchers and engineers working on the Google Brain Team within Google's Machine Intelligence research organization for the purposes of conducting machine learning and deep neural networks research, but the system is general enough to be applicable in a wide variety of other domains as well.
  • TensorFlow Playground
    One can try here to construct a Neural Network without any programming, just using a graphical interface.