Hands-On Deep Learning Algorithms with Python

Master deep learning algorithms with extensive math by implementing them using TensorFlow

Sudharsan Ravichandiran

• Publisher: Packt Publishing
• Year: 2019
• ISBN:
  9781789344516
• Edition: 1
• Topic: Informatica
• Subtopic: Informatica generale

Understand basic to advanced deep learning algorithms, the mathematical principles behind them, and their practical applications.

Key Features

• Get up-to-speed with building your own neural networks from scratch
• Gain insights into the mathematical principles behind deep learning algorithms
• Implement popular deep learning algorithms such as CNNs, RNNs, and more using TensorFlow

Book Description

Deep learning is one of the most popular domains in the AI space, allowing you to develop multi-layered models of varying complexities.

This book introduces you to popular deep learning algorithms—from basic to advanced—and shows you how to implement them from scratch using TensorFlow. Throughout the book, you will gain insights into each algorithm, the mathematical principles behind it, and how to implement it in the best possible manner. The book starts by explaining how you can build your own neural networks, followed by introducing you to TensorFlow, the powerful Python-based library for machine learning and deep learning. Moving on, you will get up to speed with gradient descent variants, such as NAG, AMSGrad, AdaDelta, Adam, and Nadam. The book will then provide you with insights into RNNs and LSTM and how to generate song lyrics with RNN. Next, you will master the math for convolutional and capsule networks, widely used for image recognition tasks. Then you learn how machines understand the semantics of words and documents using CBOW, skip-gram, and PV-DM. Afterward, you will explore various GANs, including InfoGAN and LSGAN, and autoencoders, such as contractive autoencoders and VAE.

By the end of this book, you will be equipped with all the skills you need to implement deep learning in your own projects.

What you will learn

• Implement basic-to-advanced deep learning algorithms
• Master the mathematics behind deep learning algorithms
• Become familiar with gradient descent and its variants, such as AMSGrad, AdaDelta, Adam, and Nadam
• Implement recurrent networks, such as RNN, LSTM, GRU, and seq2seq models
• Understand how machines interpret images using CNN and capsule networks
• Implement different types of generative adversarial network, such as CGAN, CycleGAN, and StackGAN
• Explore various types of autoencoder, such as Sparse autoencoders, DAE, CAE, and VAE

Who this book is for

If you are a machine learning engineer, data scientist, AI developer, or simply want to focus on neural networks and deep learning, this book is for you. Those who are completely new to deep learning, but have some experience in machine learning and Python programming, will also find the book very helpful.

Section 1: Getting Started with Deep Learning

In this section, we will get ourselves familiarized with deep learning and will understand the fundamental deep learning concepts. We will also learn about powerful deep learning framework called TensorFlow, and set TensorFlow up for all of our future deep learning tasks.

The following chapters are included in this section:

• Chapter 1, Introduction to Deep Learning
• Chapter 2, Getting to Know TensorFlow

Introduction to Deep Learning

Deep learning is a subset of machine learning inspired by the neural networks in the human brain. It has been around for a decade, but the reason it is so popular right now is due to the computational advancements and availability of the huge volume of data. With a huge volume of data, deep learning algorithms outperform classic machine learning. It has already been transfiguring and extensively used in several interdisciplinary scientific fields such as computer vision, natural language processing (NLP), speech recognition, and many others.

In this chapter, we will learn about the following topics:

• Fundamental concepts of deep learning
• Biological and artificial neurons
• Artificial neural network and its layers
• Activation functions
• Forward and backward propagation in ANN
• Gradient checking algorithm
• Building an artificial neural network from scratch

What is deep learning?

Deep learning is just a modern name for artificial neural networks with many layers. What is deep in deep learning though? It is basically due to the structure of the artificial neural network (ANN). ANN consists of some n number of layers to perform any computation. We can build an ANN with several layers where each layer is responsible for learning the intricate patterns in the data. Due to the computational advancements, we can build a network even with 100s or 1000s of layers deep. Since the ANN uses deep layers to perform learning we call it as deep learning and when ANN uses deep layers to learn we call it as a deep network. We have learned that deep learning is a subset of machine learning. How does deep learning differ from machine learning? What makes deep learning so special and popular?

The success of machine learning lies in the right set of features. Feature engineering plays a crucial role in machine learning. If we handcraft the right set of features to predict a certain outcome, then the machine learning algorithms can perform well, but finding and engineering the right set of features is not an easy task.

With deep learning, we don't have to handcraft such features. Since deep ANNs employ several layers, it learns the complex intrinsic features and multi-level abstract representation of data by itself. Let's explore this a bit with an analogy.

Let's suppose we want to perform an image classification task. Say, we are learning to recognize whether an image contains a dog or not. With machine learning, we need to handcraft features that help the model to understand whether the image contains a dog. We send these handcrafted features as inputs to machine learning algorithms which then learn a mapping between the features and the label (dog). But extracting features from an image is a tedious task. With deep learning, we just need ...