Deep Learning with Theano
eBook - ePub

Deep Learning with Theano

Christopher Bourez

Condividi libro
  1. 300 pagine
  2. English
  3. ePUB (disponibile sull'app)
  4. Disponibile su iOS e Android
eBook - ePub

Deep Learning with Theano

Christopher Bourez

Dettagli del libro
Anteprima del libro
Indice dei contenuti
Citazioni

Informazioni sul libro

Develop deep neural networks in Theano with practical code examples for image classification, machine translation, reinforcement agents, or generative models.About This Book• Learn Theano basics and evaluate your mathematical expressions faster and in an efficient manner• Learn the design patterns of deep neural architectures to build efficient and powerful networks on your datasets• Apply your knowledge to concrete fields such as image classification, object detection, chatbots, machine translation, reinforcement agents, or generative models.Who This Book Is ForThis book is indented to provide a full overview of deep learning. From the beginner in deep learning and artificial intelligence, to the data scientist who wants to become familiar with Theano and its supporting libraries, or have an extended understanding of deep neural nets.Some basic skills in Python programming and computer science will help, as well as skills in elementary algebra and calculus.What You Will Learn• Get familiar with Theano and deep learning• Provide examples in supervised, unsupervised, generative, or reinforcement learning.• Discover the main principles for designing efficient deep learning nets: convolutions, residual connections, and recurrent connections.• Use Theano on real-world computer vision datasets, such as for digit classification and image classification.• Extend the use of Theano to natural language processing tasks, for chatbots or machine translation• Cover artificial intelligence-driven strategies to enable a robot to solve games or learn from an environment• Generate synthetic data that looks real with generative modeling• Become familiar with Lasagne and Keras, two frameworks built on top of TheanoIn DetailThis book offers a complete overview of Deep Learning with Theano, a Python-based library that makes optimizing numerical expressions and deep learning models easy on CPU or GPU.The book provides some practical code examples that help the beginner understand how easy it is to build complex neural networks, while more experimented data scientists will appreciate the reach of the book, addressing supervised and unsupervised learning, generative models, reinforcement learning in the fields of image recognition, natural language processing, or game strategy.The book also discusses image recognition tasks that range from simple digit recognition, image classification, object localization, image segmentation, to image captioning. Natural language processing examples include text generation, chatbots, machine translation, and question answering. The last example deals with generating random data that looks real and solving games such as in the Open-AI gym.At the end, this book sums up the best -performing nets for each task. While early research results were based on deep stacks of neural layers, in particular, convolutional layers, the book presents the principles that improved the efficiency of these architectures, in order to help the reader build new custom nets.Style and approachIt is an easy-to-follow example book that teaches you how to perform fast, efficient computations in Python. Starting with the very basics-NumPy, installing Theano, this book will take you to the smooth journey of implementing Theano for advanced computations for machine learning and deep learning.

Domande frequenti

Come faccio ad annullare l'abbonamento?
È semplicissimo: basta accedere alla sezione Account nelle Impostazioni e cliccare su "Annulla abbonamento". Dopo la cancellazione, l'abbonamento rimarrà attivo per il periodo rimanente già pagato. Per maggiori informazioni, clicca qui
È possibile scaricare libri? Se sì, come?
Al momento è possibile scaricare tramite l'app tutti i nostri libri ePub mobile-friendly. Anche la maggior parte dei nostri PDF è scaricabile e stiamo lavorando per rendere disponibile quanto prima il download di tutti gli altri file. Per maggiori informazioni, clicca qui
Che differenza c'è tra i piani?
Entrambi i piani ti danno accesso illimitato alla libreria e a tutte le funzionalità di Perlego. Le uniche differenze sono il prezzo e il periodo di abbonamento: con il piano annuale risparmierai circa il 30% rispetto a 12 rate con quello mensile.
Cos'è Perlego?
Perlego è un servizio di abbonamento a testi accademici, che ti permette di accedere a un'intera libreria online a un prezzo inferiore rispetto a quello che pagheresti per acquistare un singolo libro al mese. Con oltre 1 milione di testi suddivisi in più di 1.000 categorie, troverai sicuramente ciò che fa per te! Per maggiori informazioni, clicca qui.
Perlego supporta la sintesi vocale?
Cerca l'icona Sintesi vocale nel prossimo libro che leggerai per verificare se è possibile riprodurre l'audio. Questo strumento permette di leggere il testo a voce alta, evidenziandolo man mano che la lettura procede. Puoi aumentare o diminuire la velocità della sintesi vocale, oppure sospendere la riproduzione. Per maggiori informazioni, clicca qui.
Deep Learning with Theano è disponibile online in formato PDF/ePub?
Sì, puoi accedere a Deep Learning with Theano di Christopher Bourez in formato PDF e/o ePub, così come ad altri libri molto apprezzati nelle sezioni relative a Computer Science e Neural Networks. Scopri oltre 1 milione di libri disponibili nel nostro catalogo.

Informazioni

Anno
2017
ISBN
9781786463050
Edizione
1

Deep Learning with Theano


Table of Contents

Deep Learning with Theano
Credits
About the Author
Acknowledgments
About the Reviewers
www.PacktPub.com
eBooks, discount offers, and more
Why subscribe?
Customer Feedback
Preface
What this book covers
Why Theano?
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Downloading the example code
Errata
Piracy
Questions
1. Theano Basics
The need for tensors
Installing and loading Theano
Conda package and environment manager
Installing and running Theano on CPU
GPU drivers and libraries
Installing and running Theano on GPU
Tensors
Graphs and symbolic computing
Operations on tensors
Dimension manipulation operators
Elementwise operators
Reduction operators
Linear algebra operators
Memory and variables
Functions and automatic differentiation
Loops in symbolic computing
Configuration, profiling and debugging
Summary
2. Classifying Handwritten Digits with a Feedforward Network
The MNIST dataset
Structure of a training program
Classification loss function
Single-layer linear model
Cost function and errors
Backpropagation and stochastic gradient descent
Multiple layer model
Convolutions and max layers
Training
Dropout
Inference
Optimization and other update rules
Related articles
Summary
3. Encoding Word into Vector
Encoding and embedding
Dataset
Continuous Bag of Words model
Training the model
Visualizing the learned embeddings
Evaluating embeddings – analogical reasoning
Evaluating embeddings – quantitative analysis
Application of word embeddings
Weight tying
Further reading
Summary
4. Generating Text with a Recurrent Neural Net
Need for RNN
A dataset for natural language
Simple recurrent network
LSTM network
Gated recurrent network
Metrics for natural language performance
Training loss comparison
Example of predictions
Applications of RNN
Related articles
Summary
5. Analyzing Sentiment with a Bidirectional LSTM
Installing and configuring Keras
Programming with Keras
SemEval 2013 dataset
Preprocessing text data
Designing the architecture for the model
Vector representations of words
Sentence representation using bi-LSTM
Outputting probabilities with the softmax classifier
Compiling and training the model
Evaluating the model
Saving and loading the model
Running the example
Further reading
Summary
6. Locating with Spatial Transformer Networks
MNIST CNN model with Lasagne
A localization network
Recurrent neural net applied to images
Unsupervised learning with co-localization
Region-based localization networks
Further reading
Summary
7. Classifying Images with Residual Networks
Natural image datasets
Batch normalization
Global average pooling
Residual connections
Stochastic depth
Dense connections
Multi-GPU
Data augmentation
Further reading
Summary
8. Translating and Explaining with Encoding – decoding Networks
Sequence-to-sequence networks for natural language processing
Seq2seq for translation
Seq2seq for chatbots
Improving efficiency of sequence-to-sequence network
Deconvolutions for images
Multimodal deep learning
Further reading
Summary
9. Selecting Relevant Inputs or Memories with the Mechanism of Attention
Differentiable mechanism of attention
Better translations with attention mechanism
Better annotate images with attention mechanism
Store and retrieve information in Neural Turing Machines
Memory networks
Episodic memory with dynamic memory networks
Further reading
Summary
10. Predicting Times Sequences with Advanced RNN
Dropout for RNN
Deep approaches for RNN
Stacked recurrent networks
Deep transition recurrent network
Highway networks design principle
Recurrent Highway Networks
Further reading
Summary
11. Learning from the Environment with Reinforcement
Reinforcement learning tasks
Simulation environments
Q-learning
Deep Q-network
Training stability
Policy gradients with REINFORCE algorithms
Related articles
Summary
12. Learning Features with Unsupervised Generative Networks
Generative models
Restricted Boltzmann Machines
Deep belief bets
Generative adversarial networks
Improve GANs
Semi-supervised learning
Further reading
Summary
13. Extending Deep Learning with Theano
Theano Op in Python for CPU
Theano Op in Python for the GPU
Theano Op in C for CPU
Theano Op in C for GPU
Coalesced transpose via shared memory, NVIDIA parallel for all
Model conversions
The future of artificial intelligence
Further reading
Summary
Index

Deep Learning with Theano

Copyright © 2017 Packt Publishing
All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.
Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author,...

Indice dei contenuti