Python Parallel Programming Cookbook
eBook - ePub

Python Parallel Programming Cookbook

Giancarlo Zaccone

Buch teilen
  1. 286 Seiten
  2. English
  3. ePUB (handyfreundlich)
  4. Über iOS und Android verfügbar
eBook - ePub

Python Parallel Programming Cookbook

Giancarlo Zaccone

Angaben zum Buch
Buchvorschau
Inhaltsverzeichnis
Quellenangaben

Über dieses Buch

Master efficient parallel programming to build powerful applications using Python

About This Book

  • Design and implement efficient parallel software
  • Master new programming techniques to address and solve complex programming problems
  • Explore the world of parallel programming with this book, which is a go-to resource for different kinds of parallel computing tasks in Python, using examples and topics covered in great depth

Who This Book Is For

Python Parallel Programming Cookbook is intended for software developers who are well versed with Python and want to use parallel programming techniques to write powerful and efficient code. This book will help you master the basics and the advanced of parallel computing.

What You Will Learn

  • Synchronize multiple threads and processes to manage parallel tasks
  • Implement message passing communication between processes to build parallel applications
  • Program your own GPU cards to address complex problems
  • Manage computing entities to execute distributed computational tasks
  • Write efficient programs by adopting the event-driven programming model
  • Explore the cloud technology with DJango and Google App Engine
  • Apply parallel programming techniques that can lead to performance improvements

In Detail

This book will teach you parallel programming techniques using examples in Python and will help you explore the many ways in which you can write code that allows more than one process to happen at once. Starting with introducing you to the world of parallel computing, it moves on to cover the fundamentals in Python. This is followed by exploring the thread-based parallelism model using the Python threading module by synchronizing threads and using locks, mutex, semaphores queues, GIL, and the thread pool.

Next you will be taught about process-based parallelism where you will synchronize processes using message passing along with learning about the performance of MPI Python Modules. You will then go on to learn the asynchronous parallel programming model using the Python asyncio module along with handling exceptions. Moving on, you will discover distributed computing with Python, and learn how to install a broker, use Celery Python Module, and create a worker.

You will understand anche Pycsp, the Scoop framework, and disk modules in Python. Further on, you will learnGPU programming withPython using the PyCUDA module along with evaluating performance limitations.

Style and approach

A step-by-step guide to parallel programming using Python, with recipes accompanied by one or more programming examples. It is a practically oriented book and has all the necessary underlying parallel computing concepts.

Häufig gestellte Fragen

Wie kann ich mein Abo kündigen?
Gehe einfach zum Kontobereich in den Einstellungen und klicke auf „Abo kündigen“ – ganz einfach. Nachdem du gekündigt hast, bleibt deine Mitgliedschaft für den verbleibenden Abozeitraum, den du bereits bezahlt hast, aktiv. Mehr Informationen hier.
(Wie) Kann ich Bücher herunterladen?
Derzeit stehen all unsere auf Mobilgeräte reagierenden ePub-Bücher zum Download über die App zur Verfügung. Die meisten unserer PDFs stehen ebenfalls zum Download bereit; wir arbeiten daran, auch die übrigen PDFs zum Download anzubieten, bei denen dies aktuell noch nicht möglich ist. Weitere Informationen hier.
Welcher Unterschied besteht bei den Preisen zwischen den Aboplänen?
Mit beiden Aboplänen erhältst du vollen Zugang zur Bibliothek und allen Funktionen von Perlego. Die einzigen Unterschiede bestehen im Preis und dem Abozeitraum: Mit dem Jahresabo sparst du auf 12 Monate gerechnet im Vergleich zum Monatsabo rund 30 %.
Was ist Perlego?
Wir sind ein Online-Abodienst für Lehrbücher, bei dem du für weniger als den Preis eines einzelnen Buches pro Monat Zugang zu einer ganzen Online-Bibliothek erhältst. Mit über 1 Million Büchern zu über 1.000 verschiedenen Themen haben wir bestimmt alles, was du brauchst! Weitere Informationen hier.
Unterstützt Perlego Text-zu-Sprache?
Achte auf das Symbol zum Vorlesen in deinem nächsten Buch, um zu sehen, ob du es dir auch anhören kannst. Bei diesem Tool wird dir Text laut vorgelesen, wobei der Text beim Vorlesen auch grafisch hervorgehoben wird. Du kannst das Vorlesen jederzeit anhalten, beschleunigen und verlangsamen. Weitere Informationen hier.
Ist Python Parallel Programming Cookbook als Online-PDF/ePub verfügbar?
Ja, du hast Zugang zu Python Parallel Programming Cookbook von Giancarlo Zaccone im PDF- und/oder ePub-Format sowie zu anderen beliebten Büchern aus Informatica & Programmazione in Python. Aus unserem Katalog stehen dir über 1 Million Bücher zur Verfügung.

Information

Jahr
2015
ISBN
9781785289583

Python Parallel Programming Cookbook


Table of Contents

Python Parallel Programming Cookbook
Credits
About the Author
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers, and more
Why Subscribe?
Free Access for Packt account holders
Preface
What this book covers
What you need for this book
Who this book is for
Sections
Getting ready
How to do it…
How it works…
There's more…
See also
Conventions
Reader feedback
Customer support
Downloading the example code
Errata
Piracy
Questions
1. Getting Started with Parallel Computing and Python
Introduction
The parallel computing memory architecture
SISD
MISD
SIMD
MIMD
Memory organization
Shared memory
Distributed memory
Massively parallel processing
A cluster of workstations
The heterogeneous architecture
Parallel programming models
The shared memory model
The multithread model
The message passing model
The data parallel model
How to design a parallel program
Task decomposition
Task assignment
Agglomeration
Mapping
Dynamic mapping
Manager/worker
Hierarchical manager/worker
Decentralize
How to evaluate the performance of a parallel program
Speedup
Efficiency
Scaling
Amdahl's law
Gustafson's law
Introducing Python
Getting ready
How to do it…
Python in a parallel world
Introducing processes and threads
Start working with processes in Python
Getting ready
How to do it…
How it works…
Start working with threads in Python
How to do it…
How it works…
2. Thread-based Parallelism
Introduction
Using the Python threading module
How to define a thread
How to do it…
How it works…
How to determine the current thread
How to do it…
How it works…
How to use a thread in a subclass
How to do it…
How it works…
Thread synchronization with Lock and RLock
How to do it…
How it works…
There's more…
Thread synchronization with RLock
How to do it…
How it works…
Thread synchronization with semaphores
Getting ready
How to do it…
How it works…
There's more…
Thread synchronization with a condition
Getting ready
How to do it…
How it works…
There's more…
Thread synchronization with an event
How to do it…
How it works…
Using the with statement
Getting ready
How to do it…
How it works…
There's more…
Thread communication using a queue
How to do it…
How it works…
Evaluating the performance of multithread applications
How to do it…
How it works…
The first test
The second test
The third test
The fourth test
There's more…
3. Process-based Parallelism
Introduction
How to spawn a process
How to do it...
How it works...
There's more...
How to name a process
How to do it...
How it works...
How to run a process in the background
How to do it...
How it works...
There's more...
How to kill a process
How to do it...
How it works...
How to use a process in a subclass
How to do it...
How it works...
How to exchange objects between processes
Using queue to exchange objects
How to do it...
How it works...
There's more...
Using pipes to exchange objects
How to do it...
How it works...
How to synchronize processes
How to do it...
How it works...
How to manage a state between processes
How to do it...
How it works...
How to use a process pool
How to do it…
How it works…
Using the mpi4py Python module
Getting ready
How to do it…
How it works…
There's more…
Point-to-point communication
How to do it…
How it works…
There's more…
Avoiding deadlock problems
How to do it…
How it works…
There's more…
Collective communication using broadcast
How to do it…
How it works…
There's more…
Collective communication using scatter
How to do it…
How it works…
There's more…
Collective communication using gather
How to do it…
How it works…
There's more…
Collective communication using Alltoall
How to do it…
How it works…
There's more…
The reduction operation
How to do it…
How it works…
How to optimize communication
How to do it…
How it works…
There's more…
4. Asynchronous Programming
Introduction
Using the concurrent.futures Python modules
Dealing with the process and thread pool
Getting ready
How to do it…
How it works…
There's more…
Event loop management with Asyncio
What is an event loop
Getting ready
How to do it…
How it works…
Handling coroutines with Asyncio
Getting ready
How to do it…
How it works…
Task manipulation with Asyncio
Getting ready
How to do it…
How it works…
Dealing with Asyncio and Futures
Getting ready
How to do it…
How it works…
There's more…
5. Distributed Python
Introduction
Using Celery to distribute tasks
How to do it…
See also
How to create a task with Celery
How to do it…
How it works…
There's more…
Scientific computing with SCOOP
Getting ready
How to do it…
How it works…
Handling map functions with SCOOP
Getting ready
How to do it…
How it works…
Remote Method Invocation with Pyro4
Getting ready
How to do it…
How it works…
Chaining objects with Pyro4
How to do it…
How it works…
Developing a client-server application with Pyro4
How to do it…
How it works…
Communicating sequential processes with PyCSP
Getting ready
How to do it…
How it works…
There's more…
Using MapReduce with Disco
Getting ready
How to do it…
How it works…
There's more…
A remote procedure call with RPyC
Getting ready
How to do it…
How it works…
6. GPU Programming with Python
Introduction
Using the PyCUDA module
A hybrid programming model
The kernel and thread hierarchy
Getting ready
How to do it…
How it works…
See also
How to build a PyCUDA application
How to do it…
How it works…
There's more…
Understanding the PyCUDA memory model with matrix manipulat...

Inhaltsverzeichnis