Python Parallel Programming Cookbook
eBook - ePub

Python Parallel Programming Cookbook

  1. 286 pages
  2. English
  3. ePUB (mobile friendly)
  4. Available on iOS & Android
eBook - ePub

Python Parallel Programming Cookbook

About this book

Master efficient parallel programming to build powerful applications using Python

About This Book

  • Design and implement efficient parallel software
  • Master new programming techniques to address and solve complex programming problems
  • Explore the world of parallel programming with this book, which is a go-to resource for different kinds of parallel computing tasks in Python, using examples and topics covered in great depth

Who This Book Is For

Python Parallel Programming Cookbook is intended for software developers who are well versed with Python and want to use parallel programming techniques to write powerful and efficient code. This book will help you master the basics and the advanced of parallel computing.

What You Will Learn

  • Synchronize multiple threads and processes to manage parallel tasks
  • Implement message passing communication between processes to build parallel applications
  • Program your own GPU cards to address complex problems
  • Manage computing entities to execute distributed computational tasks
  • Write efficient programs by adopting the event-driven programming model
  • Explore the cloud technology with DJango and Google App Engine
  • Apply parallel programming techniques that can lead to performance improvements

In Detail

This book will teach you parallel programming techniques using examples in Python and will help you explore the many ways in which you can write code that allows more than one process to happen at once. Starting with introducing you to the world of parallel computing, it moves on to cover the fundamentals in Python. This is followed by exploring the thread-based parallelism model using the Python threading module by synchronizing threads and using locks, mutex, semaphores queues, GIL, and the thread pool.

Next you will be taught about process-based parallelism where you will synchronize processes using message passing along with learning about the performance of MPI Python Modules. You will then go on to learn the asynchronous parallel programming model using the Python asyncio module along with handling exceptions. Moving on, you will discover distributed computing with Python, and learn how to install a broker, use Celery Python Module, and create a worker.

You will understand anche Pycsp, the Scoop framework, and disk modules in Python. Further on, you will learnGPU programming withPython using the PyCUDA module along with evaluating performance limitations.

Style and approach

A step-by-step guide to parallel programming using Python, with recipes accompanied by one or more programming examples. It is a practically oriented book and has all the necessary underlying parallel computing concepts.

Tools to learn more effectively

Saving Books

Saving Books

Keyword Search

Keyword Search

Annotating Text

Annotating Text

Listen to it instead

Listen to it instead

Information

Python Parallel Programming Cookbook


Table of Contents

Python Parallel Programming Cookbook
Credits
About the Author
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers, and more
Why Subscribe?
Free Access for Packt account holders
Preface
What this book covers
What you need for this book
Who this book is for
Sections
Getting ready
How to do it…
How it works…
There's more…
See also
Conventions
Reader feedback
Customer support
Downloading the example code
Errata
Piracy
Questions
1. Getting Started with Parallel Computing and Python
Introduction
The parallel computing memory architecture
SISD
MISD
SIMD
MIMD
Memory organization
Shared memory
Distributed memory
Massively parallel processing
A cluster of workstations
The heterogeneous architecture
Parallel programming models
The shared memory model
The multithread model
The message passing model
The data parallel model
How to design a parallel program
Task decomposition
Task assignment
Agglomeration
Mapping
Dynamic mapping
Manager/worker
Hierarchical manager/worker
Decentralize
How to evaluate the performance of a parallel program
Speedup
Efficiency
Scaling
Amdahl's law
Gustafson's law
Introducing Python
Getting ready
How to do it…
Python in a parallel world
Introducing processes and threads
Start working with processes in Python
Getting ready
How to do it…
How it works…
Start working with threads in Python
How to do it…
How it works…
2. Thread-based Parallelism
Introduction
Using the Python threading module
How to define a thread
How to do it…
How it works…
How to determine the current thread
How to do it…
How it works…
How to use a thread in a subclass
How to do it…
How it works…
Thread synchronization with Lock and RLock
How to do it…
How it works…
There's more…
Thread synchronization with RLock
How to do it…
How it works…
Thread synchronization with semaphores
Getting ready
How to do it…
How it works…
There's more…
Thread synchronization with a condition
Getting ready
How to do it…
How it works…
There's more…
Thread synchronization with an event
How to do it…
How it works…
Using the with statement
Getting ready
How to do it…
How it works…
There's more…
Thread communication using a queue
How to do it…
How it works…
Evaluating the performance of multithread applications
How to do it…
How it works…
The first test
The second test
The third test
The fourth test
There's more…
3. Process-based Parallelism
Introduction
How to spawn a process
How to do it...
How it works...
There's more...
How to name a process
How to do it...
How it works...
How to run a process in the background
How to do it...
How it works...
There's more...
How to kill a process
How to do it...
How it works...
How to use a process in a subclass
How to do it...
How it works...
How to exchange objects between processes
Using queue to exchange objects
How to do it...
How it works...
There's more...
Using pipes to exchange objects
How to do it...
How it works...
How to synchronize processes
How to do it...
How it works...
How to manage a state between processes
How to do it...
How it works...
How to use a process pool
How to do it…
How it works…
Using the mpi4py Python module
Getting ready
How to do it…
How it works…
There's more…
Point-to-point communication
How to do it…
How it works…
There's more…
Avoiding deadlock problems
How to do it…
How it works…
There's more…
Collective communication using broadcast
How to do it…
How it works…
There's more…
Collective communication using scatter
How to do it…
How it works…
There's more…
Collective communication using gather
How to do it…
How it works…
There's more…
Collective communication using Alltoall
How to do it…
How it works…
There's more…
The reduction operation
How to do it…
How it works…
How to optimize communication
How to do it…
How it works…
There's more…
4. Asynchronous Programming
Introduction
Using the concurrent.futures Python modules
Dealing with the process and thread pool
Getting ready
How to do it…
How it works…
There's more…
Event loop management with Asyncio
What is an event loop
Getting ready
How to do it…
How it works…
Handling coroutines with Asyncio
Getting ready
How to do it…
How it works…
Task manipulation with Asyncio
Getting ready
How to do it…
How it works…
Dealing with Asyncio and Futures
Getting ready
How to do it…
How it works…
There's more…
5. Distributed Python
Introduction
Using Celery to distribute tasks
How to do it…
See also
How to create a task with Celery
How to do it…
How it works…
There's more…
Scientific computing with SCOOP
Getting ready
How to do it…
How it works…
Handling map functions with SCOOP
Getting ready
How to do it…
How it works…
Remote Method Invocation with Pyro4
Getting ready
How to do it…
How it works…
Chaining objects with Pyro4
How to do it…
How it works…
Developing a client-server application with Pyro4
How to do it…
How it works…
Communicating sequential processes with PyCSP
Getting ready
How to do it…
How it works…
There's more…
Using MapReduce with Disco
Getting ready
How to do it…
How it works…
There's more…
A remote procedure call with RPyC
Getting ready
How to do it…
How it works…
6. GPU Programming with Python
Introduction
Using the PyCUDA module
A hybrid programming model
The kernel and thread hierarchy
Getting ready
How to do it…
How it works…
See also
How to build a PyCUDA application
How to do it…
How it works…
There's more…
Understanding the PyCUDA memory model with matrix manipulat...

Table of contents

  1. Python Parallel Programming Cookbook

Frequently asked questions

Yes, you can cancel anytime from the Subscription tab in your account settings on the Perlego website. Your subscription will stay active until the end of your current billing period. Learn how to cancel your subscription
No, books cannot be downloaded as external files, such as PDFs, for use outside of Perlego. However, you can download books within the Perlego app for offline reading on mobile or tablet. Learn how to download books offline
Perlego offers two plans: Essential and Complete
  • Essential is ideal for learners and professionals who enjoy exploring a wide range of subjects. Access the Essential Library with 800,000+ trusted titles and best-sellers across business, personal growth, and the humanities. Includes unlimited reading time and Standard Read Aloud voice.
  • Complete: Perfect for advanced learners and researchers needing full, unrestricted access. Unlock 1.4M+ books across hundreds of subjects, including academic and specialized titles. The Complete Plan also includes advanced features like Premium Read Aloud and Research Assistant.
Both plans are available with monthly, semester, or annual billing cycles.
We are an online textbook subscription service, where you can get access to an entire online library for less than the price of a single book per month. With over 1 million books across 990+ topics, we’ve got you covered! Learn about our mission
Look out for the read-aloud symbol on your next book to see if you can listen to it. The read-aloud tool reads text aloud for you, highlighting the text as it is being read. You can pause it, speed it up and slow it down. Learn more about Read Aloud
Yes! You can use the Perlego app on both iOS and Android devices to read anytime, anywhere — even offline. Perfect for commutes or when you’re on the go.
Please note we cannot support devices running on iOS 13 and Android 7 or earlier. Learn more about using the app
Yes, you can access Python Parallel Programming Cookbook by Giancarlo Zaccone in PDF and/or ePUB format, as well as other popular books in Informatica & Programmazione in Python. We have over one million books available in our catalogue for you to explore.