Multimedia Programming with Pure Data

Bryan WC Chung

• Publisher: Packt Publishing
• Year: 2013
• eBook ISBN: 9781782164647
• Edition: 1
• Topic: Computer Science
• Subtopic: Computer Graphics
• Index: Computer Science

In Detail

Preparing interactive displays, creating computer games, and conducting audio-visual performance are now achievable without typing lines of code. With Pure Data, a graphical programming environment, creating interactive multimedia applications is just visually connecting graphical icons together. It is straightforward, intuitive, and effective.

"Multimedia Programming with Pure Data" will show you how to create interactive multimedia applications. You will learn how to author various digital media, such as images, animations, audio, and videos together to form a coherent title. From simple to sophisticated interaction techniques, you will learn to apply these techniques in your practical multimedia projects.

You start from making 2D and 3D computer graphics and proceed to animation, multimedia presentation, interface design, and more sophisticated computer vision applications with interactivity. With Pure Data and GEM, you will learn to produce animations with 2D digital imagery, 3D modelling, and particle systems. You can also design graphical interfaces, and use live video for motion tracking applications. Furthermore, you will learn Audio signal processing, which forms the key aspect to multimedia content creation. Last but not least, Network programming using Pure Data extension libraries explores applications to other portable devices.

Approach

A quick and comprehensive tutorial book for media designers to jump-start interactive multimedia production with computer graphics, digital audio, digital video, and interactivity, using the Pure Data graphical programming environment.

Who this book is for

An introductory book on multimedia programming for media artists/designers who like to work on interactivity in their projects, digital art/design students who like to learn the first multimedia programming technique, and audio-visual performers who like to customize their performance sets.

Multimedia Programming with Pure Data

---

Table of Contents

Multimedia Programming with Pure Data

Credits

About the Author

About the Reviewers

www.PacktPub.com

Support files, eBooks, discount offers and more

Why Subscribe?

Free Access for Packt account holders

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Errata

Piracy

Questions

1. Getting Started with Pure Data

Creating the first program

Understanding the terms and interface

Displaying messages

Performing arithmetic calculation

Creating a counter

Automating the counter

Making an animation with the interface elements

Using the graphical interface objects

Summary

2. Computer Graphics with the GEM Library

Using the GEM display window

Drawing basic 2D graphics

Understanding the coordinates system

Drawing basic 3D primitive shapes

Working with digital color

Applying geometric transformation

Performing translation, rotation, and scaling

Checking the margins of the window

Order of transformations

Creating animation in 3D space

Summary

3. Image Processing

Obtaining images from external sources

Applying image filters

Layering multiple images

Working with time

Performing background removal

Working with chroma key

Experimenting with advanced effects

Layering with gemhead

Coloring pixel data

Creating painterly effect

Summary

4. Interactivity

Obtaining the mouse position

Responding to keyboard events

Creating a graphical button

Preparing a video-jockey instrument

Creating interactive animation

Animate the moving ball

Bouncing the ball on the four margins

Creating the paddle control

Keeping and displaying the score

Summary

5. Motion Detection

Obtaining the frame difference

Detecting presence

Detecting motion

Creating a motion detection animation

Comparing colors

Performing color detection

Making an air drum

Summary

6. Animation with Particle System

Understanding a particle system

Creating a basic particle system

Applying forces to the particles system

Interacting with the mouse

Rendering particles with images

Combining particle system with motion-tracking

Summary

7. Audio Programming

Preparing for audio processing

Using existing sound files

Generating audio with waves

Working with MIDI

Obtaining audio input for interaction

Summary

8. Interface with the Outside World

Communicating through the Internet

Making the connection

Sending messages

Sending numbers

Controlling the visual display of another computer

Using Open Sound Control with mobile devices

Connecting the TUIOpad to the host computer

Decoding the OSC messages

Tracking multiple points

Drawing the graphics

Interfacing with custom hardware through Arduino

Digital output

Servomotor control

Digital input

Analog input

Summary

9. Extending Pure Data

Integrating with OpenCV

Working with the Kinect camera

Installation of libfreenect

Installation of OpenNI

Summary

A. Communities and References

Pure Data communities

Pure Data events

Pure Data artists and organizations

Reactable

GOTO10

Claude Heiland-Allen

Jun Lee

Hans-Christoph Steiner

Piksel

Baran Gülesen

Andy Farnell

Ben Bogart

Matthias Kronlachner

References

Index

Multimedia Programming with Pure Data

Copyright © 2013 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

First published: July 2013

Production Reference: 1020713

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham B3 2PB, UK..

ISBN 978-1-78216-464-7

www.packtpub.com

Cover Image by Suresh Mogre (<[email protected]>)

Credits

Author

Bryan WC Chung

Reviewers

Buron Cédric

Guy John

Antonio Roberts

Greg Surges

Acquisition Editor

Vinay Argekar

Lead Technical Editor

Ankita Shashi

Technical Editors

Sampreshita Maheshwari

Kaustubh S. Mayekar

Zafeer Rais

Project Coordinator

Anurag Banerjee

Proofreaders

Am...

Table of contents

• Multimedia Programming with Pure Data