eBook - ePub
Mastering OpenCV with Practical Computer Vision Projects
Shervin Emami, Khvedchenia Levgen, Naureen Mahmood, Jason Saragih, Roy Shilkrot, David Millan Escriva, Daniel Lelis Baggio
This is a test
Share book
- 340 pages
- English
- ePUB (mobile friendly)
- Available on iOS & Android
eBook - ePub
Mastering OpenCV with Practical Computer Vision Projects
Shervin Emami, Khvedchenia Levgen, Naureen Mahmood, Jason Saragih, Roy Shilkrot, David Millan Escriva, Daniel Lelis Baggio
Book details
Book preview
Table of contents
Citations
About This Book
In Detail
Computer Vision is fast becoming an important technology and is used in Mars robots, national security systems, automated factories, driver-less cars, and medical image analysis to new forms of human-computer interaction. OpenCV is the most common library for computer vision, providing hundreds of complex and fast algorithms. But it has a steep learning curve and limited in-depth tutorials.
Mastering OpenCV with Practical Computer Vision Projects is the perfect book for developers with just basic OpenCV skills who want to try practical computer vision projects, as well as the seasoned OpenCV experts who want to add more Computer Vision topics to their skill set or gain more experience with OpenCV's new C++ interface before migrating from the C API to the C++ API.
Each chapter is a separate project including the necessary background knowledge, so try them all one-by-one or jump straight to the projects you're most interested in.
Create working prototypes from this book including real-time mobile apps, Augmented Reality, 3D shape from video, or track faces & eyes, fluid wall using Kinect, number plate recognition and so on.
Mastering OpenCV with Practical Computer Vision Projects gives you rapid training in nine computer vision areas with useful projects.
Approach
Each chapter in the book is an individual project and each project is constructed with step-by-step instructions, clearly explained code, and includes the necessary screenshots.
Who this book is for
You should have basic OpenCV and C/C++ programming experience before reading this book, as it is aimed at Computer Science graduates, researchers, and computer vision experts widening their expertise.
Frequently asked questions
How do I cancel my subscription?
Can/how do I download books?
At the moment all of our mobile-responsive ePub books are available to download via the app. Most of our PDFs are also available to download and we're working on making the final remaining ones downloadable now. Learn more here.
What is the difference between the pricing plans?
Both plans give you full access to the library and all of Perlego’s features. The only differences are the price and subscription period: With the annual plan you’ll save around 30% compared to 12 months on the monthly plan.
What is Perlego?
We are an online textbook subscription service, where you can get access to an entire online library for less than the price of a single book per month. With over 1 million books across 1000+ topics, we’ve got you covered! Learn more here.
Do you support text-to-speech?
Look out for the read-aloud symbol on your next book to see if you can listen to it. The read-aloud tool reads text aloud for you, highlighting the text as it is being read. You can pause it, speed it up and slow it down. Learn more here.
Is Mastering OpenCV with Practical Computer Vision Projects an online PDF/ePUB?
Yes, you can access Mastering OpenCV with Practical Computer Vision Projects by Shervin Emami, Khvedchenia Levgen, Naureen Mahmood, Jason Saragih, Roy Shilkrot, David Millan Escriva, Daniel Lelis Baggio in PDF and/or ePUB format, as well as other popular books in Ciencia de la computación & Ciencias computacionales general. We have over one million books available in our catalogue for you to explore.
Information
Mastering OpenCV with Practical Computer Vision Projects
Table of Contents
Mastering OpenCV with Practical Computer Vision Projects
Credits
About the Authors
About the Reviewers
www.PacktPub.com
Support files, eBooks, discount offers and more
Why Subscribe?
Free Access for Packt account holders
Preface
What this book covers
What you need for this book
Who this book is for
Conventions
Reader feedback
Customer support
Downloading the example code
Errata
Piracy
Questions
1. Cartoonifier and Skin Changer for Android
Accessing the webcam
Main camera processing loop for a desktop app
Generating a black-and-white sketch
Generating a color painting and a cartoon
Generating an "evil" mode using edge filters
Generating an "alien" mode using skin detection
Skin-detection algorithm
Showing the user where to put their face
Implementation of the skin-color changer
Porting from desktop to Android
Setting up an Android project that uses OpenCV
Color formats used for image processing on Android
Input color format from the camera
Output color format for display
Adding the cartoonifier code to the Android NDK app
Reviewing the Android app
Cartoonifying the image when the user taps the screen
Saving the image to a file and to the Android picture gallery
Showing an Android notification message about a saved image
Changing cartoon modes through the Android menu bar
Reducing the random pepper noise from the sketch image
Showing the FPS of the app
Using a different camera resolution
Customizing the app
Summary
2. Marker-based Augmented Reality on iPhone or iPad
Creating an iOS project that uses OpenCV
Adding OpenCV framework
Including OpenCV headers
Application architecture
Accessing the camera
Marker detection
Marker identification
Grayscale conversion
Image binarization
Contours detection
Candidates search
Marker code recognition
Reading marker code
Marker location refinement
Placing a marker in 3D
Camera calibration
Marker pose estimation
Rendering the 3D virtual object
Creating the OpenGL rendering layer
Rendering an AR scene
Summary
References
3. Marker-less Augmented Reality
Marker-based versus marker-less AR
Using feature descriptors to find an arbitrary image on video
Feature extraction
Definition of a pattern object
Matching of feature points
PatternDetector.cpp
Outlier removal
Cross-match filter
Ratio test
PatternDetector.cpp
Homography estimation
PatternDetector.cpp
Homography refinement
PatternDetector.cpp
Putting it all together
Pattern pose estimation
PatternDetector.cpp
Obtaining the camera-intrinsic matrix
Pattern.cpp
Application infrastructure
ARPipeline.hpp
ARPipeline.cpp
Enabling support for 3D visualization in OpenCV
Creating OpenGL windows using OpenCV
Video capture using OpenCV
Rendering augmented reality
ARDrawingContext.hpp
ARDrawingContext.cpp
Demonstration
main.cpp
Summary
References
4. Exploring Structure from Motion Using OpenCV
Structure from Motion concepts
Estimating the camera motion from a pair of images
Point matching using rich feature descriptors
Point matching using optical flow
Finding camera matrices
Reconstructing the scene
Reconstruction from many views
Refinement of the reconstruction
Visualizing 3D point clouds with PCL
Using the example code
Summary
References
5. Number Plate Recognition Using SVM and Neural Networks
Introduction to ANPR
ANPR algorithm
Plate detection
Segmentation
Classification
Plate recognition
OCR segmentation
Feature extraction
OCR classification
Evaluation
Summary
6. Non-rigid Face Tracking
Overview
Utilities
Object-oriented design
Data collection: Image and video annotation
Training data types
Annotation tool
Pre-annotated data (The MUCT dataset)
Geometrical constraints
Procrustes analysis
Linear shape models
A combined local-global representation
Training and visualization
Facial feature detectors
Correlation-based patch models
Learning discriminative patch models
Generative versus discriminative patch models
Accounting for global geometric transformations
Training and visualization
Face detection and initialization
Face tracking
Face tracker implementation
Training and visualization
Generic versus person-specific models
Summary
References
7. 3D Head Pose Estimation Using AAM and POSIT
Active Appearance Models overview
Active Shape Models
Getting the feel of PCA
Triangulation
Triangle texture warping
Model Instantiation – playing with the Active Appearance Model
AAM search and fitting
POSIT
Diving into POSIT
POSIT and head model
Tracking from webcam or video file
Summary
References
8. Face Recognition using Eigenfaces or Fisherfaces
Introduction to face recognition and face detection
Step 1: Face detection
Implementing face detection using OpenCV
Loading a Haar or LBP detector for object or face detection
Accessing the webcam
Detecting an object using the Haar or LBP Classifier
Grayscale color conversion
Shrinking the camera image
Histogram equalization
Detecting the face
Step 2: Face preprocessing
Eye detection
Eye search regions
Geometrical transformation
Separate histogram equalization for left and right sides
Smoothing
Elliptical mask
Step 3: Collecting faces and learning from them
Collecting preprocessed faces for training
Training the face recognition system from collected faces
Viewing the learned knowledge
Average face
Eigenvalues, Eigenfaces, and Fisherfaces
Step 4: Face recognition
Face identification: Recognizing people from their face
Face verification: Validating that it is the claimed person
Finishing touches: Saving and loading files
Finishing touches: Making a nice and interactive GUI
Drawing the GUI elements
Startup mode
Detection mode
Collection mode
Training mode
Recognition mode
Checking and handling mouse clicks
Summary
References
Index
Mastering OpenCV with Practical Computer Vision Projects
Copyright © 2012 Packt Publishing
All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.
Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either express or implied. Neither the authors, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.
Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.
First published: November 2012
Production Reference: 1161112
Published by Packt Publishing Ltd.
Livery Place
35 Livery Street
Birmingham B3 2PB, UK.
ISBN 978-1-84951-782-9
www.packtpub.com
Cover Image by Neha Rajappan (
<[email protected]>)Credits
Authors
Daniel Lélis Baggio
Shervin Emami
David Millán Escrivá
Khvedchenia Ievgen
Naureen Mahmood
Jason Saragih
Roy Shilkrot
Reviewers
Kirill Kornyakov
Luis Díaz Más
Sebastian Montabone
Acquisition Editor
Usha Iyer
Lead Technical Editor
Ankita Shashi
Technical Editors
Sharvari Baet
Prashant Salvi
Copy Editors
Brandt D'Mello
Aditya Nair
Alfida Paiva
Project Coordinator
Priya Sharma
Proofreaders
Chris Brown
Martin Diver
Indexer
Hemangini Bari
Tejal Soni
Rekha Nair
Graphics
Valentina D'silva
Aditi Gajjar
Production Coordinator
Arvindkumar Gupta
Cover Work
Arvindkumar Gupta
About the Authors
Daniel Lélis Baggio started his work in comp...