Machine Learning on Commodity Tiny Devices

Theory and Practice

Song Guo, Qihua Zhou

• Publisher: CRC Press
• Year: 2022
• Print ISBN: 9781032374239
• eBook ISBN: 9781000780383
• Topic: Computer Science
• Subtopic: Artificial Intelligence (AI) & Semantics
• Index: Computer Science

This book aims at the tiny machine learning (TinyML) software and hardware synergy for edge intelligence applications. This book presents on-device learning techniques covering model-level neural network design, algorithm-level training optimization and hardware-level instruction acceleration.

Analyzing the limitations of conventional in-cloud computing would reveal that on-device learning is a promising research direction to meet the requirements of edge intelligence applications. As to the cutting-edge research of TinyML, implementing a high-efficiency learning framework and enabling system-level acceleration is one of the most fundamental issues. This book presents a comprehensive discussion of the latest research progress and provides system-level insights on designing TinyML frameworks, including neural network design, training algorithm optimization and domain-specific hardware acceleration. It identifies the main challenges when deploying TinyML tasks in the real world and guides the researchers to deploy a reliable learning system.

This book will be of interest to students and scholars in the field of edge intelligence, especially to those with sufficient professional Edge AI skills. It will also be an excellent guide for researchers to implement high-performance TinyML systems.

Table of contents

• Cover Page
• Half-Title Page
• Title Page
• Copyright Page
• Contents
• List of Figures
• List of Tables
• Chapter 1 ◾ Introduction
• Chapter 2 ◾ Fundamentals: On-Device Learning Paradigm
• Chapter 3 ◾ Preliminary: Theories and Algorithms
• Chapter 4 ◾ Model-Level Design: Computation Acceleration and Communication Saving
• Chapter 5 ◾ Hardware-Level Design: Neural Engines and Tensor Accelerators
• Chapter 6 ◾ Infrastructure-Level Design: Serverless and Decentralized Machine Learning
• Chapter 7 ◾ System-Level Design: From Standalone to Clusters
• Chapter 8 ◾ Application: Image-Based Visual Perception
• Chapter 9 ◾ Application: Video-Based Real-Time Processing
• Chapter 10 ◾ Application: Privacy, Security, Robustness and Trustworthiness in Edge AI
• Bibliography
• Index