Meta-Learning

Theory, Algorithms and Applications

Lan Zou

• Publisher: Academic Press
• Year: 2022
• Print ISBN: 9780323899314
• eBook ISBN: 9780323903707
• Topic: Computer Science
• Subtopic: Artificial Intelligence (AI) & Semantics
• Index: Computer Science

Deep neural networks (DNNs) with their dense and complex algorithms provide real possibilities for Artificial General Intelligence (AGI). Meta-learning with DNNs brings AGI much closer: artificial agents solving intelligent tasks that human beings can achieve, even transcending what they can achieve. Meta-Learning: Theory, Algorithms and Applications shows how meta-learning in combination with DNNs advances towards AGI. Meta-Learning: Theory, Algorithms and Applications explains the fundamentals of meta-learning by providing answers to these questions: What is meta-learning?; why do we need meta-learning?; how are self-improved meta-learning mechanisms heading for AGI ?; how can we use meta-learning in our approach to specific scenarios? The book presents the background of seven mainstream paradigms: meta-learning, few-shot learning, deep learning, transfer learning, machine learning, probabilistic modeling, and Bayesian inference. It then explains important state-of-the-art mechanisms and their variants for meta-learning, including memory-augmented neural networks, meta-networks, convolutional Siamese neural networks, matching networks, prototypical networks, relation networks, LSTM meta-learning, model-agnostic meta-learning, and the Reptile algorithm. The book takes a deep dive into nearly 200 state-of-the-art meta-learning algorithms from top tier conferences (e.g. NeurIPS, ICML, CVPR, ACL, ICLR, KDD). It systematically investigates 39 categories of tasks from 11 real-world application fields: Computer Vision, Natural Language Processing, Meta-Reinforcement Learning, Healthcare, Finance and Economy, Construction Materials, Graphic Neural Networks, Program Synthesis, Smart City, Recommended Systems, and Climate Science. Each application field concludes by looking at future trends or by giving a summary of available resources. Meta-Learning: Theory, Algorithms and Applications is a great resource to understand the principles of meta-learning and to learn state-of-the-art meta-learning algorithms, giving the student, researcher and industry professional the ability to apply meta-learning for various novel applications. - A comprehensive overview of state-of-the-art meta-learning techniques and methods associated with deep neural networks together with a broad range of application areas - Coverage of nearly 200 state-of-the-art meta-learning algorithms, which are promoted by premier global AI conferences and journals, and 300 to 450 pieces of key research - Systematic and detailed exploration of the most crucial state-of-the-art meta-learning algorithm mechanisms: model-based, metric-based, and optimization-based - Provides solutions to the limitations of using deep learning and/or machine learning methods, particularly with small sample sizes and unlabeled data - Gives an understanding of how meta-learning acts as a stepping stone to Artificial General Intelligence in 39 categories of tasks from 11 real-world application fields

Table of contents

• Meta-Learning
• Cover
• Front Matter
• Series Page
• Title Page
• Copyright
• Table of Contents
• Dedication
• Preface
• Acknowledgments
• Chapter 1 Meta-learning basics and background
• Chapter 2 Model-based meta-learning approaches
• Chapter 3 Metric-based meta-learning approaches
• Chapter 4 Optimization-based meta-learning approaches
• Chapter 5 Meta-learning for computer vision
• Chapter 6 Meta-learning for natural language processing
• Chapter 7 Meta-reinforcement learning
• Chapter 8 Meta-learning for healthcare
• Chapter 9 Meta-learning for emerging applications: Finance, building materials, graph neural networks, program synthesis, transportation, recommendation systems, and climate science
• Index