Serverless ETL and Analytics with AWS Glue
eBook - ePub

Serverless ETL and Analytics with AWS Glue

  1. 434 pages
  2. English
  3. ePUB (mobile friendly)
  4. Available on iOS & Android
eBook - ePub

About this book

Build efficient data lakes that can scale to virtually unlimited size using AWS Glue

Key Features

Book Description

Organizations these days have gravitated toward services such as AWS Glue that undertake undifferentiated heavy lifting and provide serverless Spark, enabling you to create and manage data lakes in a serverless fashion. This guide shows you how AWS Glue can be used to solve real-world problems along with helping you learn about data processing, data integration, and building data lakes.Beginning with AWS Glue basics, this book teaches you how to perform various aspects of data analysis such as ad hoc queries, data visualization, and real-time analysis using this service. It also provides a walk-through of CI/CD for AWS Glue and how to shift left on quality using automated regression tests. You'll find out how data security aspects such as access control, encryption, auditing, and networking are implemented, as well as getting to grips with useful techniques such as picking the right file format, compression, partitioning, and bucketing. As you advance, you'll discover AWS Glue features such as crawlers, Lake Formation, governed tables, lineage, DataBrew, Glue Studio, and custom connectors. The concluding chapters help you to understand various performance tuning, troubleshooting, and monitoring options.By the end of this AWS book, you'll be able to create, manage, troubleshoot, and deploy ETL pipelines using AWS Glue.

What you will learn

  • Apply various AWS Glue features to manage and create data lakes
  • Use Glue DataBrew and Glue Studio for data preparation
  • Optimize data layout in cloud storage to accelerate analytics workloads
  • Manage metadata including database, table, and schema definitions
  • Secure your data during access control, encryption, auditing, and networking
  • Monitor AWS Glue jobs to detect delays and loss of data
  • Integrate Spark ML and SageMaker with AWS Glue to create machine learning models

Who this book is for

ETL developers, data engineers, and data analysts

]]>

Frequently asked questions

Yes, you can cancel anytime from the Subscription tab in your account settings on the Perlego website. Your subscription will stay active until the end of your current billing period. Learn how to cancel your subscription.
At the moment all of our mobile-responsive ePub books are available to download via the app. Most of our PDFs are also available to download and we're working on making the final remaining ones downloadable now. Learn more here.
Perlego offers two plans: Essential and Complete
  • Essential is ideal for learners and professionals who enjoy exploring a wide range of subjects. Access the Essential Library with 800,000+ trusted titles and best-sellers across business, personal growth, and the humanities. Includes unlimited reading time and Standard Read Aloud voice.
  • Complete: Perfect for advanced learners and researchers needing full, unrestricted access. Unlock 1.4M+ books across hundreds of subjects, including academic and specialized titles. The Complete Plan also includes advanced features like Premium Read Aloud and Research Assistant.
Both plans are available with monthly, semester, or annual billing cycles.
We are an online textbook subscription service, where you can get access to an entire online library for less than the price of a single book per month. With over 1 million books across 1000+ topics, weโ€™ve got you covered! Learn more here.
Look out for the read-aloud symbol on your next book to see if you can listen to it. The read-aloud tool reads text aloud for you, highlighting the text as it is being read. You can pause it, speed it up and slow it down. Learn more here.
Yes! You can use the Perlego app on both iOS or Android devices to read anytime, anywhere โ€” even offline. Perfect for commutes or when youโ€™re on the go.
Please note we cannot support devices running on iOS 13 and Android 7 or earlier. Learn more about using the app.
Yes, you can access Serverless ETL and Analytics with AWS Glue by Vishal Pathak,Subramanya Vajiraya,Noritaka Sekiyama,Tomohiro Tanaka,Albert Quiroga,Ishan Gaur in PDF and/or ePUB format, as well as other popular books in Computer Science & Data Processing. We have over one million books available in our catalogue for you to explore.

Table of contents

  1. Serverless ETL and Analytics with AWS Glue
  2. Contributors
  3. Preface
  4. Section 1 โ€“ Introduction, Concepts, and the Basics of AWS Glue
  5. Chapter 1: Data Management โ€“ Introduction and Concepts
  6. Chapter 2: Introduction to Important AWS Glue Features
  7. Chapter 3: Data Ingestion
  8. Section 2 โ€“ Data Preparation, Management, and Security
  9. Chapter 4: Data Preparation
  10. Chapter 5: Data Layouts
  11. Chapter 6: Data Management
  12. Chapter 7: Metadata Management
  13. Chapter 8: Data Security
  14. Chapter 9: Data Sharing
  15. Chapter 10: Data Pipeline Management
  16. Section 3 โ€“ Tuning, Monitoring, Data Lake Common Scenarios, and Interesting Edge Cases
  17. Chapter 11: Monitoring
  18. Chapter 12: Tuning, Debugging, and Troubleshooting
  19. Chapter 13: Data Analysis
  20. Chapter 14: Machine Learning Integration
  21. Chapter 15: Architecting Data Lakes for Real-World Scenarios and Edge Cases
  22. Other Books You May Enjoy