Azure Storage, Streaming, and Batch Analytics

A guide for data engineers

Richard Nuckolls

• Publisher: Manning
• Year: 2020
• Print ISBN: 9781617296307
• eBook ISBN: 9781638350149
• Topic: Computer Science
• Subtopic: Cloud Computing
• Index: Computer Science

The Microsoft Azure cloud is an ideal platform for data-intensive applications. Designed for productivity, Azure provides pre-built services that make collection, storage, and analysis much easier to implement and manage. Azure Storage, Streaming, and Batch Analytics teaches you how to design a reliable, performant, and cost-effective data infrastructure in Azure by progressively building a complete working analytics system. Summary
The Microsoft Azure cloud is an ideal platform for data-intensive applications. Designed for productivity, Azure provides pre-built services that make collection, storage, and analysis much easier to implement and manage. Azure Storage, Streaming, and Batch Analytics teaches you how to design a reliable, performant, and cost-effective data infrastructure in Azure by progressively building a complete working analytics system.Purchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications. About the technology
Microsoft Azure provides dozens of services that simplify storing and processing data. These services are secure, reliable, scalable, and cost efficient. About the book
Azure Storage, Streaming, and Batch Analytics shows you how to build state-of-the-art data solutions with tools from the Microsoft Azure platform. Read along to construct a cloud-native data warehouse, adding features like real-time data processing. Based on the Lambda architecture for big data, the design uses scalable services such as Event Hubs, Stream Analytics, and SQL databases. Along the way, you'll cover most of the topics needed to earn an Azure data engineering certification. What's inside Configuring Azure services for speed and cost
Constructing data pipelines with Data Factory
Choosing the right data storage methods About the reader
For readers familiar with database management. Examples in C# and PowerShell. About the author
Richard Nuckolls is a senior developer building big data analytics and reporting systems in Azure. Table of Contents 1 What is data engineering?2 Building an analytics system in Azure3 General storage with Azure Storage accounts4 Azure Data Lake Storage5 Message handling with Event Hubs6 Real-time queries with Azure Stream Analytics7 Batch queries with Azure Data Lake Analytics8 U-SQL for complex analytics9 Integrating with Azure Data Lake Analytics10 Service integration with Azure Data Factory11 Managed SQL with Azure SQL Database12 Integrating Data Factory with SQL Database13 Where to go next

Table of contents

• Azure Storage, Streaming, and Batch Analytic
• Copyright
• dedication
• brief contents
• contents
• front matter
• 1 What is data engineering?
• 2 Building an analytics system in Azure
• 3 General storage with Azure Storage accounts
• 4 Azure Data Lake Storage
• 5 Message handling with Event Hubs
• 6 Real-time queries with Azure Stream Analytics
• 7 Batch queries with Azure Data Lake Analytics
• 8 U-SQL for complex analytics
• 9 Integrating with Azure Data Lake Analytics
• 10 Service integration with Azure Data Factory
• 11 Managed SQL with Azure SQL Database
• 12 Integrating Data Factory with SQL Database
• 13 Where to go next
• appendix A. Setting up Azure services through PowerShell
• appendix B. Configuring the Jonestown Sluggers analytics system
• index