OpenStack Object Storage (Swift) Essentials

Amar Kapadia, Kris Rajana, Sreedhar Varma

• Verlag: Packt Publishing
• Jahr: 2015
• ISBN:
  9781785289569
• Thema: Computer Science
• Thema: System Administration

About This Book

• Learn the fundamentals of cloud architecture and improve usability of your Cloud storage using OpenStack Swift
• Perform basic data transfers and access-control list management using REST APIs
• Illustrated with examples and Swift's latest features, this book is a complete guide to installing, managing, and administering your cloud storage and its capabilities

Who This Book Is For

If you are an IT administrator and you want to enter the world of cloud storage using OpenStack Swift, then this book is ideal for you. Basic knowledge of Linux and server technology is beneficial to get the most out of the book.

OpenStack Object Storage (Swift) Essentials

---

Table of Contents

OpenStack Object Storage (Swift) Essentials

Credits

About the Authors

About the Reviewers

www.PacktPub.com

Support files, eBooks, discount offers, and more

Why subscribe?

Free access for Packt account holders

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Errata

Piracy

Questions

1. Cloud Storage – Why Can't I Be Like Google?

What constitutes cloud storage?

Reduced TCO

Unlimited scalability

Elastic

On-demand

Universal access

Multitenancy

Data durability and availability

Limitations of cloud storage

Performance

New APIs

Object storage

The importance of being open

OpenStack Swift

Summary

2. OpenStack Swift Architecture

Logical organization of objects

Swift implementation and architecture

Key architectural principles

Physical data organization

Data path software servers

A day in the life of a create operation

A day in the life of a read operation

A day in the life of an update operation

A day in the life of a delete operation

Post-processing software components

Replication

Updaters

Auditors

Other processes

Inline middleware options

Authentication

Other modules

Additional features

Large object support

Metadata

Multirange support

CORS

Server-side copies

Cluster health

Summary

3. Installing OpenStack Swift

Hardware planning

Server setup and network configuration

Pre-installation steps

Downloading and installing Swift

Setting up storage server nodes

Installing services

Formatting and mounting hard disks

RSYNC and RSYNCD

Setting up the proxy server node

The Keystone service

Installing MariaDB

Installing Keystone

The ring setup

Multiregion support

Finalizing the installation

Storage policies

Implementing storage policies

Applying storage policies

Summary

4. Using Swift

Installing clients

Creating a token using Keystone authentication

Displaying metadata information for an account, container, or object

Using the Swift client CLI

Using cURL

Using the specialized REST API client

Listing containers

Using the Swift client CLI

Using cURL

Listing objects in a container

Using the Swift client CLI

Using cURL

Using the REST API

Updating the metadata for a container

Using the Swift client CLI

Using the REST API

Environment variables

The pseudo-hierarchical directories

Container ACLs

Transferring large objects

Amazon S3 API compatibility

Accessing Swift using S3 commands

Accessing Swift using client libraries

Java

Python

Ruby

Summary

5. Additional Swift Interfaces

Using Swift for virtual machine storage

Swift in Sahara

Hadoop Cluster with Sahara

Using Swift with Sahara

Running a job in Sahara

Authenticating with Swift proxy

Summary

6. Monitoring and Managing Swift

Routine management

Swift cluster monitoring

Swift Recon

Swift Informant

Swift dispersion tool

StatsD

Swift metrics

Tulsi – a Swift health monitoring tool

Architecture of Tulsi

Deploying Tulsi

Running Tulsi

Anomaly detection in Tulsi

Logging using rsyslog

Failure management

Detecting drive failures

Handling drive failure

Handling node failure

Proxy server failure

Zone and region failure

Capacity planning

Adding new drives

Adding new storage and proxy servers

Migrations

Summary

7. Docker Intercepts Swift

Swift with Docker

Installation of Docker

Basic commands for the Docker user

Setting up a Swift proxy container using the Docker image

Setting up the storage container using the Docker image

Setting up a Swift cluster using a Dockerfile

Creating a proxy container using a Dockerfile

Creating a storage container using a Dockerfile

Summary

8. Choosing the Right Hardware

The hardware list

The hardware selection criteria

Choosing the storage server configuration

Determining the region and zone configuration

Choosing the account and container server configuration

Selecting the proxy server configuration

Choosing the network hardware

Choosing the ratios of various server types

Heterogeneous hardware

Choosing additional networking equipment

Selecting a cloud gateway

Additional selection criteria

The vendor selection strategy

Branded hardware

Commodity hardware

Summary

9. Tuning Your Swift Installation

Performance benchmarking

Hardware tuning

Software tuning

Ring considerations

Data path software tuning

Post-processing software tuning

Additional tuning parameters

Summary

10. Additional Resources

Use cases

Archival

Backup

Content repository

Collaboration

Data lakes

Operating systems used for OpenStack implementations

Virtualization used for OpenStack implementations

Provisioning and distribution tools

Monitoring and graphing tools

Additional information

Summary

A. Swift CLI Commands

Commands

list

Examples

stat

Examples

post

Examples

upload

Examples

download

Examples

delete

Examples

Index

OpenStack Object Storage (Swift) Essentials

Copyright © 2015 Packt Publishing

All...