Getting Started with Talend Open Studio for Data Integration

Jonathan Bowen

• Publisher: Packt Publishing
• Year: 2012
• ISBN:
  9781849514729
• Edition: 1
• Topic: Computer Science
• Subtopic: Computer Science General
• Index: Computer Science

In Detail

Talend Open Studio for Data Integration (TOS) is an open source graphical development environment for creating custom integrations between systems. It comes with over 600 pre-built connectors that make it quick and easy to connect databases, transform files, load data, move, copy and rename files and connect individual components in order to define complex integration processes.

"Getting Started with Talend Open Studio for Data Integration" illustrates common uses and scenarios in a simple, practical manner and, building on knowledge as the book progresses, works towards more complex integration solutions.

TOS is a code generator and so does a lot of the "heavy lifting" for you. As such, it is a suitable tool for experienced developers and non-developers alike. You'll start by learning how to construct some common integrations tasks - transforming files and extracting data from a database, for example. These building blocks form a "toolkit" of techniques that you will learn how to apply in many different situations.

By the end of the book, once complex integrations will appear easy and you will be your organization's integration expert!

Best of all, TOS makes integrating systems fun!

Approach

"Getting Started with Talend Open Studio for Data Integration" takes a step-by-step, hands-on approach to learning with lots of examples and clear instructions.

Who this book is for

Are you a developer, business analyst, project manager, business intelligence specialist, system architect or a consultant who needs to undertake integration projects, then this book is for you.

The book assumes a certain level of familiarity with Relational database management systems with SQL and experience and Java.

Getting Started with Talend Open Studio for Data Integration

---

Table of Contents

Getting Started with Talend Open Studio for Data Integration

Credits

Foreword

Foreword

About the Author

Acknowledgement

About the Reviewers

www.PacktPub.com

Support files, eBooks, discount offers, and more

Why Subscribe?

Free Access for Packt account holders

Preface

What this book covers

What you need for this book

Who this book is for

Conventions

Reader feedback

Customer support

Downloading the example code

Errata

Piracy

Questions

1. Knowing Talend Open Studio

What Talend Open Studio is

Use cases

History of Talend Open Studio

Benefits of Talend Open Studio

Installing Talend Open Studio

Prerequisites

Installation guide

Other useful software

Text editor

MySQL

Sample jobs and data

Summary

2. Working with Talend Open Studio

Studio definitions

Starting the Studio

Tour of the Studio

The Repository

The design workspace

The Palette

Configuration tabs

Outline and Code panels

Creating a new project

Creating an example job

Metadata

Summary

3. Transforming Files

Transforming XML to CSV

Transforming CSV to XML

Maps and expressions

Advanced XML output for complex XML structures

Working with multi-schema XML files

Enriching data with lookups

Extracting data from Excel files

Extracting data from multiple sheets

Joining data from multiple sheets

Summary

4. Working with Databases

Database metadata

Extracting data from a database

Extracts from multiple tables

Joining within the database component

Joining outside the database component

Writing data to a database

Database to database transfer

Modifying data in a database

Dynamic database lookup

Summary

5. Filtering, Sorting, and Other Processing Techniques

Filtering data

Simple filter

Filter and rejects

Filter and split

Sorting data

Aggregating data

Normalizing and denormalizing data

Data normalization

Data denormalization

Extracting delimited fields

Find and replace

Sampling rows

Summary

6. Managing Files

Managing local files

Copying files

Copying and removing files

Renaming files

Deleting files

Timestamping a file

Listing files in a directory

Checking for files

Archiving and unarchiving files

FTP file operations

FTP Metadata

FTP Put

FTP Get

FTP File Exist

FTP File List and Rename

Deleting files on an FTP server

Summary

7. Job Orchestration

What is a subjob

A simple subjob

On Subjob Error

On Component OK

Run If

Jobs as subjobs

Iterating and looping

Iterate connections

ForEach loop

Loop "n" times

Infinite loop

Duplicating and merging dataflows

Duplicating data

Merging data

Summary

8. Managing Jobs

Job versions

Exporting and importing jobs

Exporting jobs

Exporting a project

Exporting a job

Exporting a job for execution

Importing jobs

Importing a project

Importing a job

Scheduling jobs

Summary

9. Global Variables and Contexts

Global variables

Studio global variables

User defined global variables

Contexts

Embedded context variables

Repository context variables

External context variables

Complex context variables

Using embedded, repository, and external contexts

Summary

10. Worked Examples

Product catalog

Data import from the ERP system

Data import from Fabric Fashions

Data import from Runway Collections

Product inventory data

Order file processing

Order status updates

Automating processes

E-mailing daily sales

Automating product visibility

Summary

A. Installing Sample Jobs and Data

Downloading job and data files

Sample data files

Sample database

Sample jobs

B. Resources

Talend documentation

TalendForge forum

Webinars

Tutorials

Talend Exchange

Index

Getting Started with Talend Open Studio for Data Integration

Copyright © 2012 Packt Publishing

All rights reserved. No part of this book may be reproduced, stored in a retrieval system, or transmitted in any form or by any means, without the prior written permission of the publisher, except in the case of brief quotations embedded in critical articles or reviews.

Every effort has been made in the preparation of this book to ensure the accuracy of the information presented. However, the information contained in this book is sold without warranty, either expressed or implied. Neither the author, nor Packt Publishing, and its dealers and distributors will be held liable for any damages caused or alleged to be caused directly or indirectly by this book.

Packt Publishing has endeavored to provide trademark information about all of the companies and products mentioned in this book by the appropriate use of capitals. However, Packt Publishing cannot guarantee the accuracy of this information.

First published: November 2012

Production Reference: 1251012

Published by Packt Publishing Ltd.

Livery Place

35 Livery Street

Birmingham B3 2PB, UK.

ISBN 978-1-84951-472-9

www.packtpub.com

Cover Image by Dean Taylor ( <[email protected] >)

Credi...