microsofttech net professional NoSQL
ffirs.indd iiffirs.indd ii 8/8/11 2:37:28 PM8/8/11 2:37:28 PM PROFESSIONAL NoSQL INTRODUCTION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . xvii PART I GETTING STARTED CHAPTER 1 NoSQL: What It Is and Why You Need It . . . . . . . . . . . . . . . . . . . . . . . . . . . 3 CHAPTER 2 Hello NoSQL: Getting Initial Hands-on Experience . . . . . . . . . . . . . . . . . .21 CHAPTER 3 Interfacing and Interacting with NoSQL. . . . . . . . . . . . . . . . . . . . . . . . . . . 43 PART II LEARNING THE NoSQL BASICS CHAPTER 4 Understanding the Storage Architecture . . . . . . . . . . . . . . . . . . . . . . . . . .71 CHAPTER 5 Performing CRUD Operations . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 97 CHAPTER 6 Querying NoSQL Stores . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 117 CHAPTER 7 Modifying Data Stores and Managing Evolution . . . . . . . . . . . . . . . . . . .137 CHAPTER 8 Indexing and Ordering Data Sets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 149 CHAPTER 9 Managing Transactions and Data Integrity . . . . . . . . . . . . . . . . . . . . . . . 169 PART III GAINING PROFICIENCY WITH NoSQL CHAPTER 10 Using NoSQL in the Cloud . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187 CHAPTER 11 Scalable Parallel Processing with MapReduce . . . . . . . . . . . . . . . . . . . . 217 CHAPTER 12 Analyzing Big Data with Hive . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233 CHAPTER 13 Surveying Database Internals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 253 PART IV MASTERING NoSQL CHAPTER 14 Choosing Among NoSQL Flavors . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271 CHAPTER 15 Coexistence . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285 CHAPTER 16 Performance Tuning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 301 CHAPTER 17 Tools and Utilities . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 311 APPENDIX Installation and Setup Instructions . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 329 INDEX . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 351 ffirs.indd iffirs.indd i 8/8/11 2:37:27 PM8/8/11 2:37:27 PM ffirs.indd iiffirs.indd ii 8/8/11 2:37:28 PM8/8/11 2:37:28 PM PROFESSIONAL NoSQL Shashank Tiwari John Wiley & Sons, Inc. ffirs.indd iiiffirs.indd iii 8/8/11 2:37:28 PM8/8/11 2:37:28 PM Professional NoSQL Published by John Wiley & Sons, Inc. 10475 Crosspoint Boulevard Indianapolis, IN 46256 www.wiley.com Copyright © 2011 by John Wiley & Sons, Inc., Indianapolis, Indiana Published simultaneously in Canada ISBN: 978-0-470-94224-6 Manufactured in the United States of America 10 9 8 7 6 5 4 3 2 1 No part of this publication may be reproduced, stored in a retrieval system or transmitted in any form or by any means, electronic, mechanical, photocopying, recording, scanning or otherwise, except as permitted under Sections 107 or 108 of the 1976 United States Copyright Act, without either the prior written permission of the Publisher, or authorization through payment of the appropriate per-copy fee to the Copyright Clearance Center, 222 Rosewood Drive, Danvers, MA 01923, (978) 750-8400, fax (978) 646-8600. Requests to the Publisher for permission should be addressed to the Permissions Department, John Wiley & Sons, Inc., 111 River Street, Hoboken, NJ 07030, (201) 748-6011, fax (201) 748-6008, or online at http://www.wiley.com/go/permissions . Limit of Liability/Disclaimer of Warranty: The publisher and the author make no representations or warranties with respect to the accuracy or completeness of the contents of this work and specifi cally disclaim all warranties, including without limitation warranties of fi tness for a particular purpose. No warranty may be created or extended by sales or pro- motional materials. The advice and strategies contained herein may not be suitable for every situation. This work is sold with the understanding that the publisher is not engaged in rendering legal, accounting, or other professional services. If professional assistance is required, the services of a competent professional person should be sought. Neither the pub- lisher nor the author shall be liable for damages arising herefrom. The fact that an organization or website is referred to in this work as a citation and/or a potential source of further information does not mean that the author or the publisher endorses the information the organization or website may provide or recommendations it may make. Further, readers should be aware that Internet website listed in this work may have changed or disappeared between when this work was written and when it is read. For general information on our other products and services please contact our Customer Care Department within the United States at (877) 762-2974, outside the United States at (317) 572-3993 or fax (317) 572-4002. Wiley also publishes its books in a variety of electronic formats. Some content that appears in print may not be available in electronic books. Library of Congress Control Number: 2011930307 Trademarks: Wiley, the Wiley logo, Wrox, the Wrox logo, Programmer to Programmer, and related trade dress are trademarks or registered trademarks of John Wiley & Sons, Inc. and/or its affi liates, in the United States and other countries, and may not be used without written permission. All other trademarks are the property of their respective owners. John Wiley & Sons, Inc., is not associated with any product or vendor mentioned in this book. ffirs.indd ivffirs.indd iv 8/8/11 2:37:36 PM8/8/11 2:37:36 PM I would like to dedicate my work on this book to my parents, Mandakini and Suresh Tiwari. Everything I do successfully, including writing this book, is a result of the immense support of my dear wife, Caren and my adorable sons, Ayaan and Ezra. ffirs.indd vffirs.indd v 8/8/11 2:37:36 PM8/8/11 2:37:36 PM CREDITS EXECUTIVE EDITOR Robert Elliot PROJECT EDITOR Sydney Jones TECHNICAL EDITORS Stefan Edlich Matt Ingenthron PRODUCTION EDITOR Daniel Scribner COPY EDITOR Kim Co er EDITORIAL DIRECTOR Robyn B. Siesky EDITORIAL MANAGER Mary Beth Wakefi eld FREELANCER EDITORIAL MANAGER Rosemarie Graham MARKETING MANAGER Ashley Zurcher PRODUCTION MANAGER Tim Tate VICE PRESIDENT AND EXECUTIVE GROUP PUBLISHER Richard Swadley VICE PRESIDENT AND EXECUTIVE PUBLISHER Barry Pruett ASSOCIATE PUBLISHER Jim Minatel PROJECT COORDINATOR, COVER Katherine Crocker PROOFREADER Scott Klemp, Word One INDEXER Robert Swanson COVER DESIGNER LeAndra Young COVER IMAGE © René Mansi ffirs.indd viffirs.indd vi 8/8/11 2:37:36 PM8/8/11 2:37:36 PM ABOUT THE AUTHOR SHASHANK TIWARI is an experienced software developer and technology entrepreneur with interests in the areas of high-performance applications, analytics, web applications, and mobile platforms. He enjoys data visualization, statistical and machine learning, coffee, deserts and bike riding. He is the author of many technical articles and books and a speaker at many conferences worldwide. Learn more about his company, Treasury of Ideas, at www.treasuryofideas.com . Read his blog at www.shanky.org or follow him on twitter at @tshanky. He lives with his wife and two sons in Palo Alto, California. ABOUT THE TECHNICAL EDITORS PROF. DR. STEFAN EDLICH is a senior lecturer at Beuth HS of Technology Berlin (U.APP.SC) with a focus on NoSQL, Software-Engineering and Cloud Computing. Beside many scientifi c papers and journal articles, he is a continuous speaker at conferences and IT events concerning enterprise, NoSQL, and ODBMS topics since 1993. Furthermore, he is the author of twelve IT books written for Apress, OReilly, Spektrum/Elsevier, Hanser, and other publishers. He is a founding member of OODBMS.org e.V. and started the world’s First International Conference on Object Databases (ICOODB.org) series. He runs the NoSQL Archive, organizes NoSQL events, and is constantly writing about NoSQL. MATT INGENTHRON is an experienced web architect with a software development background. He has deep expertise in building, scaling and operating global-scale Java, Ruby on Rails and AMP web applications. Having been with Couchbase, Inc. since its inception, he has been a core developer on the Open Source Membase NoSQL project, a contributor to the Memcached project, and a leader for new developments in the Java spymemcached client. Matt’s NoSQL experiences are widespread though, having experience with Hadoop, HBase and other parts of the NoSQL world. ffirs.indd viiffirs.indd vii 8/8/11 2:37:37 PM8/8/11 2:37:37 PM ACKNOWLEDGMENTS THIS BOOK REPRESENTS the efforts of many people, and I sincerely thank them for their contribution. Thanks to the team at Wiley. You made the book possible! Thanks to Matt and Stefan for the valuable inputs and the technical review. Thanks to my wife and sons for encouraging and supporting me through the process of writing this book. Thanks to all the members of my family and friends who have always believed in me. Thanks to all who have contributed directly or indirectly to this book and who I may have missed unintentionally. —Shash ank Tiwari ffirs.indd viiiffirs.indd viii 8/8/11 2:37:37 PM8/8/11 2:37:37 PM