1617290521_hbas_5782

Nick Dimiduk Amandeep Khurana FOREWORD BY Michael Stack MANNING HBase in Action NICK DIMIDUK AMANDEEP KHURANA TECHNICAL EDITOR MARK HENRY RYAN MANNING Shelter Island For online information and ordering of this and other Manning books, please visit www.manning.com The publisher offers discounts on this book when ordered in quantity For more information, please contact Special Sales Department Manning Publications Co 20 Baldwin Road PO Box 261 Shelter Island, NY 11964 Email: orders@manning.com ©2013 by Manning Publications Co All rights reserved No part of this publication may be reproduced, stored in a retrieval system, or transmitted, in any form or by means electronic, mechanical, photocopying, or otherwise, without prior written permission of the publisher Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks Where those designations appear in the book, and Manning Publications was aware of a trademark claim, the designations have been printed in initial caps or all caps Recognizing the importance of preserving what has been written, it is Manning’s policy to have the books we publish printed on acid-free paper, and we exert our best efforts to that end Recognizing also our responsibility to conserve the resources of our planet, Manning books are printed on paper that is at least 15 percent recycled and processed without the use of elemental chlorine Manning Publications Co 20 Baldwin Road PO Box 261 Shelter Island, NY 11964 Development editors: Technical editor: Technical proofreaders: Copyeditor: Proofreaders: Typesetter: Cover designer: ISBN 9781617290527 Printed in the United States of America 10 – MAL – 17 16 15 14 13 12 Renae Gregoire, Susanna Kline Mark Henry Ryan Jerry Kuch, Kristine Kuch Tiffany Taylor Elizabeth Martin, Alyson Brener Gordan Salinovic Marija Tudor brief contents PART PART PART PART HBASE FUNDAMENTALS 1 ■ Introducing HBase ■ Getting started ■ Distributed HBase, HDFS, and MapReduce 51 21 ADVANCED CONCEPTS 83 ■ HBase table design 85 ■ Extending HBase with coprocessors ■ Alternative HBase clients 143 126 EXAMPLE APPLICATIONS 179 ■ HBase by example: OpenTSDB ■ Scaling GIS on HBase 203 181 OPERATIONALIZING HBASE 237 ■ Deploying HBase 10 ■ Operations 264 iii 239 334 TableMapper 69 TableMapReduceUtil 69 TableOutputFormat 71 TableReducer 70 TaskTracker 61 telemetry 11–12 temporary directory 259 Text 55 TextOuputFormat 70 Thrift API 156 client library 157–158 gateway deployment 157 interacting with tables 159–162 scripting shell from 156–162 service, launching 159 throughput MapReduce See MapReduce parallel execution 53–55 serial execution 53 throughput vs latency 52 time series 184–185 aggregation 201 data management 185 data, recording 185 hot spot 185 metadata auto-complete 199–201 reading 201–202 Time Series Database See TSDB Time To Live See TTL timestamp 19 TimestampFilter 123 tombstone record 30 top (Linux tool) 269 Trend Micro, HBase use 12 truncate command 292 TSDB 182 TSDB.addPoint() 198 TsdbQuery 201 TsdbQuery.createAndSetFilter() 201 INDEX TsdbQuery.findSpans() 201 TsdbQuery.getScanner() 201 TsdbQuery.run() 201 TTL 101 disabling 115 tuning See performance, tuning TwitBase 22–48 U uberhbck 293 UI, port 259 UID creating 194 name auto-completion 199–201 UniqueId.getOrCreateId() 194 UniqueId.getSuggestScanner() 200 UniqueId.suggest() 200 UNIX, scripting shell from 144–147 upgrading 285–286 URL shorteners 14 user model, serving 14 user-interaction data, capturing 11 See also HLog See also MemStore WALObserver 129 web search, canonical problem well-known text See WKT WhileMatchFilter 47 Whirr 249–250 within query client side 228–231 filter 231–234 WKT 224 workload, tuning See performance, tuning WritableByteArrayComparable 121 write buffer 258 write path 26–28 write pattern, defining 89 write-ahead log See WAL Y Yahoo! Cloud Serving Benchmark (YCSB) 275–276 Yahoo!, Hadoop development V Z value 33 ValueFilter 46, 123 VerifyReplication 303 version 33 version information 32 versioning, doesn’t map to relational database 113 vm.swappiness 261 W WAL 26, 28, 129 disabling 28 Z-order curve 216 zk_dump 288–289, 311 ZooKeeper 66–68, 311–312 hardware 246 quorum 257 quorum address 24 root znode 259 status 288–289 timeout 259 zookeeper.session.timeout 259 zookeeper.znode.parent 259 DATABASE HBase IN ACTION SEE INSERT Dimiduk Khurana ● H Base is a NoSQL storage system designed for fast, random access to large volumes of data It runs on commodity hardware and scales smoothly from modest datasets to billions of rows and millions of columns HBase in Action is an experience-driven guide that shows you how to design, build, and run applications using HBase First, it introduces you to the fundamentals of handling big data Then, you’ll explore HBase with the help of real applications and code samples and with just enough theory to back up the practical techniques You’ll take advantage of the MapReduce processing framework and benefit from seeing HBase best practices in action What’s Inside “ A difficult topic lucidly explained ” —John Griffin, coauthor of Hibernate Search in Action “ ” —Charles Pyle, APS Healthcare Written for developers and architects familiar with data storage and processing No prior knowledge of HBase, Hadoop, or MapReduce is required Nick Dimiduk is a Data Architect with experience in social media analytics, digital marketing, and GIS Amandeep Khurana is a Solutions Architect focused on building HBase-driven solutions To download their free eBook in PDF, ePub, and Kindle formats, owners of this book should visit manning.com/HBaseinAction $39.99 / Can $41.99 ” —From the Foreword by Michael Stack, Chair of the Apache HBase Project Management Committee Amusing tongue-in-cheek style that doesn’t detract from the substance When and how to use HBase ● Practical examples ● Design patterns for scalable data systems ● Deployment, integration, design ● MANNING “ Timely, practical explains in plain language how to use HBase [INCLUDING eBOOK] “ Learn how to think the HBase way ” —Gianluca Righetto, Menttis