Handbook of big data technologies

Albert Y. Zomaya · Sherif Sakr Editors Handbook of Big Data Technologies www.ebook3000.com Handbook of Big Data Technologies Albert Y Zomaya Sherif Sakr • Editors Handbook of Big Data Technologies Foreword by Sartaj Sahni, University of Florida 123 www.ebook3000.com Editors Albert Y Zomaya School of Information Technologies The University of Sydney Sydney, NSW Australia Sherif Sakr The School of Computer Science The University of New South Wales Eveleigh, NSW Australia and King Saud Bin Abdulaziz University of Health Science Riyadh Saudi Arabia ISBN 978-3-319-49339-8 DOI 10.1007/978-3-319-49340-4 ISBN 978-3-319-49340-4 (eBook) Library of Congress Control Number: 2016959184 © Springer International Publishing AG 2017 This work is subject to copyright All rights are reserved by the Publisher, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, reuse of illustrations, recitation, broadcasting, reproduction on microfilms or in any other physical way, and transmission or information storage and retrieval, electronic adaptation, computer software, or by similar or dissimilar methodology now known or hereafter developed The use of general descriptive names, registered names, trademarks, service marks, etc in this publication does not imply, even in the absence of a specific statement, that such names are exempt from the relevant protective laws and regulations and therefore free for general use The publisher, the authors and the editors are safe to assume that the advice and information in this book are believed to be true and accurate at the date of publication Neither the publisher nor the authors or the editors give a warranty, express or implied, with respect to the material contained herein or for any errors or omissions that may have been made Printed on acid-free paper This Springer imprint is published by Springer Nature The registered company is Springer International Publishing AG The registered company address is: Gewerbestrasse 11, 6330 Cham, Switzerland To the loving memory of my Grandparents Albert Y Zomaya To my wife, Radwa, my daughter, Jana, and my son, Shehab for their love, encouragement, and support Sherif Sakr www.ebook3000.com Foreword Handbook of Big Data Technologies (edited by Albert Y Zomaya and Sherif Sakr) is an exciting and well-written book that deals with a wide range of topical themes in the field of Big Data The book probes many issues related to this important and growing field—processing, management, analytics, and applications Today, we are witnessing many advances in Big Data research and technologies brought about by developments in big data algorithms, high performance computing, databases, data mining, and more In addition to covering these advances, the book showcases critical evolving applications and technologies These developments in Big Data technologies will lead to serious breakthroughs in science and engineering over the next few years I believe that the current book is a great addition to the literature It will serve as a keystone of gathered research in this continuously changing area The book also provides an opportunity for researchers to explore the use of advanced computing technologies and their impact on enhancing our capabilities to conduct more sophisticated studies The book will be well received by the research and development community and will be beneficial for researchers and graduate students focusing on Big Data Also, the book is a useful reference source for practitioners and application developers Finally, I would like to congratulate Profs Zomaya and Sakr on a job well done! Sartaj Sahni University of Florida Gainesville, FL, USA vii Preface We live in the era of Big Data We are witnessing radical expansion and integration of digital devices, networking, data storage, and computation systems Data generation and consumption is becoming a main part of people’s daily life especially with the pervasive availability and usage of Internet technology and applications In the enterprise world, many companies continuously gather massive datasets that store customer interactions, product sales, results from advertising campaigns on the Web in addition to various types of other information The term Big Data has been coined to reflect the tremendous growth of the world’s digital data which is generated from various sources and many formats Big Data has attracted a lot of interest from both the research and industrial worlds with a goal of creating the best means to process, analyze, and make the most of this data This handbook presents comprehensive coverage of recent advancements in Big Data technologies and related paradigms Chapters are authored by international leading experts in the field All contributions have been reviewed and revised for maximum reader value The volume consists of twenty-five chapters organized into four main parts Part I covers the fundamental concepts of Big Data technologies including data curation mechanisms, data models, storage models, programming models, and programming platforms It also dives into the details of implementing Big SQL query engines and big stream processing systems Part II focuses on the semantic aspects of Big Data management, including data integration and exploratory ad hoc analysis in addition to structured querying and pattern matching techniques Part III presents a comprehensive overview of large-scale graph processing It covers the most recent research in large-scale graph processing platforms, introducing several scalable graph querying and mining mechanisms in domains such as social networks Part IV details novel applications that have been made possible by the rapid emergence of Big Data technologies, such as Internet-of-Things (IOT), Cognitive Computing, and SCADA Systems All parts of the book discuss open research problems, including potential opportunities, that have arisen from the rapid progress of Big Data technologies and the associated increasing requirements of application domains We hope that our readers will benefit from these discussions to enrich their own future research and development ix www.ebook3000.com x Preface This book is a timely contribution to the growing Big Data field, designed for researchers and IT professionals and graduate students Big Data has been recognized as one of leading emerging technologies that will have a major contribution and impact on the various fields of science and varies aspect of the human society over the coming decades Therefore, the content in this book will be an essential tool to help readers understand the development and future of the field Sydney, Australia Eveleigh, Australia; Riyadh, Saudi Arabia Albert Y Zomaya Sherif Sakr Contents Part I Fundamentals of Big Data Processing Big Data Storage and Data Models Dongyao Wu, Sherif Sakr and Liming Zhu Big Data Programming Models Dongyao Wu, Sherif Sakr and Liming Zhu 31 Programming Platforms for Big Data Analysis Jiannong Cao, Shailey Chawla, Yuqi Wang and Hanqing Wu 65 Big Data Analysis on Clouds 101 Loris Belcastro, Fabrizio Marozzo, Domenico Talia and Paolo Trunfio Data Organization and Curation in Big Data 143 Mohamed Y Eltabakh Big Data Query Engines 179 Mohamed A Soliman Large-Scale Data Stream Processing Systems 219 Paris Carbone, Gábor E Gévay, Gábor Hermann, Asterios Katsifodimos, Juan Soto, Volker Markl and Seif Haridi Part II Semantic Big Data Management Semantic Data Integration 263 Michelle Cheatham and Catia Pesquita Linked Data Management 307 Manfred Hauswirth, Marcin Wylot, Martin Grund, Paul Groth and Philippe Cudré-Mauroux xi www.ebook3000.com xii Contents Non-native RDF Storage Engines 339 Manfred Hauwirth, Marcin Wylot, Martin Grund, Sherif Sakr and Phillippe Cudré-Mauroux Exploratory Ad-Hoc Analytics for Big Data 365 Julian Eberius, Maik Thiele and Wolfgang Lehner Pattern Matching Over Linked Data Streams 409 Yongrui Qin and Quan Z Sheng Searching the Big Data: Practices and Experiences in Efficiently Querying Knowledge Bases 429 Wei Emma Zhang and Quan Z Sheng Part III Big Graph Analytics Management and Analysis of Big Graph Data: Current Systems and Open Challenges 457 Martin Junghanns, André Petermann, Martin Neumann and Erhard Rahm Similarity Search in Large-Scale Graph Databases 507 Peixiang Zhao Big-Graphs: Querying, Mining, and Beyond 531 Arijit Khan and Sayan Ranu Link and Graph Mining in the Big Data Era 583 Ana Paula Appel and Luis G Moyano Granular Social Network: Model and Applications 617 Sankar K Pal and Suman Kundu Part IV Big Data Applications Big Data, IoT and Semantics 655 Beniamino di Martino, Giuseppina Cretella and Antonio Esposito SCADA Systems in the Cloud 691 Philip Church, Harald Mueller, Caspar Ryan, Spyridon V Gogouvitis, Andrzej Goscinski, Houssam Haitof and Zahir Tari Quantitative Data Analysis in Finance 719 Xiang Shi, Peng Zhang and Samee U Khan Emerging Cost Effective Big Data Architectures 755 K Ashwin Kumar .. .Handbook of Big Data Technologies Albert Y Zomaya Sherif Sakr • Editors Handbook of Big Data Technologies Foreword by Sartaj Sahni, University of Florida 123 www.ebook3000.com... Sakr Contents Part I Fundamentals of Big Data Processing Big Data Storage and Data Models Dongyao Wu, Sherif Sakr and Liming Zhu Big Data Programming Models ... (eds.), Handbook of Big Data Technologies, DOI 10.1007/978-3-319-49340-4_1 www.ebook3000.com D Wu et al Fig Taxonomy of data stores and platforms lying storage model is also the key of understanding