Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn Sep 2017 understanding business intelligence huy nguyễn
Understanding Business Intelligence Huy Nguyen CTO, Cofounder - Holistics Software About Me Education: ● Pho Thong Nang Khieu, Tin 04-07 ● National University of Singapore (NUS), Computer Science Work: ● Software Engineer Intern, Facebook (California, US) ● Software Engineer Intern, SenseGraphics (Stockholm, Sweden) ● Data Infrastructure Engineer, Viki (Singapore) Now: ● Co-founder & CTO, Holistics Software ● Co-founder, Grokking Vietnam huy@holistics.io facebook.com/huy bit.ly/huy-linkedin Agenda • Architecture of BI System • Data Thinking • BI Implementation Data Thinking Holistics.io Data Thinking The process of articulating and formulating a dataoriented approach to measure and answer the business question Ask Question (Hypothesis) Formulate Data Approach Data thinking Draw Insights Get Data (build report) Write SQL query Example: How often buyers buy again? (retail/ecommerce business) Visualize Data → Chart Chart: Visualize a chart that could give you the answer you need Table: Draw out the underlying data table that powers the chart Query: Write code that generates the table Report: Use BI tool to build visualization Date Period Male Users Female Users 2017-01-01 300 102 2017-01-02 260 300 select L.listing_date, count(1) as daily_listings, from listings L where L.listing_date >= NOW() - INTERVAL '30 days' group by order by DESC Data-informed vs Data-driven Datadeprived Difficult to access data Make decision by intuition Usually in traditional businesses Data-informed Data is only used as a supporting tool, as part of a bigger context Data Driven All decisions driven by data Usually missing the bigger picture Strategic level Works at tactical level While data is concrete, it is often systematically biased - Andrew Chen http://andrewchen.co/know-the-difference-between-data-informed-and-versus-data-driven/ When Do Your Business Need BI? ● Most (if not all) businesses need data to operate and make decisions ● Depends on cost and the approach taken to implementing BI BI Platform - Some Consideration Points Use Cases: Pretty Visualizations vs Detailed Data Access, Embedded, Email Schedules, etc Creation Process: Technical vs Non-technical Data Ownership: Your own database vs BI Software’s storage Holistics.io Report Creation Process ● Drag-and-drop (non-technical) ○ Simple to use ○ Usually hard for complex use cases ● Technical (write code, SQL, etc) ○ Hard to use ○ Flexible for complex use cases ● Self-serve BI ○ Related to data modeling (relational, OLAP Cube, etc) Data Ownership Heavyweight BI Lightweight BI Reporting / Viz BI Cache Database Interface User ExperienceUser Business Intelligence Functions Copyright © Holistics.io Data Visualization Scheduled Reporting Self-Serve Querying Dashboards & Embedded Reports Batch Scheduling Data Extraction / ETL Data Cleansing Masking & Encoding Filtering & Custom Processing Data Modeling Huy Nguyen huy@holistics.io Holistics.io Transactional Data vs Behavioural Data ● Critical data (e.g bookings, payments) ● Non-critical data (logging data, e.g pageview) ● Lower volume ● Huge volume ● Fixed schema ● Often semi-structured Holistics.io Implementing BI BI and Big Data? End-to-End Analytics Services Collect Data Process Data Present Data / Insights Data Source Data Source Concepts OLAP Cube Data Warehouse Data Model Data Mining ETL ELT ... data is concrete, it is often systematically biased - Andrew Chen http://andrewchen.co/know-the-difference-between-data-informed-and-versus-data-driven/ Summary: The Data Process Ask Question (Hypothesis)... Users 201 7- 0 1-0 1 300 102 201 7- 0 1-0 2 260 300 select L.listing_date, count(1) as daily_listings, from listings L where L.listing_date >= NOW() - INTERVAL '30 days' group by order by DESC Data-informed... Infrastructure Engineer, Viki (Singapore) Now: ● Co-founder & CTO, Holistics Software ● Co-founder, Grokking Vietnam huy@ holistics.io facebook.com /huy bit.ly /huy- linkedin Agenda • Architecture of BI System