About This eBook ePUB is an open, industry-standard format for eBooks However, support of ePUB and its many features varies across reading devices and applications Use your device or app settings to customize the presentation to your liking Settings that you can customize often include font, font size, single or double column, landscape or portrait mode, and figures that you can click or tap to enlarge For additional information about the settings and features on your reading device or app, visit the device manufacturer’s Web site Many titles include programming code or configuration examples To optimize the presentation of these elements, view the eBook in single-column, landscape mode and adjust the font size to the smallest setting In addition to presenting code and configurations in the reflowable text format, we have included images of the code that mimic the presentation found in the print book; therefore, where the reflowable format may compromise the presentation of the code listing, you will see a “Click here to view code image” link Click the link to view the print-fidelity code image To return to the previous page viewed, click the Back button on your device or app Hands-On Mobile App Testing A Guide for Mobile Testers and Anyone Involved in the Mobile App Business Daniel Knott New York • Boston • Indianapolis • San Francisco Toronto • Montreal • London • Munich • Paris • Madrid Capetown • Sydney • Tokyo • Singapore • Mexico City Many of the designations used by manufacturers and sellers to distinguish their products are claimed as trademarks Where those designations appear in this book, and the publisher was aware of a trademark claim, the designations have been printed with initial capital letters or in all capitals The author and publisher have taken care in the preparation of this book, but make no expressed or implied warranty of any kind and assume no responsibility for errors or omissions No liability is assumed for incidental or consequential damages in connection with or arising out of the use of the information or programs contained herein For information about buying this title in bulk quantities, or for special sales opportunities (which may include electronic versions; custom cover designs; and content particular to your business, training goals, marketing focus, or branding interests), please contact our corporate sales department at corpsales@pearsoned.com or (800) 382-3419 For government sales inquiries, please contact governmentsales@pearsoned.com For questions about sales outside the U.S., please contact international@pearsoned.com Visit us on the Web: informit.com/aw Library of Congress Cataloging-in-Publication Data Knott, Daniel Hands-on mobile app testing : a guide for mobile testers and anyone involved in the mobile app business / Daniel Knott pages cm Includes index ISBN 978-0-13-419171-3 (pbk : alk paper)—ISBN 0-13-419171-4 Mobile apps—Testing I Title QA76.76.T48K64 2015 006.3—dc23 2015009688 Copyright © 2015 Pearson Education, Inc All rights reserved Printed in the United States of America This publication is protected by copyright, and permission must be obtained from the publisher prior to any prohibited reproduction, storage in a retrieval system, or transmission in any form or by any means, electronic, mechanical, photocopying, recording, or likewise To obtain permission to use material from this work, please submit a written request to Pearson Education, Inc., Permissions Department, 200 Old Tappan Road, Old Tappan, New Jersey 07675, or you may fax your request to (201) 236-3290 ISBN-13: 978-0-13-419171-3 ISBN-10: 0-13-419171-4 Text printed in the United States on recycled paper at RR Donnelley in Crawfordsville, Indiana First printing, May 2015 For my wife, Sarah Thank you very much for your support and encouragement while I wrote this book Contents Preface Acknowledgments About the Author Chapter 1: What’s Special about Mobile Testing? User Expectations Mobility and Data Networks Mobile Devices Mobile Release Cycles Mobile Testing Is Software Testing Summary Chapter 2: Introduction to Mobile Devices and Apps Overview of Mobile Networks Mobile Devices and the Year 2007 The Big Two What Types of Apps Exist? Native Apps Hybrid Apps Web Apps Business Models of Mobile Apps Freemium Paid Transaction Choosing a Business Model App Stores Summary Chapter 3: Challenges in Mobile Testing The Customer Customer Summary Mobile Platforms and Fragmentation Mobile Device Groups Mobile Device Labs Sensors and Interfaces Ambient Light Sensor Proximity Sensor Acceleration Sensor Gyroscope Sensor Magnetic Sensor Pressure, Temperature, and Humidity Sensors Location Sensor Touchless Sensor Sensors Summary Touchscreen Microphones Camera System Apps Internationalization (I18n) and Localization (L10n) Mobile Browsers Summary Chapter 4: How to Test Mobile Apps Emulator, Simulator, or Real Device? Manual Testing versus Automated Testing “Traditional” Testing Mobile-Specific Testing Mobile Functional Testing Mobile Usability Testing Accessibility Testing Battery Usage Testing Stress and Interrupt Testing Performance Testing Standby Testing Installation Testing Update Testing Database Testing Local Storage Testing Security Testing Platform Guideline Testing Conformance Testing Checking the Log Files Be Creative! Checklists, Mnemonics, and Mind Maps Checklists Mnemonics Mind Maps How to File Mobile Bugs Bug ID Description Steps to Reproduce Expected Result Actual Result Work-around Reproducible Operating System, Mobile Platform, and Mobile Device Mobile-Device-Specific Information Browser Version Software Build Version Network Condition and Environment Language Test Data Severity Bug Category Screenshot or Video Log Files Tester Who Found the Bug Three More Points App Quality Alliance Summary Chapter 5: Mobile Test Automation and Tools The Flipped Testing Pyramid The Mobile Test Pyramid Different Types of Test Automation Tools Image Recognition Coordinate-Based Recognition OCR/Text Recognition Native Object Recognition Capture and Replay Tool Type Recommendation What Should Be Automated? Emulator, Simulator, or Real Device? Emulator/Simulator Pros Emulator/Simulator Cons Real Device Pros Real Device Cons Where to Automate? How to Select the Right Mobile Test Automation Tool Selection Criteria for a Test Automation Tool Current State of Tools Android Tools iOS Tools Mobile Test Automation Tools Summary Continuous Integration System Beta Distribution Tools Summary Chapter 6: Additional Mobile Testing Methods Crowd Testing Private Crowd Testing Mobile Cloud Testing Private Cloud Cloud-Based Test Automation Summary Chapter 7: Mobile Test and Launch Strategies Mobile Test Strategy Define Requirements Testing Scope Define Test Levels and Test Techniques Test Data Select Target Devices and Test Environment Manual and in-the-Wild Testing Mobile Checklists and Tours Test Automation Product Risks Mobile Launch Strategy Pre-Launch—Check the Release Material Post-Release—What Happens after an App Launch? Community Support Reviews Crash Reports Tracking and Statistics Summary Chapter 8: Important Skills for Mobile Testers Skill Set of a Mobile Tester Communication Curiosity Critical Thinking Tenacity Constant Learner Creativity Customer Focus Programming and Technical Skills How to Improve Your Mobile Testing Skills Learn from Other Apps Crashes on Specific Devices Observe Take Part in Competitions and Test Cycles The Mobile Community and the Mobile World Valuable Sources Summary Chapter 9: What’s Next? And Final Thoughts Internet of Things Connected Home Connected Car Wearables Smart Watches and Fitness Wristbands Smart Glasses Health Apps Final Thoughts Five Key Success Factors Summary Index ... click the Back button on your device or app Hands- On Mobile App Testing A Guide for Mobile Testers and Anyone Involved in the Mobile App Business Daniel Knott New York • Boston • Indianapolis • San Francisco... Visit us on the Web: informit.com/aw Library of Congress Cataloging-in-Publication Data Knott, Daniel Hands- on mobile app testing : a guide for mobile testers and anyone involved in the mobile app. .. “Traditional” Testing Mobile- Specific Testing Mobile Functional Testing Mobile Usability Testing Accessibility Testing Battery Usage Testing Stress and Interrupt Testing Performance Testing Standby Testing