Software testing 2

SOFTWARE TESTING DEPARTMENT OF COMPUTER SIENCE AND ENGINEERING (UG & PG) Final Year Computer Science and Engineering, th Semester Marks Question and Answer Subject Code & Name: SOFTWARE TESTING UNIT-I Define Validation Validation is the process of evaluating a software system or component during or at the development cycle in order to determine whether it satisfies specified requirements end of the Define verification Verification is the process of evaluating a software system or component to determine whether the products of a given development phases satisfy the conditions imposed at the start of that phase What is testing? It is generally described as a group of procedures carried out to evaluate some aspect of a piece of software List out the benefits of test process improvement Smarter testers High quality software Ability to meet budget and scheduling goals Improved planning Ability to meet quantifiable testing goals Define debugging Debugging or fault localization is the process of Locating the fault or defect Repairing the code Retesting the code Depart ment of Compute Science and Engineering Page SOFTWARE TESTING Define errors An error is a mistake, misconception or misunderstanding on the part of a software developer Define Fault A fault is introduced into the software as the result of an error It is an anomaly in the software that may cause it to behave incorrectly and not according to its specification Define Failures A failure is the inability of a software system or component to perform its required function within specified performance requirements What is meant by Test cases? In order to decide whether the software has passed or failed the test the tester also needs to know what are the proper outputs for the software, given the set of inputs and execution condition What are the software testing principles? a general or fundamental ,law, doctrine or assumption a rule or code of conduct The laws or facts of nature underlying the working of an artificial device 1 List out the origins of defects E ducation communication oversight Transcription P rocess What are all the types of defects? Requirements and specification defects Design defects Coding defects Testing defects Depart ment of Compute Science and Engineering Page SOFTWARE TESTING Define defect repository The defect repository concept supports storage and retrieval of defect data from all projects in centrally accessible location What you meant by software quality? Quality relates to the degree to which a system, system component, or process meets specified requirements Define Software quality assurance group It is a group in a team of people with the necessary training and skills to ensure that all necessary actions are taken during the development process so that the resulting software conforms to established technical requirements What is the objective of SQA? The objective of software quality assurance is to conduct various methods of testing and assure the quality of the software products by following the global Standards and to produce robust, efficient compatible and easy to use applications Define the structure of TMM levels A set of maturity goals Supporting maturity sub goals Activities, tasks and responsibilities What are the goals of tasks force team? o o To define a body of knowledge To define a code of ethics for the software engineer What are all the engineering approach to the software development? The development process is well understood Projects are planned Life cycle models are defined and adhered to Stands are in place for product and process Measurements are employed to evaluate product and process quality Components are reused Validation and verification processes play a key role in quality determination Engineers have proper education, training and certification Depart ment of Compute Science and Engineering Page SOFTWARE TESTING Define Test Oracle It is a document or piece of software that allows testers to determine whether a been passed or failed test has What you mean by test bed? It is an environment that contains all the hardware and software needed to test a component or a software system Depart ment of Compute Science and Engineering software Page SOFTWARE TESTING UNIT-II TEST CASE DESIGN Define smart tester It is defines as the responsibility of the testers to design tests that reveal defects be used to evaluate software performance, usability and reliability and can Define Novice testers Taking their responsibilities seriously might try to test a module or component all possible inputs and exercise all possible software structures What you mean by black box approach? There is no knowledge of its inner structure (how it works) The tester only has knowledge of what it does What you mean by white box approach? It focuses on the inner structure of the software to be tested To design teat case using this strategy the tester must have knowledge of that structure Define random testing If a tester randomly selects inputs from the domain this is called random testing Define equivalence class partitionining Equivalence class partitioning results in a partitionining of the input domain of the under test software List out the advantages of equivalence class partitionining Elimanates the need for exhaustive testing It guides a tester in selecting a subset of test inputs with a high probability of detecting a defect It allows a tester to cover a larger domain of inputs/outputs with a smaller subset selected from an equivalent class Depart ment of Compute Science and Engineering Page SOFTWARE TESTING Define boundary value analysis With experience testers soon realize that many defects occur directly on and above and edges of equivalence class below the Define cause and effect graphing It is a technique that can be used to combine conditions and derive an effective set of cases that may disclose inconsistencies in a specification test Define state A state is an internal configuration of a system or component.It is defined in terms of the values assumed at a particular time for the variables that characterize the system or component 1 Define finite state machine A finite state machine is an abstract machine that can be represented by a graph finite number if states and a finite number of transitions between states having a What you mean by error guessing? It is based on tester’s/developer’s past experience with code similar to the code under test and their intuitions to where defects may lurk in the code What you mean buy test adequacy criteria? The tester develops test cases that exercise structural elements are executed when the test case run List out the examples for coverage and control flow graphs Program statements Decisions/branches Conditions Combinations of decisions and conditions Paths What are the two major payoffs for the tester? Quantitative coverage goals can be proposed Depart ment of Compute Science and Engineering Page SOFTWARE TESTING Commercial tool support is readily available to facilitate the testers work List the axioms / properties of evaluating test adequacy criteria Applicability property N onexhaustive applicability property monotoncity property i nadequate empty set antiextension property general multiple change property Antidecomposition property Antiecomposition property Renaming property complexity property 1 statement coverage property Define path Data is selected to ensure that all paths of the program have been executed Black box Vs White box testing For every use case, there is a use case realization that represents how the system is designed to accomplish the use case The use case itself lives in the requirements domain and simply specify necessary The use-case realization lives inside the solution space and describes how the accomplished by the system behavior behavior is 19 Define test set data It is statement or branch adequate if a teat set T for program P causes all the branches to be executed respectively statements or 20 Give the formula for calculating the control flow graph V(G)=E-N+2 Depart ment of Compute Science and Engineering Page SOFTWARE TESTING UNIT-III LEVELS OF TESTING What are the needs for the levels of testing? Unit test Integration test System test Acceptance test Define software unit A unit is the smallest possible testable software component List the components suitable for the unit test Procedures and functions Class/objects and methods Procedure-sized reusable components List the task prepared by the developer /tester to perform unit test Plan the general approach to unit testing Design the test cases and test procedure Define relationships between the tests Prepare the auxiliary code necessary for unit test Define test harness The auxiliary code developed to support testing of units and components is called a test harness The harness consists of drivers that call the target code and stubs that represent modules it calls Under what condition the unit tests can begin The units becomes available from the developers The test cases have been designed and reviewed Depart ment of Compute Science and Engineering Page SOFTWARE TESTING The test harness and any other supplemental supporting tools are available List that need to be carefully investigated by the tester A fault A fault A fault A fault in the test case specification in test procedure execution in the test environment in the unit design What are all the two major goals of integration test? To detect defects that occurs on the interfaces of unit To assemble the individual units into working subsystems and finally a complete system that is ready for system test Give some examples for control flow criteria All modules in the graph or chart should be executed at least once All calls should be executed at least once All descending sequences of calls should be executed at least once Define cluster A cluster consists of classes that are related for example they may work together to support a required functionality for the complete system 1 What are all the plan included in integration test planning? Clusters this cluster is dependent on A natural language description of the functionality of the cluster to be tested List of classes in the cluster A set of cluster test cases List the types of system plan Functional testing Performance testing Stress testing, Configuration testing What are the two types of requirements in performance testing? Functional requirements Quality requirements List the objectives of configuration testing Show that all the configuration changing commands and menus work properly Show that all interchangeable devices are really interchangeable and that they each enter the proper states for the specified conditions, Depart ment of Compute Science and Engineering Page SOFTWARE TESTING Show that the systems performance level is maintained when devices are interchanged or whey they fail Define regression testing It is not a level of testing but it is the retesting of software that occurs when changes are made to ensure that the version of the software has retained the capabilities of the old version and that no new defects have been intoopduced due to the changes Define alpha test This take place at the developer’s site A cross sectional potential users and members oh the developers organization are invited to use the software Developers observe the users and note problems Define beta test It sends a cross sectio9n of user who install it and use it under real working user sends records of the with software to the development condition The organization where the are repaired sometimes in the current release Define Test suite It defined as collection of test cases, typically related by a testing goal or an dependency implementation Define the goals of acceptance test Evaluate whether the system meets the customer criteria Determine whether the customer will accept the system Define unit test Exercising the smallest individually executable code units It is a defect testing process Component or unit testing is the process of testing individual components in isolation Depart ment of Compute Science and Engineering Page 10 SOFTWARE TESTING UNIT-IV TEST MANAGEMENT Define Plan A plan is a document that provides a framework or approach for achieving a set of goals Define milestone Milestones are tangible events that are expected to occur at a certain time in the projects lifetime Managers use them to determine project status List the essential high level items that planners usually have a b c d e f Overall test objectives What to test Who will test How to test When to test When to stop test List any four components of a test plan a Tester plan identifier b Items to be tested c Features to be tested d Pass/ fail criteria e Define feature It may system be described as distinguish characteristics of a software component or What you mean by work breakdown structure? It is a hierarchical or treelike representation of all the tasks that are required to complete a project What are all the test plan included in the testing costs? a b Costs of planning and designing the tests Costs of acquiring the hardware and software necessary for the tests Depart ment of Compute Science and Engineering Page 11 SOFTWARE TESTING c d e f Costs to support the test environment Costs of executing the tests Costs of recording and analyzing tests results Tear-down costs to restore the environment What are the approaches available to test cost estimation? a b c d e The CCOMO model and heuristics Use of test cost drivers Test tasks Tester / developers ratios Expert judgment Define costs drivers It can be described as a process or product factor that has an impact on overall costs projects Give some examples of test cost drivers a Numbers of test procedures b Number of requirements c Number of modulus 1 Define test design specification IEEE standard for soetware test documentation describe a test design specification as a test deliverable that specifies the reuiremwnts of that teat approach Depart ment of Compute Science and Engineering Page 12 ... that contains all the hardware and software needed to test a component or a software system Depart ment of Compute Science and Engineering software Page SOFTWARE TESTING UNIT-II TEST CASE DESIGN... respectively statements or 20 Give the formula for calculating the control flow graph V(G)=E-N +2 Depart ment of Compute Science and Engineering Page SOFTWARE TESTING UNIT-III LEVELS OF TESTING What are... the types of system plan Functional testing Performance testing Stress testing, Configuration testing What are the two types of requirements in performance testing? Functional requirements Quality