Assume you are the Test Manager in charge of independent testing for avionics applications.
You are in charge of testing for a project to implement three different CSCI (Computer Software Configuration Item):
- a BOOT-X CSCI that must be certified at level B of the DO-178B standard
- a DIAG-X CSCI that must be certified at level C of the DO-178B standard
- a DRIV-X CSCI that must be certified at level A of the DO-178B standard
These are three different software modules written in C language to run on a specific hardware platform.
You have been asked to select a single code coverage tool to perform the mandatory code coverage measurements, in order to meet the structural coverage criteria prescribed by the DO-178B standard. This tool must be qualified as a verification tool under DO-178B.
Since there are significant budget constraints to purchase this tool, you are evaluating an open-source tool that is able to provide different types of code coverage. This tool meets perfectly your technical needs in terms of the programming language and the specific hardware platform (it supports also the specific C-compiler).
The source code of the tool is available.
Your team could easily customize the tool to meet the project needs. This tool is not qualified as a verification tool under the DO-178B.
Which of the following are the three main concerns related to that open-source tool selection?
K4 3 credits (2 credits out of 3 credits correct, 1 credit point)
Assume you are managing a test automation project for a mission-critical system.
Because vendor provided tools and open source solutions don't meet the needs of this project, you ask your test team to develop a custom automation framework.
Which of the following management issues associated to the development of this custom automation framework is least likely to manage?
K2 1 credit
An agile development team decides to hire a tester who has always workeD.
- in independent test teams, reporting the problems found in a defect tracking system
- in safety-critical projects, with a stronger focus on the quality of the product than on time and budget.
This agile team is focused on short-term goals to get the product released on time and within budget.
Which of the following answers would you expect to be most likely true in this scenario?
K2 1 credit
Consider the following skills assessment spreadsheet for your test team (consisting of four team members):
This spreadsheet has three sections: technical expertise, testing skills and professionalism.
The skill levels for each skill area for both the “technical expertise” and “testing skills” sections have been rated on a four-point scale:
- E (Expert): indicates that a person has expert knowledge and experience in the skill area
- B (Beginner): indicates that a person has some knowledge and experience in the skill area but he/she is not autonomous
- W (Wants to learn): indicates that a person has no knowledge or experience in the skill area but he/she wants to learn that skill
- NI (Not Interested): indicates that a person has no knowledge or experience in the skill area and he/she is not interested to learn that skill
The skill levels for each skill area of the “professionalism” section have been rated on a three point scale (H=High, M=Medium, L=Low).
Consider the following analysis of testing skills performed on four peoplE. Alex, Robert, John and Mark (all the skills have been rated on an ascending scalE. The higher the score, the better the skill):
Which of these people, based on this analysis, would you expect to be most suitable to work specifically as test designer?
K4 3 credits
Assume you are working on a defect management process to be used by a software organization to track the current status of the defects reports for several projects.
When a defect is found for investigation a defect report is created in “Opened” state that is the unique initial state. The defect report status has also a unique finale state that is the “Closed” state.
The following state transition diagram describes the states of this defect management process:
Where only the initial (“Opened”) and final (“Closed”) states are indicated while the remaining states (V, W, X, Y, Z) have yet to be named.
Which of the following assignments would you expect to best complete the defect management process?
K3 2 credits
During the system testing phase a tester from your test team observes a failure in the system under test and he/she decides to create an incident report. The incident report is currently in a “new” state, indicating it needs to be investigated.
Which THREE of the following information items can’t yet be present in the incident report?
K3 2 credits (2 credits out of 3 credits correct, 1 credit point)
You are the Test Manager for a project to develop a web customer portal of a Pay-TV company that allows customers (with a smartcard and a set-top box) to purchase digital contents.
In the "select" page the system displays a dialogue where the customer can select the items (digital contents) he/she is interested in. In this page he/she can add one or more items to a shopping cart. An item consists of a product and a duration.
There are three types of products: Movie, sport and premium (movie and sport).
There are four possible durations: 1 months, 2 months, winter (from the beginning of January to end of March) and summer (from the beginning of July to end of September).
All the combinations of products and durations are allowed to define an item. Thus there are twelve possible items. A maximum of six different items can be added to the shopping cart at a time.
When the customer decides to check out he/she goes to the "purchase" page where he/she can pay the total amount of the shopping cart in three different ways:
- using a credit voucher
- using a credit already charged on the smartcard
- using a credit card (accepted credit cards are. Visa, MasterCard and Great Wall Card)
The customer can logout from both the “select” and “purchase” pages. In this case no purchase is made.
You decide to apply a blended risk-based and reactive testing strategy and the following is a subset of the exit criteria for system testing:
EXCR1- Each “critical” quality risk item must be covered by at least one test condition
EXCR2- Each “critical” requirement must be covered by at least one test condition
You are following a risk-based testing strategy. The test execution time is very limited. Assume that all the product risk items require more or less the same level of test effort.
Which of the following answers describes the best execution schedule in this scenario?
K3 3 credits
The following are the exit criteria described in the test plan of a software product:
EX1. The test suite for the product must ensure that at least each quality risk item is covered by at least one test case (a quality risk item can be covered by more test cases).
EX2. All test cases in the test suite must be run during the execution phase.
EX3. Defects are classified into two categories: “C” (critical defect) and “NC” (non-critical defect). No known C defects shall exist in the product at the end of the test execution phase.
Which of the following information is useless when the specified exit criteria is evaluated?
K2 1 credit
Consider the following list of statements about audits and management reviews:
I. Audits are usually more effective than management reviews at finding defects
II. Audits and management reviews have the same main goals, the only difference is related to the roles and level of formality
III. A typical outcome of an audit includes observations and recommendations, corrective actions and a pass/fail assessment
IV. An audit is not the appropriate mechanism to use at the code review in order to detect defects prior to dynamic testing
Which of the following statements is true?
K2 1 credit