Certified Tester Advanced Level Test Management (CTAL-TM) v3.0 Questions and Answers
Which of the following statements is true regarding documentation standards? [2]
Which of the following is a generic good practice when evaluating and selecting a test tool?
Assume that you are working for a company that has maintained and tested a car parking permit system for many years. The system holds the name and address of permit holders and automatically writes to the permit holder with a form to renew or cancel their permit each year.
The test plan states the following:
"since the system is considered a stable system. Boundary Value Analysis is the only test case design technique that needs to be applied during testing"
Consider the following change that was detailed in the Requirements Specification for a replacement to an existing parameter held within the system;
• The specified renewal date for each permit must be not be after 31 st January 2020. Which one of the following is a valid test condition that satisfies both the requirement and the test plan?
SELECT ONE OPTION
Which of the following is the MOST relevant factor to consider when selecting an open source tool? SELECT ONE OPTION
Which testing metric identifies defect density? [1]
Your last project was released three months ago and used a risk-based approach. In production, a number of serious failures in low risk areas have occurred.
What is the most important lesson to be learned from this information? [2]
Which of the following are primary activities in conducting product risk analysis? [1]
Assume that you are part of a team conducting test design for a new university system that will allow students to update their own personal information. The Test
Strategy states that positive and negative testing should be carried out. along with performance, security and interoperability testing against all new requirements.
The following requirements have been identified by stakeholders:
1. Students must be able to make changes to the following information:
a Name (due to marital status)
b Marital status
c. Home address
d. Home telephone number
e. Email address
f. Mobile telephone number
g. Contact details in case of emergency
2 Only Reception staff must have access to the information held.
3 The system must support 2000 concurrent users and details updated on the system within 20 seconds.
4. Interoperability of the new system with the other systems maintained by the University for student Registrations.
Test analysis for functional and non-functional testing has iust bequn and the following test conditions have been identified:
Which one of the following is a valid test condition that is missing from the table of test conditions and has clear traceability back to the test strategy and requirements?
SELECT ONE OPTION
Your company specialises in the manufacture of luxury garden furniture to the UK market and it is starting a project that will deliver a major update to its payment processing component, addressing improvements to functional suitability and performance efficiency.
A decision has been made to transfer responsibility for functional system test procedure creation and execution to a software house, located offshore. System test analysis and design will be performed onshore, at the company's UK headquarters. As the senior test manager for your company, you want to employ another experienced test manager to oversee the daily operations of the software house to ensure that their work meets required quality standards and adheres to the agreed organisational test strategy and project test plan.
Which option presents the skills that are of MOST relevance for the new test manager role?
Which of the following is an advantage of specifying test conditions at a detailed level? [1]
You are Test Manager working on a project which is improving the user interface for its call centre staff handling customer enquiries. The project has completed UAT for the first iteration; however a large number of defects were raised by call centre staff seconded to help with the User Acceptance testing.
The defects described the user interface as not being intuitive enough with a poor 'help' facility. A user representative spent a week working with developers and system testers to explain the issues, which were subsequently agreed to have resulted from poorly specified usability requirements.
The requirements were defined separately for each iteration and have been formally reviewed by business analysts, developers and the IT director.
The user representative was also able to answer a number of other questions that the system test team had regarding call centre workflows, which improved their domain knowledge.
You have been asked to conduct a project retrospective and recommend improvements for the next iteration which introduces further user interface changes. Which of the following would be the MOST effective improvement for the next iteration?
Which of the following aspects should test progress metrics be mapped to? [1]
You are performing a risk assessment for a financial application using quantitative risk analysis. The following is a table describing the analysis undertaken so far:
Which of the following statements correctly describes the outcome of the risk assessment using the "Cost of Exposure" technique in this scenario? SELECT ONE OPTION
Assuming that 'In progress' means that somebody is working on a fix and that 'Resolved' means that the fix passed the confirmation test; which option provides a defect workflow that flows in a sensible way from an initial state to a terminal state?
The previous release of an in-house invoicing application was live for 6 months before beingreplaced by a later release.
• Before it went live, €1,500 had been spent on defect prevention and a further €4,500 had been spent on writing and running tests; these tests found 80 defects and the average cost of dealing with these was €50 each.
• By the time that it was replaced, defect reports from live running showed that pre-release testing had found only 80% of the defects that were present; the average cost of dealing with the defects that went live was 12 times that of the internal failures.
Which statement is TRUE?
Which of the following is likely to occur if reviewers do not have an adequate level of technicalknowledge? [1]
You are a new Test Manager on a maintenance release for an existing mature product that is expected to be retired in the not too distant
future. The previous release had utilized a performance regression test suite written in an in-house custom tool using the same
programming language as the product itself. This suite will most likely require tweaking to ensure it works with the new version of the
product. While there are several members in the performance testing team, the original author of the performance testing tool has moved on
to another company, and none of the remaining staff have a great deal of familiarity with the performance test scripts used to test this
product.
How would you recommend this scenario be addressed? [3]
The diagram shows a defect workflow in which two states do not have appropriate names.
Which option could correctly provide the missing state names?
You have been promoted to Test Manager within your company. Your new manager states that your test team utilized a risk-based test approach for the last release but in production, a number of
serious failures in lightly tested areas have occurred.
What would be your first action prior to the start of the next test phase for the next release? [3]
Most managers in your company consider the efforts of your test team valuable, while others seecomprehensive testing as an unnecessary cost overhead to the SDLC.
What action could the Test Manager take to quantify the value of testing to the organization? [3]
Which of statement about defect management is TRUE?
Which one of the following is NOT a determining factor when considering the optimal time to conduct a document review? SELECT ONE OPTION
While mining the defect database for patterns of problems in the last release, a Test Manager notices that many of the most damaging failures were caused by defects
injected during the low-level design phase.
Which of the following actions will likely give this project the most effective solution to this problem? [3]
Which one of the following metrics would be MOST suitable for helping to determine whether test analysis and design is complete? SELECT ONE OPTION
You are Test Manager of a project delivering a workflow system for complex business processes It has been decided a tool is required to increase the efficiency of test execution. What would be a valid issue to consider when deciding whether to build a custom made tool?
SELECT ONE OPTION
Referring to SCENARIO 2 It has been agreed that Project 1 will be delivered using an Agile approach, with user stories delivered across three sprints, each lasting 4 weeks. The programme manager is concerned about RISK 3 and wants the Master Test Plan to specify an effective test process improvement approach.
Which of the following is the best test process improvement approach for Project 1 ? SELECT ONE OPTION
Refer to SCENARIO 2 Project 2 is to be delivered using a RAD software development model. There will be two increments, the first will deliver a simple prototype user interface to facilitatetesting of the sound system delivered by 'Silver Sound Ltd', the second will deliver the full user interface required for the production system.
Development of the business requirements and project plan are underway, detailed system analysis will follow for each increment.
You have studied the test policy and risk register and must plan the next set of test activities. Which one of the following is the MOST effective approach for this project?
SELECT ONE OPTION
Which TWO of the following metrics will be MOST useful in helping the stakeholders to decide whether to allow the system into acceptance testing?
Breakdown of all risks by status (closed / not fully tested / one or more tests failed)
Breakdown by test priority of test execution status (passed / failed / not run)
Breakdown of outstanding risks by risk level and status (not fully tested / one or more tests failed / both)
Breakdown of unresolved defects by severity and status
Breakdown of unresolved defects by Risk Id/s that is/are affected by them
You are the Test Manager of a four-person test team working for a small distribution company with a single warehouse. Your team has been working with a third party development team on a new
inventory management system. The company expects this system to generate approximately one million dollars per annum in profits for the company. Early in the project, various risks were
identified, and steps taken to mitigate those risks.
For example, you sent your test team for training on the new system, and upgraded the test environment. There are still some lingering risks that have not been addressed, but they have been
determined to have a low chance of occurring, with minimal impact if they do occur.
What would be the best option to mitigate these remaining risks? [3]
Which option correctly presents the main characteristics of test estimation?
You are testing a new product that will turn on the windshield wipers of a car when the sensors detect there is moisture on the windshield. Depending on the information
returned from the sensors, the wipers will be turned on at one of the following speeds: slow intermittent, medium intermittent, fast intermittent, slow constant, medium
constant, fast constant. Your team has identified the following test condition:
Test Condition 1.1.1 - Verify that the windshield wipers can go from slow constant to fast constant speed when the amount of moisture increases appropriately.
Your team has defined the following steps for a test case for this test condition:
1. Set the moisture sensor to request slow constant
2. Increase the moisture to set the sensor to request fast constant
3. Verify that the wipers respond with fast constant speed
Given this information, which of the following statements is correct? [2]
SCENARIO 1
DreamPartner dating agency are redesigning their dating application following a major security breach in which sensitive customer data was made publically available. The redesign includes stronger security encryption and performance tuning.
The product risk register for the redesign project, which was produced after all requirements had been agreed, includes the following:
The organisational Test Strategy contains the following objectives:
1. A Risk-based lest approach must be adopted for all projects
2. Functional regression testing should start as soon as functional testing is complete
3. Automated tests may be run before or in parallel with manual tests
The project Test Plan has allocated 6 weeks to complete all test execution, with functional testing taking 3 weeks to execute, performance and security testing 2 weeks each and regression testing 1 week.
Which of the following options places the test suites (TS1 to TS5) in the correct order for test execution?
SELECT ONE OPTION
A car rental company offers discounts to its customers based on a number of factors, including booking history, length of membership and type of car being booked. An update to the rental application is under test, with test cases written that specifically address a documented product risk covering discount calculation. Although the risk impact was analysed as high, the likelihood was given as low, as there had been no known changes to the calculation rules. However, during test execution some discount calculations were incorrect and investigation showed that code changes had been made that impacted the discount algorithms. As a result, the likelihood was increased to high by the risk management team.
Which would be the BEST measure to take to respond to the current situation?
As test manager, you need to determine if there are likely to be new security risks arising from proposed changes to an in-house purchasing application. You invite a security testing consultant, who is external to the organisation, to assess the changes and provide you with their written report of perceived security risks.
Which risk identification technique are you using?
You have assembled the following cost of quality numbers 1 000 defects were found prior to release and 100 were found after.
Given this information what should you conclude?
Which test process improvement model consists of five maturity levels?
You are a new lest manager in an organization You have been asked to assess the defect process to determine if there are any efficiency improvements that could be made that would reduce the cost of quality You have started digging through the defect Information What information would be most helpful for this investigation?
When Is the metric for the percentage of requirements coverage defined?
There is a debate in your organization about who can close a defect report The developers think they should be able to reject and close defects without any further steps The testers are not happy with this approach as they are afraid the rejections may go undetected and the developers may close something without understanding the real problem
How can this problem be rectified7
What is the purpose of the defect management committee?
You are managing the test team that is testing a new mobile application that provides a "step-by-step' hiking guide Your risk assessment resulted in the following table:
Your team has clone the depth and breadth testing for the GPS accuracy and usability features but when the product was given to beta testers there were some issues Despite the users reporting the app was easy to use at least one user walked off the edge of a cliff and another one ended up in a river. Your team has confirmed that the functionality is working correctly. and the GPS information is accurate.
What other area of testing should you now prioritize?
You are working for an outsource testing company You have a client that will only consider candidates that are highly skilled with Salesforce. regardless of the number of years they have spent testing similar products You have looked through your skills matrix and you have no one with the right type of experience for this project.
What competence area is your team lacking?
At what testing level do the test management activities Include coordinating with end users7
Which of the following Is the common set of information to be produced in a test estimate''
In what environment are you most likely to see multiple defect management systems used in one project?
Which of the Mowing Is commonly used by a test manager to identity risks'
You have been looking at the actual vs expected defects in one high risk area of the software The actual is much higher than the expected value What should you do?
Which of the following defect statistics will provide input to be used for improvement in the defect reporting process?
Which of the following Is a way in which risk analysis drives test analysis?
Your team has been assigned to a new project You have a mix of manual testers and automation engineers but everyone is currently doing manual testing. The development learn has alreadydecided to use DevOps as its approach but they have never used it before and are happy to take your input Unfortunately, about 50% of the development is completed already In the testing your team is doing they are finding that about 40% of the defects they catch are actually regressions caused by other changes
Given this information what should you do to help mitigate risk'?
You have decided to help your team improve their skills. One of their assignments is to mentor a junior member of the team Which competency should you expect the mentor to develop during this exercise?
Which of the following is the proper order for the stages of a tool lifecycle?
Your team has been given the following test objective Ensure that the users are happier with this version than they were with the last version?
What is wrong with the way this is defined?
Your team has been working on an Agile project for two months. There is a retrospective at the endof each sprint One of the data items reviewed is how many defects are being caught by users rather than by testers. The test team is being blamed for these escapes
What do you need to do to make these sessions more productive?
You have been assigned t o a project that has a very tight schedule. In fact, given your first analysis you do not think the planned test execution can be completed within the schedule There is no time allowed for defect fixing or for repeating tests. Regression testing has been left out of the planning entirely There is no time to develop test automation. The team has agreed that this Is not the way to run a project, yet they are stuck with the current schedule
Given this information what is the best way to proceed with the testing to try to meet the deadline with the best outcome1?
You are looking to Improve the efficiency of testing. The developers have been claiming that the majority of defect reports they receive are invalid either due to the test environment or because the tester did not follow the right steps In a standard defect management process where should you look for more information about these invalid defects?
You have been asked to make a recommendation on deployment readiness on the software your team has been testing.You have the following metrics:
Given this information what is a critical metric you are missing?
Which of the following is required to apply an experience-based testing approach''
Your manager has decided that your team of manual testers should all become test automation engineers Your team is much stronger in analysis than In technical testing so you are concerned about their ability to adapt. What tool capabilities could help with this transition?
Your team has been assigned to test a loyalty card program for a supermarket chain. Because this is a highly competitive market significant investment has been made to determine the shortcomings of the products offered by competitors While the feature sets are mostly the same, there is a wide variance In usability and performance and the users perceptions of these quality characteristics
Given only this information what test approach would be most appropriate?
In what way is the operations team usually Involved In testing7
You tend to be conservative in your project estimations because you know how many things can go wrong and extend the schedule. You manager is not happy with your estimates and thinks you are being too negative with your numbers and not trying hard enough Which estimation method should you use to provide your manager with a positive' number while still also providing the number you think is more realistic?
You are working on a project where the business part of the organization works traditionally with defined requirements, but the development team follows an Agile model Neither team plans to change their approach What is the proper name for this type of project approach''
Which of the following best describes the appraisal costs in the cost of quality'
Your organization has decided to augment your testing team with an offshore team. The offshore team members are experienced testers who are experts in the domain of the system under test Your team is worried about the offshore team taking their jobs and they are resistant to the change You need to pick three of your team members to be the ambassadors for the new team
Which competences will be most important for your ambassadors to possess?
You are working In an environment that is continually pushing process improvements down to the lest team You are skeptical that any of these have actually accomplished any improvement In fact you know that some of the changes have actually impaired progress
Given this information what step of the IDEAL model is missing?
In an Agile project, when Is it acceptable lo not write a formal defect report when a defect is found''
Which of the following Is considered a heavyweight risk-based testing technique'