The Test Automation Manager has asked you to provide a solution for collecting metrics from the TAS that measures code coverage every time the automated regression test pack is run. The metrics must be trend based to ensure that the scope of the regression test pack continues to reflect enhancements made to the SUT - coverage must not drop and should ideally increase. The solution must be as automated as possible to avoid unnecessary manual overheads and errors.
Which of the following approaches would BEST meet these requirements?
A. Test automation cannot measure code coverage for the SUT, only the code for the automation tools and scripts. The automated test cases would need to be run manually with a code coverage and reporting tool running in the background.
B. The automated testware would record overall code coverage for each run and add the figure to a new row in a pre-formatted Excel spreadsheet. You would then present the spreadsheet to stakeholders so they could look for changes in coverage.
C. The automated testware would record overall code coverage for each run, export the data to a pre-formatted Excel spreadsheet that automatically updates a trend analysis bar chart for you to distribute to stakeholders.
D. The automated testware would record the pass/fail rate of each regression test case, export the data to a pre-formatted Excel spreadsheet that automatically updates a trend analysis success rate bar chart and emails it to stakeholders.
You are working as a TAE for a company who have been using a web test execution tool for a number of years. The tool has been used successfully on ten web applications in the past.
The company are developing a new web application which has a friendly User Interface, but the developers have used an object throughout the application which the tool is unable to recognise. As a result, you have no way of capturing the
object or verifying the contents using the automation tool.
What is the first thing you should do about this problem?
A. See if the application can be run on a desktop and if the object can be recognised on the desktop by the tool.
B. Investigate whether the object can be recognised by other test execution tools in the market
C. Ask the developers to remove the object and replace it with some text fields
D. Ask the developers if they can change the object to something that can be recognised by the tool
You have been asked to develop test automation for a legacy system that is going to go through a series of infrastructure migrations. The scripts will be used to verify basic functionality during these infrastructure changes Your Test Analysts
have some programming skills and need a solution that is simple and fast.
Maintainability of the scripts is not a consideration because no changes to the software are anticipated.
Which of the following is the BEST scripting approach in this situation?
A. Structured scripting
B. Capture-replay scripting
C. Model-Based scripting
D. Linear scripting
Consider a TAS that uses a keyword-driven framework. The SUT is a web application and there is a large set of keywords available for writing the automated tests that relate to highly specific user actions linked directly to the GUI of the SUT. The automated test written with the keywords are statically analyzed by a custom tool which highlight's repeated instances of identical sequence of keywords. The waiting mechanism implemented by the TAS for a webpage load is based on a synchronous sampling within a given timeout. The TAS allows checking a webpage load every seconds until a timeout value
A. Changing the scripting approach to data-driven scripting
B. Implementing keywords with a higher level of granularity
C. Changing the wait mechanism to explicit hard-coded waits
D. Establishing an error recovery process for TAS and SUT
What is the PRIMARY advantage of using abstraction in the TAA?
A. It makes it more flexible for future reuse and improvements
B. It requires a higher skill level to implement
C. It ensures that any scripting method will be supported
D. It improves the performance of the TAS
Which of the following statements about the reuse of TAS artefacts is TRUE?
A. Reusable TAS artefacts can include components (or parts of components) associated with different layers of the TAA
B. To enable reuse of TAS artefacts, a good design for reuse is built into the TAA and to further action are needed during the TAS lifecycle
C. Communications maintenance and improvements for reusing TAS artefacts are modify addressed during the design of the TAA
D. Reusable TAS artifacts associated with the definition layer of the TAA include the adaptors to the SUT components and/or interfaces
Your goal is to verify completeness, consistency and correct behavior of an automated test suite. The TAS has been proven to successfully install in the SUT environment. All the preliminary checks to verify the correct functioning of the automated test environment and test tool configuration, installation and setup have successfully completed. Which of the following is NOT a relevant check for achieving your goal in this scenario?
A. Checking whether all the test cases contain the expected results
B. Checking whether the post condition have been fulfilled for all the test cases
C. Checking whether the loading of the TAS is repeatable in the SUT environment
D. Checking whether all the test cases produce repeatable outcomes
You have been asked to automate a set of functional tests at system Test level via the CLI of the SUT for the first release of a software system. The automated tests will be delivered to the learn in change of maintenance testing, who will use them for part of the regression testing. They have the following requirements.
1. The automated tests must be as fast and cheap to maintain as possible
2. The cost of adding new automated tests must be as low as possible
3. The automated tests must have a high level of independence from the tool itself Which of the following scripting techniques would be MOST suitable?
A. Data-driven scripting
B. Keyword-driven scripting
C. Linear scripting
D. Structure scripting
Which of the following metrics could suggest, under certain condition that an automated regression test suite has NOT been updated for new functionalities added to the SUT?
A. The ratio of comments to executable statements in the SUT code.
B. The SUT code coverage provided by the execution of the regression test suite.
C. The defect density in the automation code of the regression test suite.
D. The ratio of commands to executable statements in the automation code of the regression test suite
Which of the following success factors for a test automation project is TRUE?
A. Automated tests must be designed to capture only the data that is strictly needed for comparing expected and actual results
B. The test cases to be automated first must always be selected based on the number of times a test will need to be run
C. The test cases to be automated must have a high dependency on particular data values
D. Automated tests that fail due to changes in the requirements of the SUT should be promptly fixed rather than disabled from the test suite