Test management
Encyclopedia
Test management is the activity of managing some tests. A test management tool is software used to manage tests
(automated or manual) that have been previously specified. It is often associated with automation
software. Test management tools often include requirement
and/or specification
management modules that allow automatic generate a requirement test matrix
(RTM), which is one of the main metrics to indicate functional coverage of a system under test
(SUT).
, association with product requirements
and specifications
. Eventually, some relationship can be set between tests so that precedences can be established.
i.e. if test A is parent of test B and if test A is failing, then it may be useless to perform test B.
Tests should also be associated with priorities.
Every change on a test must be versioned so that the QA team has a comprehensive view of the history of the test.
Execution can be either manual or automatic.
Manual execution
The user will have to perform all the test steps manually and inform the system of the result.
Some test management tools includes a framework to interface the user with the test plan
to facilitate this task.
Automatic execution
There are a numerous way of implementing automated tests.
Automatic execution requires the test management tool to be compatible with the tests themselves.
To do so, test management tools may propose proprietary automation frameworks or APIs to interface with third-party or proprietary automated tests.
Metrics are generally presented as graphics and tables indicating success rates, progression/regression and much other sensitive data.
or Mantis) efficiently link a test failure with a bug
.
functionalities to help the QA manager planning activities ahead of time.
and IBM Rational Quality Manager
. Most test management tools are web-served applications that need to be installed in-house. Others can be accessed as Software as a service
.
Test case
A test case in software engineering is a set of conditions or variables under which a tester will determine whether an application or software system is working correctly or not. The mechanism for determining whether a software program or system has passed or failed such a test is known as a test...
(automated or manual) that have been previously specified. It is often associated with automation
Automation
Automation is the use of control systems and information technologies to reduce the need for human work in the production of goods and services. In the scope of industrialization, automation is a step beyond mechanization...
software. Test management tools often include requirement
Requirement
In engineering, a requirement is a singular documented physical and functional need that a particular product or service must be or perform. It is most commonly used in a formal sense in systems engineering, software engineering, or enterprise engineering...
and/or specification
Specification (technical standard)
A specification is an explicit set of requirements to be satisfied by a material, product, or service. Should a material, product or service fail to meet one or more of the applicable specifications, it may be referred to as being out of specification;the abbreviation OOS may also be used...
management modules that allow automatic generate a requirement test matrix
Traceability matrix
A traceability matrix is a document, usually in the form of a table, that correlates any two baselined documents that require a many to many relationship to determine the completeness of the relationship...
(RTM), which is one of the main metrics to indicate functional coverage of a system under test
System under test
System under test refers to a system that is being tested for correct operation. The term is used mostly in software testing.A special case of a software system is an application which, when tested, is called an application under test....
(SUT).
Creating tests definitions in a database
Test definition includes: test planTest plan
A test plan is a document detailing a systematic approach to testing a system such as a machine or software. The plan typically contains a detailed understanding of what the eventual workflow will be.-Test plans:...
, association with product requirements
Requirement
In engineering, a requirement is a singular documented physical and functional need that a particular product or service must be or perform. It is most commonly used in a formal sense in systems engineering, software engineering, or enterprise engineering...
and specifications
Specification (technical standard)
A specification is an explicit set of requirements to be satisfied by a material, product, or service. Should a material, product or service fail to meet one or more of the applicable specifications, it may be referred to as being out of specification;the abbreviation OOS may also be used...
. Eventually, some relationship can be set between tests so that precedences can be established.
i.e. if test A is parent of test B and if test A is failing, then it may be useless to perform test B.
Tests should also be associated with priorities.
Every change on a test must be versioned so that the QA team has a comprehensive view of the history of the test.
Preparing test campaigns
This includes building some bundles of test cases and execute them (or scheduling their execution).Execution can be either manual or automatic.
Manual execution
The user will have to perform all the test steps manually and inform the system of the result.
Some test management tools includes a framework to interface the user with the test plan
Test plan
A test plan is a document detailing a systematic approach to testing a system such as a machine or software. The plan typically contains a detailed understanding of what the eventual workflow will be.-Test plans:...
to facilitate this task.
Automatic execution
There are a numerous way of implementing automated tests.
Automatic execution requires the test management tool to be compatible with the tests themselves.
To do so, test management tools may propose proprietary automation frameworks or APIs to interface with third-party or proprietary automated tests.
Generating reports and metrics
The ultimate goal of test management tools is to deliver sensitive metrics that will help the QA manager in evaluating the quality of the system under test before releasing.Metrics are generally presented as graphics and tables indicating success rates, progression/regression and much other sensitive data.
Managing bugs
Eventually, test management tools can integrate bug tracking features or at least interface with well-known dedicated bug tracking solutions (such as BugzillaBugzilla
Bugzilla is a Web-based general-purpose bugtracker and testing tool originally developed and used by the Mozilla project, and licensed under the Mozilla Public License....
or Mantis) efficiently link a test failure with a bug
Software bug
A software bug is the common term used to describe an error, flaw, mistake, failure, or fault in a computer program or system that produces an incorrect or unexpected result, or causes it to behave in unintended ways. Most bugs arise from mistakes and errors made by people in either a program's...
.
Planning test activities
Test management tools may also integrate (or interface with third-party) project managementProject management
Project management is the discipline of planning, organizing, securing, and managing resources to achieve specific goals. A project is a temporary endeavor with a defined beginning and end , undertaken to meet unique goals and objectives, typically to bring about beneficial change or added value...
functionalities to help the QA manager planning activities ahead of time.
Test management tools
There are several commercial and open source test management tools available in the market today which include HP Quality CenterHP Quality Center
HP Quality Center is a set of web-based test management software offerings from the HP Software Division of Hewlett-Packard, many of which were acquired from Mercury Interactive Corporation. HP Quality Center offers software quality assurance, including requirements management, test management...
and IBM Rational Quality Manager
IBM Rational Quality Manager
IBM Rational Quality Manager provides a collaborative application lifecycle management environment for test planning, construction, and execution.-Overview:...
. Most test management tools are web-served applications that need to be installed in-house. Others can be accessed as Software as a service
Software as a Service
Software as a service , sometimes referred to as "on-demand software," is a software delivery model in which software and its associated data are hosted centrally and are typically accessed by users using a thin client, normally using a web browser over the Internet.SaaS has become a common...
.
See also
- Test management toolsTest management toolsTest management tools are used to structure automated tests and manual test processes, and to easily manage multiple environments. Quality assurance teams use these types of tools as a single application for managing test cases, environments, automated tests, defects and project tasks...
- Software TestingSoftware testingSoftware testing is an investigation conducted to provide stakeholders with information about the quality of the product or service under test. Software testing can also provide an objective, independent view of the software to allow the business to appreciate and understand the risks of software...
- Test automation management toolsTest automation management toolsTest automation management tools tools are specific tools providing test automation collaborative environment that is intended to make test automation efficient, clear for stakeholders and traceable. Since test automation is becoming cross-discipline Test automation management tools tools are...
- Enhancing test management platforms : KalistickKalistickKalistick is a French based company editing a software radiography platform for Java and C# developments. Its goal is to help test teams improve their efficiency in software testing.-Overview:...