White-box testing

White-box testing (also known as clear box testing, glass box testing, transparent box testing, and structural testing) is a method of testing software that tests internal structures or workings of an application, as opposed to its functionality (i.e. black-box testing). In white-box testing an internal perspective of the system, as well as programming skills, are used to design test cases. The tester chooses inputs to exercise paths through the code and determine the appropriate outputs. This is analogous to testing nodes in a circuit, e.g. in-circuit testing (ICT).

White-box testing can be applied at the unit, integration and system levels of the software testing process. Although traditional testers tended to think of white-box testing as being done at the unit level, it is used for integration and system testing more frequently today. It can test paths within a unit, paths between units during integration, and between subsystems during a system–level test. Though this method of test design can uncover many errors or problems, it has the potential to miss unimplemented parts of the specification or missing requirements.

White-box test design techniques include the following code coverage criteria:

Overview

White-box testing is a method of testing the application at the level of the source code. These test cases are derived through the use of the design techniques mentioned above: control flow testing, data flow testing, branch testing, path testing, statement coverage and decision coverage as well as modified condition/decision coverage. White-box testing is the use of these techniques as guidelines to create an error free environment by examining any fragile code. These White-box testing techniques are the building blocks of white-box testing, whose essence is the careful testing of the application at the source code level to prevent any hidden errors later on.[1] These different techniques exercise every visible path of the source code to minimize errors and create an error-free environment. The whole point of white-box testing is the ability to know which line of the code is being executed and being able to identify what the correct output should be.[1]

Levels

  1. Unit testing. White-box testing is done during unit testing to ensure that the code is working as intended, before any integration happens with previously tested code. White-box testing during unit testing catches any defects early on and aids in any defects that happen later on after the code is integrated with the rest of the application and therefore prevents any type of errors later on.[1]
  2. Integration testing. White-box testing at this level are written to test the interactions of each interface with each other. The Unit level testing made sure that each code was tested and working accordingly in an isolated environment and integration examines the correctness of the behaviour in an open environment through the use of white-box testing for any interactions of interfaces that are known to the programmer.[1]
  3. Regression testing. White-box testing during regression testing is the use of recycled white-box test cases at the unit and integration testing levels.[1]

Basic procedure

White-box testing's basic procedures involves the tester having a deep level of understanding of the source code being tested. The programmer must have a deep understanding of the application to know what kinds of test cases to create so that every visible path is exercised for testing. Once the source code is understood then the source code can be analyzed for test cases to be created. These are the three basic steps that white-box testing takes in order to create test cases:

  1. Input involves different types of requirements, functional specifications, detailed designing of documents, proper source code, security specifications.[2] This is the preparation stage of white-box testing to layout all of the basic information.
  2. Processing involves performing risk analysis to guide whole testing process, proper test plan, execute test cases and communicate results.[2] This is the phase of building test cases to make sure they thoroughly test the application the given results are recorded accordingly.
  3. Output involves preparing final report that encompasses all of the above preparations and results.[2]

Advantages

White-box testing is one of the two biggest testing methodologies used today. It has several major advantages:

  1. Side effects of having the knowledge of the source code is beneficial to thorough testing.[3]
  2. Optimization of code by revealing hidden errors and being able to remove these possible defects.[3]
  3. Gives the programmer introspection because developers carefully describe any new implementation.[3]
  4. Provides traceability of tests from the source, allowing future changes to the software to be easily captured in changes to the tests.[4]
  5. White box tests are easy to automate.[5]
  6. White box testing give clear, engineering-based, rules for when to stop testing.[6][5]

Disadvantages

Although white-box testing has great advantages, it is not perfect and contains some disadvantages:

  1. White-box testing brings complexity to testing because the tester must have knowledge of the program, including being a programmer. White-box testing requires a programmer with a high-level of knowledge due to the complexity of the level of testing that needs to be done.[3]
  2. On some occasions, it is not realistic to be able to test every single existing condition of the application and some conditions will be untested.[3]
  3. The tests focus on the software as it exists, and missing functionality may not be discovered.

Modern view

A more modern view is that the dichotomy between white-box testing and black-box testing has blurred and is becoming less relevant. Whereas "white-box" originally meant using the source code, and black-box meant using requirements, tests are now derived from many documents at various levels of abstraction. The real point is that tests are usually designed from an abstract structure such as the input space, a graph, or logical predicates, and the question is what level of abstraction we derive that abstract structure from.[5] That can be the source code, requirements, input space descriptions, or one of dozens of types of design models. Therefore, the "white-box / black-box" distinction is less important and the terms are less relevant.

Hacking

In penetration testing, white-box testing refers to a methodology where a white hat hacker has full knowledge of the system being attacked. The goal of a white-box penetration test is to simulate a malicious insider who has knowledge of and possibly basic credentials for the target system.

See also

References

  1. ↑ 1.0 1.1 1.2 1.3 1.4 Williams, Laurie. "White-Box Testing" (PDF). pp. 60–61, 69. Retrieved 13 February 2013.
  2. ↑ 2.0 2.1 2.2 Ehmer Khan, Mohd (July 2011). "Different Approaches to White Box Testing Technique for Finding Errors" (PDF). International Journal of Software Engineering and Its Applications 5: 1–6. Retrieved 12 February 2013.
  3. ↑ 3.0 3.1 3.2 3.3 3.4 Ehmer Khan, Mohd (May 2010). "Different Forms of Software Testing Techniques for Finding Errors" (PDF). IJCSI International Journal of Computer Science Issues 7 (3): 12. Retrieved 12 February 2013.
  4. ↑ Binder, Bob (2000). Testing Object-oriented Systems. Addison-Wesley Publishing Company Inc.
  5. ↑ 5.0 5.1 5.2 Ammann, Paul; Offutt, Jeff (2008). Introduction to Software Testing. Cambridge University Press. ISBN 9780521880381.
  6. ↑ Myers, Glenford (1979). The Art of Software Testing. John Wiley and Sons.

External links