Building the Testing Pipeline

时间:2021-12-06 21:37:57

This essay is a part of my knowledge sharing session slides which are shared for development and quality team. I want to share some contents here and hope that may trigger some brainstorming or thoughts about how could we do better test automation by development team in the software development cycle.

The related sessions:

Quick Index

Understanding tests better

Building the Testing Pipeline

Test Strategy

One of the key decisions is what kinds of tests should be automated and which approach to testing should be used for manual test.

Building the Testing Pipeline

Catch defect as quickly as possible

Building the Testing Pipeline

The V Model of Software Development

Building the Testing Pipeline

Unit Testing

Unit testing can be on little things like methods/functions or bigger things like modules and classes.

Building the Testing Pipeline

Component Testing

Component testing are used for testing packages, individual executables or subsystems.

Building the Testing Pipeline

System Testing

System testing is done at the level of the whole product and can include a range of system sizes:

individual systems or integrated workflows through multiple systems that have to interact.

Building the Testing Pipeline

Ideal Automated Testing Pyramid

Building the Testing Pipeline

Testing goes to fragile

Building the Testing Pipeline

Assembling a Test Pipeline

Building the Testing Pipeline

Continuous Integration

Building the Testing Pipeline

Defect Prevention before Defect Detection

The ultimate goal of any development process is to build the right product of high quality and to build it with minimum waste.

Defect Prevention techniques address how to prevent “error” before it is injected:

  • Root Cause Analysis of problem
  • Education and training
  • Software process maturity and improvement

Defect Detection techniques address how to find the faults:

  • Testing
  • Reviews and inspection
  • Formal verification

Cause-and-Effect Diagram for error prevention

Building the Testing Pipeline

References

  1. Unit Testing
  2. Build the Testing Pipeline
  3. Automating tests vs. Test Automation
  4. Gmail测试工程经理Ankit Mehta的访谈
  5. Patterns & Practices Acceptance Test Engineering Guide
  6. Continuous Integration is backed by several important principles and practices
  7. Continuous Integration
  8. What TDD Is and Is Not
  9. 7 Deadly Sins of Automated Software Testing
  10. How Is Automation Return-On-Investment (ROI) Calculated?
  11. Continuous Delivery in a nutshell
  12. Testing WPF Applications - TestComplete
  13. Continuous Delivery: Anatomy of the Deployment Pipeline
  14. Continuous integration is about keeping it all together
  15. YAGNI - You Aint Gonna Need It