[Epic] Robust Testing Initiative

[QMalcolm]

Fixture Building+ Major Examples

Beta Give feedback

1. Create unit tests for SemanticManifest supported by a manifest fixture and utility builders #9665
   enhancement +1
   
2. Create Project fixture and unit test Project class #9870
   +0
   
3. Create Profile fixture and rewrite TestRuntimeConfig to use it #9984
   +0
4. Refactor TestRuntimeConfig to use Project fixture #9983
   +0
5. Write a unittest for get_full_manifest #9865
   +0
   
6. Write a unittest for partial parse #9866
   +0
   
7. Create a standard way to check events being fired in Unittest #9947
   +0
   
8. [SPIKE+] Make a plan for how to write a unittest for ModelRunner #9867
   Refinement +1
   
9. [CT-3111] [Tech debt] Create setup fixture for setting flags in unit tests #8627
   tech_debt +1
   
10. Create RuntimeConfig fixture and refactor the current test to use it #10000
    +0
    
11. An example unit test for GraphRunnableTask #10001
    +0
    
12. [SPIKE+] Write a unittest for a simple selection #9868
    +0
    

Parameterized Tests

Beta Give feedback

1. [SPIKE] Identify functional tests that should be parameterized #10181
   +0

Test Organization

Beta Give feedback

1. [Robust Testing] Reorganize tests to match source code #9961
   tech_debt +1
   

TODO

Beta Give feedback

1. Create DiGraph fixtured and unit test Graph Class #9871
   +0
2. Unit test GraphQueue class #9872
   Refinement +1
   
3. [Spike+] Investigate using pyfakefs to speed up testing #9885
   +0
4. [refactor] Seperate selection method to make it easier to test
5. Write a unittest for Task
6. Identify functional tests that should be unittest
7. [Spike] Investigate duplicate fixture in functional tests
8. [SPIKE] Can we use codecoverage to protect feature sets
9. Features that interacting with each other #10145
   +0