TEST METRICS & TEST ESTIMATION

There are 2 types of Test Metrics:

1) RESULT METRICS:

    1.1) No. of Tc's executed

    1.2) No. of defects raised

    1.3) No. of defects closed

    1.4) No. of Test cases written

    1.5) Planned testing time

    1.6) Actual testing time

2) PREDICTIVE METRICS:

    2.1) Percent coverage of execution

    2.2) Fixed defect %

    2.3) Failed defect %

    2.4) Test case efficacy

    2.5) Defect Leakage

    2.6) Defect Reopen rate

    2.6) Defect Rejection rate

-------------------------------------------------------------------------------------------

Technique used for determining the metrics:

1)    ANALYZE METRICS

2)    COMMUNICATE TO THE CLIENT

3)    EVALUATION AND CONFIRMATION ON METRICS

4)    REPORTING ON BASIS OF CONFIRMED METRICS

-------------------------------------------------------------------------------------------

Categorization on below 2 types:

1) PROCESS METRICS

    1.1) Test case preparation productivity = No. of TC's / No. of Hrs.

    

    1.2) Test case design coverage = No. of req. mapped with testcases / No. of req. *100

    1.3) Test case execution productivity = No. of TC's executed / No. of Hrs.

    1.4) Test case execution coverage = Tot. TC's executed / Tot. TC's planned to execute *100

    1.5) Test case passed = TC passed / TC executed *100

    1.6) Test case failed = TC failed / TC executed *100

    1.7) Test case blocked = TC blocked / TC executed *100

2) PRODUCT METRICS

    2.1) Error discovery rate = Tot. defects found / Tot. TC's executed *100

    2.2) Defect fix rate = Defects reported as fix - Tot. defects reopened / Defects reported as fix + New defects encountered while retesting

    2.3) Defect Density = Tot. no. of defects / Tot. requirements

    2.4) Defect Leakage = Tot. UAT defects / Total SIT defects *100

    2.5) Defect Removal Efficiency :

    Tot. defects in pre delivery / Tot. defects in pre delivery + Tot. defects post delivery

    2.6) Defect Reopen Rate

    

    2.7) Defect Rejection Rate

-------------------------------------------------------------------------------------------

AGILE METRICS:

1) Velocity: We take average of user stories delivered in past sprints

Eg: AVG = 50 User stories / 5 Sprints = 10 user stories per sprint is the average

- Fluctuation should be monitored and on basis of that Upper bracket & Lower bracket should be       defined.

Eg: 40 % upper bracket i.e 140% & 15% lower bracket i.e 85%

2) Commitment Reliability: 

No. of user stories accepted / No of committed user stories per sprint *100

3) Capacity Utilization:

No. of committed hours / No. of available hours

4) Effort estimation variance:

Actual estimation/ Estimated estimation * 100

    4.1) Over estimation = (E-A*/E) * 100

    4.2) Under estimation = (A-E*/E) * 100

5) Scope Change : It calculates what scope are added or what are descoped from actual scope

6) Defect Leakage:

7) Backlog health: It compares Average velocity with user stories in product backlog.

-------------------------------------------------------------------------------------------

TEST ESTIMATION:

APPROACH:

1) Historical data of completed projects 

2) Organization Estimation model

3) Delphi method: Asking experts

4) WBS (Work Breakdown Structure)

5) Reference base approach (Using Fibonacci series )

6) T-shirt sizing 

7) 3 point estimation

Eg:

1) Envt. setup : 2 hrs

2) Writing Positive test cases: 100 user stories * 0.5(Half hour per user story on basis of how detailed is req.)

i.e 100*0.5 = 50 Hrs. 

Total=52 Hrs.

3) Writing Negative test cases: 10 Hrs.

Total: 62 Hrs.

4) Log defect: 20(Defects) * 0.25(Hrs.) =5 Hrs

Total: 67 Hrs.

5) Retesting: 25(Defects) * 0.25(Hrs.) = 6 Hrs.

Total: 73 Hrs.

6) Regression: 5 Hrs.

Total: 78 Hrs.

7) Triage calls: 2 Hrs.

Total: 80 Hrs.

8) Reporting: 5 Hrs.

Total: 85 Hrs.

9) Reserve: 10 Hrs.

Total: 95 Hrs.

-------------------------------------------------------------------------------------------

HECTOR MORALES EFFORT MATRIX:

-------------------------------------------------------------------------------------------

PlanITpoker: Online Scrum planning poker for Agile project teams

https://www.scrumpoker-online.org/

Agile Project Management Software - VivifyScrum