Lesson 12.2: Diagnostic Test Characteristics and Risk Measures

Introduction

Welcome to Lesson 12.2 of the USMLE Step 2 CK course, where we will explore Diagnostic Test Characteristics and Risk Measures. This lesson is designed to equip students with the necessary mathematical tools and concepts to analyze medical literature critically. Our objectives include understanding sensitivity, specificity, predictive values, likelihood ratios, relative risk, odds ratio, absolute risk reduction, and the number needed to treat. By the end of this lesson, students will be proficient in computing and interpreting diagnostic test characteristics while gaining insights into risk measures.

Understanding Diagnostic Test Characteristics

Sensitivity and Specificity

When assessing the efficacy of a diagnostic test, we begin with sensitivity and specificity.

1. Sensitivity: This measures the test's ability to correctly identify those with the disease. It is expressed as a percentage and calculated as:

$$\text{Sensitivity} = \frac{\text{True Positives}}{\text{True Positives} + \text{False Negatives}}$$

1. Specificity: This indicates the test's ability to correctly identify those without the disease. Like sensitivity, it is also expressed as a percentage:

$$\text{Specificity} = \frac{\text{True Negatives}}{\text{True Negatives} + \text{False Positives}}$$

Worked Example:

Suppose we have a population of 1,000 patients where:

• 100 patients have the disease (True Positives)
• 20 patients do not have the disease but test positive (False Positives)
• 80 patients with the disease were wrongly identified as Negative (False Negatives)
• 800 patients correctly test negative (True Negatives)

To find sensitivity:

$$\text{Sensitivity} = \frac{100}{100 + 80} \times 100 = \frac{100}{180} \times 100 \approx 55.56\%$$

To find specificity:

$$\text{Specificity} = \frac{800}{800 + 20} \times 100 = \frac{800}{820} \times 100 \approx 97.56\%$$

Predictive Values and Likelihood Ratios

Next, we explore predictive values and likelihood ratios which help interpret test results more effectively.

1. Positive Predictive Value (PPV): This indicates the probability that subjects with a positive test truly have the disease:

$$\text{PPV} = \frac{\text{True Positives}}{\text{True Positives} + \text{False Positives}}$$

1. Negative Predictive Value (NPV): This shows the probability that subjects with a negative test truly do not have the disease:

$$\text{NPV} = \frac{\text{True Negatives}}{\text{True Negatives} + \text{False Negatives}}$$

1. Likelihood Ratios:

• Positive Likelihood Ratio (PLR): This indicates how much more likely a positive test result is in those with the disease compared to those without. It is calculated as:

$$\text{PLR} = \frac{\text{Sensitivity}}{1 - \text{Specificity}}$$

• Negative Likelihood Ratio (NLR): Conversely, this indicates how much less likely a negative test result is for those with the disease versus those without:

$$\text{NLR} = \frac{1 - \text{Sensitivity}}{\text{Specificity}}$$

Worked Example:

Using the previous test results:

To find PPV:

$$\text{PPV} = \frac{100}{100 + 20} = \frac{100}{120} \approx 0.83 \; (or \; 83\%)$$

To find NPV:

$$\text{NPV} = \frac{800}{800 + 80} = \frac{800}{880} \approx 0.91 \; (or \; 91\%)$$

Next, calculating PLR and NLR:

$$\text{PLR} = \frac{0.5556}{1 - 0.9756} = \frac{0.5556}{0.0244} \approx 22.75$$

$$\text{NLR} = \frac{1 - 0.5556}{0.9756} = \frac{0.4444}{0.9756} \approx 0.456$$

Risk Measures in Epidemiology

Relative Risk and Odds Ratio

In epidemiological studies, relative risk and odds ratio are vital metrics that help quantify the strength of the association between exposure and outcomes.

1. Relative Risk (RR): This measures the probability of an event occurring in a treatment group compared to a control group:

$$\text{RR} = \frac{\text{Incidence in treated group}}{\text{Incidence in control group}}$$

1. Odds Ratio (OR): This compares the odds of an event occurring in the treatment group to the odds in the control group. It is calculated as:

$$\text{OR} = \frac{\text{Odds in treatment}}{\text{Odds in control}}$$

Worked Example:

Consider a study where:

• In a treatment group of 200 patients, 10 develop the disease (Incidence in treated group = 10/200 = 0.05)
• In a control group of 200 patients, 30 develop the disease (Incidence in control group = 30/200 = 0.15)

Calculating relative risk:

$$\text{RR} = \frac{0.05}{0.15} \approx 0.33$$

Calculating odds:

• Odds in treatment = $\frac{10}{190}$
• Odds in control = $\frac{30}{170}$

Calculating odds ratio:

$$\text{OR} = \frac{\frac{10}{190}}{\frac{30}{170}} = \frac{10 \times 170}{190 \times 30} \approx 0.30$$

Absolute Risk Reduction and Number Needed to Treat

1. Absolute Risk Reduction (ARR): This quantifies the absolute change in risk between two groups. It is defined as:

$$\text{ARR} = \text{Incidence in control} - \text{Incidence in treatment}$$

1. Number Needed to Treat (NNT): This represents the number of patients that need to be treated to prevent one additional adverse outcome:

$$\text{NNT} = \frac{1}{\text{ARR}}$$

Worked Example:

Using our previous findings:

$$\text{ARR} = 0.15 - 0.05 = 0.10$$

$$\text{NNT} = \frac{1}{0.10} = 10$$

Understanding Incidence and Prevalence

Relationship Between Incidence and Prevalence

1. Incidence refers to the number of new cases of a disease that occur in a specific population over a defined period. It is crucial for understanding the dynamics of disease spread.

1. Prevalence indicates the total number of existing cases of a disease in a population at a given time.

The relationship between incidence and prevalence can be illustrated as:

$$\text{Prevalence} = \text{Incidence} \times \text{Duration of disease}$$

Understanding this relationship helps ascertain how quickly a disease is spreading and its overall impact on a population.

Worked Example:

If the incidence of a disease is 0.01 cases per year and the average duration of the disease is 2 years, the prevalence at any point can be calculated as:

$$\text{Prevalence} = 0.01 \times 2 = 0.02 \; (or \; 2\%)$$

Conclusion

In this lesson, we extensively covered the diagnostic test characteristics of sensitivity, specificity, predictive values, and likelihood ratios. We then transitioned into risk measures such as relative risk, odds ratio, absolute risk reduction, and the number needed to treat, culminating in a discussion of incidence and prevalence. Understanding these concepts is vital in interpreting medical literature and making informed clinical decisions. students should now be equipped with the tools to analyze data and effectiveness critically.

Study Notes

• Sensitivity: $$\text{Sensitivity} = \frac{\text{True Positives}}{\text{True Positives} + \text{False Negatives}}$$
• Specificity: $$\text{Specificity} = \frac{\text{True Negatives}}{\text{True Negatives} + \text{False Positives}}$$
• Positive Predictive Value: $$\text{PPV} = \frac{\text{True Positives}}{\text{True Positives} + \text{False Positives}}$$
• Negative Predictive Value: $$\text{NPV} = \frac{\text{True Negatives}}{\text{True Negatives} + \text{False Negatives}}$$
• Positive Likelihood Ratio: $$\text{PLR} = \frac{\text{Sensitivity}}{1 - \text{Specificity}}$$
• Negative Likelihood Ratio: $$\text{NLR} = \frac{1 - \text{Sensitivity}}{\text{Specificity}}$$
• Relative Risk: $$\text{RR} = \frac{\text{Incidence in treated group}}{\text{Incidence in control group}}$$
• Odds Ratio: $$\text{OR} = \frac{\text{Odds in treatment}}{\text{Odds in control}}$$
• Absolute Risk Reduction: $$\text{ARR} = \text{Incidence in control} - \text{Incidence in treatment}$$
• Number Needed to Treat: $$\text{NNT} = \frac{1}{\text{ARR}}$$
• Relationship Between Incidence and Prevalence: $$\text{Prevalence} = \text{Incidence} \times \text{Duration of disease}$$