Lesson 2.4: Statistical Independence
Introduction
Welcome to Lesson 2.4 on Statistical Independence. In this lesson, you will explore the concept of statistical independence between two events. Understanding this concept is crucial in probability theory, as it allows you to determine how two events relate to each other with respect to their likelihood of occurring together.
Learning Objectives
By the end of this lesson, you will:
- Understand the formal condition for two events to be statistically independent.
- Be able to determine whether two events are independent given their probabilities or a two-way table.
- Distinguish between independence and mutual exclusivity.
- Test whether two events are statistically independent using the multiplication condition.
- Analyze a two-way table to decide whether two characteristics are independent.
What is Statistical Independence?
Statistical independence refers to a situation where the occurrence of one event does not affect the occurrence of another event. In simpler terms, two events A and B are statistically independent if the probability of their co-occurrence is equal to the product of their individual probabilities. This can be formally defined as:
$$P(A \cap B) = P(A) \cdot P(B)$$
Key Point: For independent events, knowing that one event has occurred does not provide any information about whether the other event will occur.
Example 1: Coin Tosses
Consider tossing a fair coin twice. Let event A be the outcome of the first toss resulting in heads, and event B be the outcome of the second toss resulting in heads. We can calculate:
- $P(A) = \frac{1}{2}$
- $P(B) = \frac{1}{2}$
- $P(A \cap B) = P(\text{Heads in first toss and Heads in second toss}) = \frac{1}{4}$
To check for independence, we examine:
$$P(A \cap B) = P(A) \cdot P(B)$$
$$\frac{1}{4} = \frac{1}{2} \cdot \frac{1}{2}$$
Since both sides of the equation are equal, we conclude that events A and B are independent.
Determining Independence from Given Probabilities
To determine if two events are independent, you can calculate their joint probability and compare it to the product of their individual probabilities. If they are equal, the events are independent.
Example 2: Dice Rolls
Let’s consider rolling a fair six-sided die. Let event C be rolling a 1 and event D be rolling a 2. The probabilities involved are:
- $P(C) = \frac{1}{6}$
- $P(D) = \frac{1}{6}$
- $P(C \cap D) = 0$ (because a single die cannot show both 1 and 2)
To check independence:
$$P(C \cap D) = P(C) \cdot P(D)$$
$$0 = \frac{1}{6} \cdot \frac{1}{6}$$
Since $0 \neq \frac{1}{36}$, events C and D are not independent; they are mutually exclusive events, meaning both cannot occur at the same time.
Independence vs. Mutual Exclusivity
It is essential to differentiate between independent events and mutually exclusive events. Two events are mutually exclusive if they cannot both occur together. If A and B are mutually exclusive, then:
$$P(A \cap B) = 0$$
If A and B are independent, then:
$$P(A \cap B) = P(A) \cdot P(B)$$
Therefore, if $P(A \cap B) = 0$, A and B cannot be independent unless at least one of them has a probability of zero.
Example 3: Drawing Cards
Consider a standard deck of 52 playing cards. Let event E be drawing a heart and event F be drawing a spade. Since no single card can be both a heart and a spade, events E and F are mutually exclusive. Thus, we see:
- $P(E) = \frac{13}{52} = \frac{1}{4}$
- $P(F) = \frac{13}{52} = \frac{1}{4}$
- $P(E \cap F) = 0$
This confirms that E and F are mutually exclusive. Since they cannot occur at the same time, they are not independent events.
Testing Independence Using the Multiplication Condition
A common method to test for independence is to verify the multiplication condition. If two events A and B satisfy the equation:
$$P(A \cap B) = P(A) \cdot P(B)$$
then A and B are independent.
Example 4: Survey on Preferences
Suppose a survey is conducted where:
- 30% of respondents like chocolate (event G)
- 40% like vanilla (event H)
- 10% like both flavors (event G $\cap$ H)
To check for independence, we compute:
- $P(G) = 0.3$
- $P(H) = 0.4$
- $P(G \cap H) = 0.1$
Now, let’s check:
$$P(G \cap H) ?= P(G) \cdot P(H)$$
$$0.1 ?= 0.3 \cdot 0.4$$
$$0.1 = 0.12$$
Since these probabilities are not equal ($0.1 \neq 0.12$), G and H are dependent events.
Independence in Two-Way Tables
A two-way table can help visualize the relationships between two events and determine if they are independent. Each cell in the table represents the frequency of occurrences of combinations of the two events.
Example 5: Two-Way Table of Preferences
Consider a two-way table showing survey responses regarding favorite fruits and whether respondents are students or not.
| Students | Non-Students | Total | |
|---|---|---|---|
| Apples | 20 | 30 | 50 |
| Bananas | 30 | 20 | 50 |
| Total | 50 | 50 | 100 |
To check for independence:
- Calculate the marginal probabilities:
- $P(\text{Students}) = \frac{50}{100} = 0.5$
- $P(\text{Non-Students}) = \frac{50}{100} = 0.5$
- Calculate joint probabilities:
- $P(\text{Apples and Students}) = \frac{20}{100} = 0.2$
- Apply the independence condition:
$$P(\text{Apples and Students}) = P(\text{Apples}) \cdot P(\text{Students})$$
$$0.2 = \left(\frac{50}{100}\right) \cdot \left(\frac{50}{100}\right) = 0.25$$
Since these are not equal, "Students" and "Apples" are not independent characteristics.
Conclusion
In summary, statistical independence plays a crucial role in probability theory. We learned that two events are independent if the probability of their intersection equals the product of their probabilities. We also distinguished between independence and mutual exclusivity, explored testing for independence using the multiplication condition, and practiced applying these concepts through two-way tables.
Understanding these concepts helps build a strong foundation in probability, allowing us to analyze complex scenarios effectively.
Study Notes
- Statistical independence means $P(A \cap B) = P(A) \cdot P(B)$.
- Mutually exclusive events cannot occur at the same time; if one occurs, the other cannot.
- Use a multiplication condition to test independence of events.
- A two-way table can be a useful tool for determining independence between two characteristics.