Discrete Distributions

Hey students! 👋 Welcome to one of the most fascinating topics in probability theory - discrete distributions! In this lesson, you'll discover how mathematicians model real-world random events that have countable outcomes, like coin flips, product defects, or customer arrivals. By the end, you'll master four essential discrete distributions and know exactly when and how to use them. Get ready to unlock the mathematical secrets behind everything from quality control in factories to predicting website traffic! 🎯

Understanding Discrete Distributions

Before we dive into specific types, let's understand what makes a distribution "discrete." students, imagine you're counting something - the number of heads in coin flips, defective items in a batch, or goals scored in a soccer match. These are all discrete because you can list out the possible values: 0, 1, 2, 3, and so on. You can't have 2.5 goals or 1.7 defective items!

A discrete probability distribution assigns probabilities to each possible outcome of a discrete random variable. Think of it as a recipe that tells us how likely each outcome is. The key rule is that all probabilities must add up to 1 - after all, something has to happen! 📊

These distributions are incredibly powerful tools. Netflix uses them to predict how many users will watch a new show, hospitals use them to forecast patient arrivals, and even video game developers use them to design fair loot boxes. The applications are endless!

The Bernoulli Distribution: The Foundation

Let's start with the simplest discrete distribution - the Bernoulli distribution, named after Swiss mathematician Jacob Bernoulli. students, this distribution models any experiment with exactly two outcomes: success or failure, yes or no, heads or tails.

The Bernoulli distribution is defined by a single parameter $p$, which represents the probability of success. If $X$ follows a Bernoulli distribution with parameter $p$, we write $X \sim \text{Bernoulli}(p)$.

The probability mass function is beautifully simple:

• $P(X = 1) = p$ (probability of success)
• $P(X = 0) = 1 - p$ (probability of failure)

Real-world example: Imagine you're a quality control inspector at a smartphone factory. Each phone you test either passes (success, $X = 1$) or fails (failure, $X = 0$). If historically 95% of phones pass inspection, then $p = 0.95$.

The expected value (mean) of a Bernoulli distribution is simply:

$$E(X) = p$$

This makes intuitive sense! If you flip a fair coin ($p = 0.5$) many times, you expect to get heads about half the time.

The variance measures how spread out the outcomes are:

$$\text{Var}(X) = p(1-p)$$

Notice something cool, students! The variance is maximized when $p = 0.5$ (giving $\text{Var}(X) = 0.25$) and minimized when $p$ is close to 0 or 1. This means fair coins are the most "unpredictable" in terms of variance! 🪙

The Binomial Distribution: Repeated Success

Now, what if we repeat our Bernoulli experiment multiple times? Enter the binomial distribution! If you perform $n$ independent Bernoulli trials, each with success probability $p$, the total number of successes follows a binomial distribution: $X \sim \text{Binomial}(n,p)$.

The probability of getting exactly $k$ successes in $n$ trials is:

$$P(X = k) = \binom{n}{k} p^k (1-p)^{n-k}$$

where $\binom{n}{k} = \frac{n!}{k!(n-k)!}$ is the binomial coefficient (combinations).

Real-world example: A pharmaceutical company tests a new drug on 20 patients. If the drug has a 70% success rate, what's the probability that exactly 15 patients recover? Here, $n = 20$, $p = 0.7$, and $k = 15$.

$$P(X = 15) = \binom{20}{15} (0.7)^{15} (0.3)^5 \approx 0.179$$

The expected value and variance for a binomial distribution are:

• $E(X) = np$
• $\text{Var}(X) = np(1-p)$

This makes perfect sense, students! If each trial has expected value $p$, then $n$ trials should have expected value $np$. In our drug example, we'd expect about $20 \times 0.7 = 14$ patients to recover.

The Geometric Distribution: Waiting for Success

Sometimes we're not interested in counting successes in a fixed number of trials. Instead, we want to know: "How long do I have to wait for my first success?" This is where the geometric distribution shines! ✨

If $X$ represents the number of trials needed to get the first success, then $X \sim \text{Geometric}(p)$, and:

$$P(X = k) = (1-p)^{k-1} p$$

Real-world example: You're a salesperson, and historically you close 20% of your calls. How likely is it that your first sale happens on the 5th call? Here, $p = 0.2$ and $k = 5$:

$$P(X = 5) = (0.8)^4 \times 0.2 = 0.08192$$

The expected value tells us the average waiting time:

$$E(X) = \frac{1}{p}$$

In our sales example, you'd expect your first sale after $\frac{1}{0.2} = 5$ calls on average. The variance is:

$$\text{Var}(X) = \frac{1-p}{p^2}$$

Here's a fascinating property, students: the geometric distribution is "memoryless." If you've already made 10 unsuccessful calls, the probability that your next call is successful is still $p$ - the past doesn't affect the future! 🔮

The Poisson Distribution: Rare Events

Our final distribution models rare events occurring in fixed intervals of time or space. Named after French mathematician Siméon Denis Poisson, this distribution is perfect for modeling arrivals, accidents, or defects when events happen independently at a constant average rate.

If events occur at an average rate of $\lambda$ per interval, then the number of events $X$ follows a Poisson distribution: $X \sim \text{Poisson}(\lambda)$.

The probability mass function is:

$$P(X = k) = \frac{\lambda^k e^{-\lambda}}{k!}$$

Real-world example: A hospital emergency room receives an average of 3 patients per hour during night shifts. What's the probability of receiving exactly 5 patients in the next hour?

$$P(X = 5) = \frac{3^5 e^{-3}}{5!} = \frac{243 \times 0.0498}{120} \approx 0.101$$

The beautiful symmetry of the Poisson distribution is that both the mean and variance equal $\lambda$:

• $E(X) = \lambda$
• $\text{Var}(X) = \lambda$

This distribution appears everywhere in nature and technology! Website clicks per minute, radioactive decay events, and even the number of chocolate chips in cookies can follow Poisson distributions. Companies like Amazon use it to predict server loads, while epidemiologists use it to model disease outbreaks. 🦠

Conclusion

students, you've just mastered four fundamental discrete distributions that form the backbone of probability theory! The Bernoulli models single yes/no events, the binomial counts successes in repeated trials, the geometric measures waiting times for first success, and the Poisson captures rare events in continuous time or space. Each has unique applications, from quality control and sales forecasting to medical research and web analytics. These mathematical tools help us quantify uncertainty and make informed decisions in an unpredictable world.

Study Notes

• Bernoulli Distribution: Models single trial with two outcomes

• Parameters: $p$ (success probability)
• $P(X = 1) = p$, $P(X = 0) = 1-p$
• $E(X) = p$, $\text{Var}(X) = p(1-p)$

• Binomial Distribution: Models number of successes in $n$ independent trials

• Parameters: $n$ (trials), $p$ (success probability)
• $P(X = k) = \binom{n}{k} p^k (1-p)^{n-k}$
• $E(X) = np$, $\text{Var}(X) = np(1-p)$

• Geometric Distribution: Models number of trials until first success

• Parameters: $p$ (success probability)
• $P(X = k) = (1-p)^{k-1} p$
• $E(X) = \frac{1}{p}$, $\text{Var}(X) = \frac{1-p}{p^2}$
• Memoryless property: past failures don't affect future success probability

• Poisson Distribution: Models rare events in fixed intervals

• Parameters: $\lambda$ (average rate)
• $P(X = k) = \frac{\lambda^k e^{-\lambda}}{k!}$
• $E(X) = \lambda$, $\text{Var}(X) = \lambda$

• Key Applications: Quality control, medical trials, sales forecasting, web analytics, emergency planning