3. Discrete Random Variables

Expectation

Compute expected value and interpret it as long-run average; use linearity of expectation in varied problems.

Expectation

Hey students! šŸ‘‹ Welcome to one of the most exciting topics in probability and statistics - expectation! In this lesson, you'll discover what expected value really means and how it helps us predict long-run averages in everything from casino games to investment decisions. By the end of this lesson, you'll be able to compute expected values confidently and use the powerful tool called linearity of expectation to solve complex problems. Think of this as your mathematical crystal ball for understanding what happens "on average" in uncertain situations! šŸŽÆ

What is Expected Value?

Expected value, often written as E(X) or μ (mu), is essentially the long-run average of a random variable. Imagine you could repeat an experiment thousands of times - the expected value tells you what the average outcome would be. It's like having a mathematical time machine that shows you the future average! ā°

The formal definition is quite elegant: Expected value is the weighted average of all possible outcomes, where each outcome is weighted by its probability of occurring.

For a discrete random variable X with possible values x₁, xā‚‚, xā‚ƒ, ..., xā‚™ and corresponding probabilities P(X = x₁), P(X = xā‚‚), ..., P(X = xā‚™), the expected value is:

$$E(X) = x_1 \cdot P(X = x_1) + x_2 \cdot P(X = x_2) + ... + x_n \cdot P(X = x_n)$$

Or more compactly: $$E(X) = \sum_{i=1}^{n} x_i \cdot P(X = x_i)$$

Let's make this concrete with a simple example. Suppose you're playing a game where you roll a fair six-sided die. If you roll a 1 or 2, you lose $2. If you roll a 3, 4, or 5, you win $1. If you roll a 6, you win $5. What's your expected winnings per game?

First, let's identify the outcomes and probabilities:

  • Lose $2 (rolling 1 or 2): probability = 2/6 = 1/3
  • Win $1 (rolling 3, 4, or 5): probability = 3/6 = 1/2
  • Win $5 (rolling 6): probability = 1/6

Now we calculate: E(X) = (-$2)(1/3) + ($1)(1/2) + ($5)(1/6) = -$2/3 + $1/2 + $5/6 = $2/3 ā‰ˆ $0.67

This means that on average, you'd expect to win about 67 cents per game if you played this game many, many times! šŸ’°

Real-World Applications and Examples

Expected value isn't just a classroom concept - it's everywhere in the real world! Insurance companies use it to set premiums, investors use it to evaluate potential returns, and even your favorite streaming service uses it to decide which shows to produce.

Insurance Industry Example: Life insurance companies calculate expected payouts based on mortality tables. If a 25-year-old has a 0.001 probability of dying in the next year, and the insurance policy pays $100,000, the expected payout is $100,000 Ɨ 0.001 = $100. The insurance company charges more than this to cover costs and profit.

Investment Example: Suppose you're considering investing in a startup. There's a 10% chance it becomes hugely successful (you make $50,000), a 30% chance it does moderately well (you make $5,000), a 40% chance you break even ($0), and a 20% chance it fails completely (you lose $10,000).

The expected return is: E(X) = ($50,000)(0.10) + ($5,000)(0.30) + ($0)(0.40) + (-$10,000)(0.20) = $5,000 + $1,500 + $0 - $2,000 = $4,500

Lottery Reality Check: The Powerball lottery has odds of about 1 in 292 million of winning the jackpot. Even with a $100 million jackpot, your expected value for a $2 ticket is approximately $100,000,000 Ɨ (1/292,000,000) - $2 ā‰ˆ -$1.66. You expect to lose about $1.66 per ticket! šŸŽ«

Understanding Expected Value as Long-Run Average

Here's the crucial insight students needs to grasp: expected value doesn't tell you what will happen in any single trial, but rather what happens on average over many trials. This is called the Law of Large Numbers.

Think about flipping a fair coin. The expected value of heads (if we assign heads = 1, tails = 0) is E(X) = (1)(0.5) + (0)(0.5) = 0.5. This doesn't mean you'll get half a head in any single flip! It means that if you flip the coin 1,000 times, you'd expect about 500 heads.

Casino games perfectly illustrate this principle. In roulette, the house edge on most bets is about 5.26%. This means that for every $100 bet, the casino expects to keep about $5.26 on average. You might win big on any given spin, but over thousands of spins, the casino's profit approaches this expected value. That's how casinos stay profitable! šŸŽ°

Linearity of Expectation

Now comes one of the most powerful tools in probability: linearity of expectation. This property states that the expected value of a sum equals the sum of expected values, regardless of whether the random variables are independent!

Mathematically: $$E(X + Y) = E(X) + E(Y)$$

And more generally: $$E(aX + bY + c) = aE(X) + bE(Y) + c$$

where a, b, and c are constants.

This property is incredibly useful because it allows us to break complex problems into simpler parts. Let's see it in action!

Example: You're taking two tests tomorrow. Based on your preparation, you expect to score 85 on the math test and 78 on the history test. What's your expected total score?

Using linearity: E(Math + History) = E(Math) + E(History) = 85 + 78 = 163

More Complex Example: A restaurant owner wants to calculate expected daily revenue. She sells an average of 50 burgers at $12 each, 30 pizzas at $15 each, and 20 salads at $8 each. Using linearity:

E(Daily Revenue) = E(50 Ɨ $12) + E(30 Ɨ $15) + E(20 Ɨ $8) = 50 Ɨ $12 + 30 Ɨ $15 + 20 Ɨ $8 = $600 + $450 + $160 = $1,210

Advanced Applications of Linearity

Linearity of expectation becomes especially powerful in combinatorial problems. Consider this classic example:

The Coupon Collector Problem: A cereal company puts one of 10 different toys in each box. How many boxes do you expect to buy to collect all 10 toys?

This seems complicated, but linearity makes it manageable! We can break it down into stages:

  • Expected boxes to get the 1st new toy: 1 (since any toy is new)
  • Expected boxes to get the 2nd new toy: 10/9 (9 out of 10 toys are new)
  • Expected boxes to get the 3rd new toy: 10/8
  • And so on...

The total expected number is: $$E(X) = 1 + \frac{10}{9} + \frac{10}{8} + ... + \frac{10}{1} = 10(1 + \frac{1}{2} + \frac{1}{3} + ... + \frac{1}{10}) ā‰ˆ 29.3$$

So you'd expect to buy about 29 boxes to collect all 10 toys! šŸ“¦

Conclusion

Expected value is your mathematical compass for navigating uncertainty, students! It transforms complex probability scenarios into simple averages that help you make informed decisions. Remember that expected value represents the long-run average outcome, not what happens in any single trial. The linearity of expectation is your superpower for breaking down complicated problems into manageable pieces. Whether you're evaluating investments, understanding games of chance, or solving combinatorial puzzles, expected value gives you the tools to see through uncertainty and make mathematically sound decisions. Master this concept, and you'll have a valuable skill that applies far beyond the classroom! 🌟

Study Notes

• Expected Value Definition: E(X) = Ī£(x Ɨ P(x)) - the weighted average of all possible outcomes

• Expected Value Formula: $$E(X) = \sum_{i=1}^{n} x_i \cdot P(X = x_i)$$

• Long-Run Average: Expected value tells you what happens on average over many trials, not in any single trial

• Linearity of Expectation: E(X + Y) = E(X) + E(Y) regardless of independence

• General Linearity: E(aX + bY + c) = aE(X) + bE(Y) + c where a, b, c are constants

• Real-World Applications: Insurance premiums, investment analysis, casino house edge, business revenue forecasting

• Law of Large Numbers: As the number of trials increases, the actual average approaches the expected value

• Key Insight: Expected value helps make decisions under uncertainty by providing mathematical predictions of average outcomes

Practice Quiz

5 questions to test your understanding