Читать книгу Applied Regression Modeling - Iain Pardoe - Страница 17

1.3 Selecting Individuals at Random—Probability

Оглавление

Having assessed the normality of our population of sale prices by looking at the histogram and QQ‐plot of sample sale prices, we now return to the task of making probability statements about the population. The crucial question at this point is whether the sample data are representative of the population for which we wish to make statistical inferences. One way to increase the chance of this being true is to select the sample values from the population at random—we discussed this in the context of our home prices example in Section 1.1. We can then make reliable statistical inferences about the population by considering properties of a model fit to the sample data—provided the model fits reasonably well.

We saw in Section 1.2 that a normal distribution model fits the home prices example reasonably well. However, we can see from Figure 1.1 that a standard normal distribution is inappropriate here, because a standard normal distribution has a mean of 0 and a standard deviation of 1, whereas our sample data have a mean of 278.6033 and a standard deviation of 53.8656. We therefore need to consider more general normal distributions with a mean that can take any value and a standard deviation that can take any positive value (standard deviations cannot be negative).

Let represent the population values (sale prices in our example) and suppose that is normally distributed with mean (or expected value), , and standard deviation, . This textbook uses this notation with familiar Roman letters in place of the traditional Greek letters, (mu) and (sigma), which, in the author's experience, are unfamiliar and awkward for many students. We can abbreviate this normal distribution as , where the first number is the mean and the second number is the square of the standard deviation (also known as the variance). Then the population standardized ‐value,


has a standard normal distribution with mean 0 and standard deviation 1. In symbols,


We are now ready to make a probability statement for the home prices example. Suppose that we would consider a home as being too expensive to buy if its sale price is higher than . What is the probability of finding such an expensive home in our housing market? In other words, if we were to randomly select one home from the population of all homes, what is the probability that it has a sale price higher than ? To answer this question, we need to make a number of assumptions. We have already decided that it is probably safe to assume that the population of sale prices () could be normal, but we do not know the mean, , or the standard deviation, , of the population of home prices. For now, let us assume that and (fairly close to the sample mean of 278.6033 and sample standard deviation of 53.8656). (We will be able to relax these assumptions later in this chapter.) From the theoretical result above, has a standard normal distribution with mean 0 and standard deviation 1.

Next, to find the probability that a randomly selected is greater than 380, we perform some standard algebra on probability statements. In particular, if we write “the probability that is bigger than ” as “,” then we can make changes to (such as adding, subtracting, multiplying, and dividing other quantities) as long as we do the same thing to . It is perhaps easier to see how this works by example:


The second equality follows since is defined to be , which is a standard normal random variable with mean 0 and standard deviation 1. From the normal table in Section 1.2, the probability that a standard normal random variable is greater than 1.96 is 0.025. Thus, Pr() is slightly less than 0.025 (draw a picture of a normal density curve with 1.96 and 2.00 marked on the horizontal axis to convince yourself of this fact). In other words, there is slightly less than a 2.5% chance of finding an expensive home () in our housing market, under the assumption that .

For further practice of this kind of calculation, suppose that we have a budget of . What is the probability of finding such an affordable home in our housing market? (You should find it is slightly less than a 10% chance; see Problem 1.10.)

We can also turn these calculations around. For example, which value of has a probability of 0.025 to the right of it? To answer this, consider the following calculation:


So, the value 378 has a probability of 0.025 to the right of it. Another way of expressing this is that “the 97.5th percentile of the variable is .”

Applied Regression Modeling

Подняться наверх