Читать книгу Social Psychology - Daniel W. Barrett - Страница 159
Doing Research: Questioning Self-Reports And Surveys
ОглавлениеThe most commonly used method for obtaining data in social psychology is the self-report, which is an individual’s conscious response to a question or situation. A direct question asking about your attitude toward your college is a self-report. Self-reports are often accurate and can be very useful, particularly when the information sought is noncontroversial and the respondent is unlikely to wish to hide his answers from the researcher. For example, self-reported gender is likely to be accurate, whereas attitudes toward members of another race is less likely to be. Researchers use self-reports to obtain a variety of data, including people’s opinions, feelings, behaviors, and physiological experiences (e.g., hunger or pain). Three advantages of self-report measures are that they are relatively easy to construct, are inexpensive, and can be utilized in a variety of research methods, including surveys, interviews, and many experiments.
There are also several disadvantages to using self-reports, whether in surveys, interviews, or experiments. One is that self-reports may not always provide accurate information, either as a result of participant psychology or the construction of the questions (Krosnick, Lavarakas, & Kim, 2014; Schwarz, 2007b). Researchers have extensively investigated the psychology of self-reports and have identified a number of undesirable response effects that can undermine the accuracy of the answers. Response effects are unintended variations in question responses that stem from procedural aspects or features of the survey instrument, such as the wording of a question or the order of the questions (Heintzelman, Trent, & King, 2015; Helmes, Holden, & Ziegler, 2015; Schwarz, 1999; Tourangeau, Rips, & Rasinski, 2000). These survey features may affect how participants understand questions, the role of memory and judgment in generating potential responses, and how participants report their answers (Schwarz, 1999, 2007a; Tourangeau et al., 2000).
One response effect is the acquiescence bias, which is the tendency to agree with or say “yes” to questions (Savalei & Falk, 2014). This is of particular concern when conducting cross-cultural research, because clear culture-based differences have been found (Riemer & Shavitt, 2011). For instance, East Asians are more likely to agree with questions than are certain other groups (Grimm & Church, 1999). Another type of response effect is the extremity bias, wherein respondents provide answers that are at the extremes of the response options (Levashina, Weekley, Roulin, & Hauck, 2014). For instance, on a scale ranging from “very unlikely” to “very likely,” a person exhibiting this bias will tend to chose one of the endpoints of the scale rather than the more moderate options, such as “likely” or “unlikely.” As with the acquiescence bias, the extremity bias varies across cultures: African Americans and Hispanics are more likely to demonstrate extreme responding than European Americans, whereas East Asians are less likely (Bachman & O’Malley, 1984; Chen, Lee, & Stevenson, 1995; Hui & Triandis, 1989). Question wording can also bias or distort the answers (Schwarz, 2007a). A recent example is a survey reported in the New York Times in which 20% of respondents said that the U.S. government spent too little on “welfare,” but 65% indicated that it spent too little on “assistance to the poor” (See Figure 4.3) (Schneiderman, 2008).
Another response bias may result from the context in which the question is asked. For instance, participants in one study provided different explanations for a mass murder depending on whether the letterhead at the top of the survey was a fictional “Institute for Social Research” or “Institute for Personality Research.” In the “social” condition respondents tended to focus on external or environmental causes, in contrast to the internal or personality factors emphasized in the “personality” condition (Norenzayan & Schwarz, 1999). Such context effects—variations in responding because of survey features encountered prior to answering a question—are also seen when the presence or wording of earlier questions alters responses to later ones (Schwarz, 1999; Toepoel & Couper, 2011; Weijters, Geuens, & Baumgartner, 2013). Researchers need to consider these biases when designing surveys and other self-reports (Schwarz, 1999, 2007a). One additional weakness in self-reports was discussed above: We often do not know how we know what we know; that is, we cannot report on many of our mental processes, even if we can report on the outcome (Nisbett & Wilson, 1977).
Figure 4.3 Do Americans Still Hate Welfare? Depends on How You Ask
Source: Reported in Schneiderman, R. M. (2008, October 30). Do Americans still hate welfare. The New York Times.
Surveys are questionnaires that consist entirely of self-report items that can be administered on paper, computer, online, or during interviews. Survey research has several advantages over other strategies: It is relatively inexpensive, questionnaires are fairly easy to construct and implement, and they can be administered to large numbers of people quickly. As a result, surveys are widely used in social psychological research.
Unfortunately, there are several disadvantages that may outweigh the benefits of doing survey research. The first is that it does not allow for the manipulation of variables that is at the core of experimental research (discussed in Chapter 1). As a consequence, survey findings are only correlational and cannot be used to establish causal relations among variables. Second, there are many social psychological phenomena that cannot be studied using the survey method. For instance, asking people to imagine being in a particular situation—say, in a group of people of a different race—may not replicate the effects of actually being in that group. Finally, the utility of survey research depends upon the sample of individuals who participate in it—responses from Caucasian college students in Boston may not reflect those from Argentinians in Buenos Aires.
Self-Report: Individual’s conscious response to a question or situation
Response Effects: Unintended variations in question responses that stem from procedural aspects or features of the survey instrument, such as the wording of a question or the order of the questions
Acquiescence Bias: Tendency to agree with or say “yes” to questions
Extremity Bias: Tendency to provide answers that are at the extremes of the response options
Context Effects: Variations in responding because of survey features encountered prior to answering a question
Surveys: Questionnaires that consist entirely of self-report items that can be administered on paper, computer, online, or in interviews