Читать книгу Diversity and Inclusion Matters - Jason R. Thompson - Страница 33

Surveys and Their Limitations

Оглавление

Surveys are commonly used to support employee retention efforts. They are easy to administer and quickly yield data regarding employees' feelings on a myriad of subjects. Many companies frequently use this tool, but I would argue that the results are often an illusion, inaccurate, and not a good indication of how the company should move on important matters for underrepresented employees.

The biggest reason surveys are not helpful is that they are based on majority rule and that by definition is biased against underrepresented groups.

What company will change their approach or their culture based on a small percentage of responses? Nobody does that. But if you think about it, you can have several departments that have one Person of Color or one woman, and if nine people love whatever policy you are polling, and one person hates it, you won't change it because it looks like 90% of people like it.

If you have four People of Color and all of them say they hate the policy or are unhappy with the manager based on that person's behavior toward them, but the other six people are happy, you still have 60% of satisfied workers. There is also the question of trust. If you are the only African American in a department and you are treated poorly, you know it would be a risk to put that in an anonymous survey. If you don't trust your manager or leadership team, you won't be honest on a survey because any negative response will be attributed to you. No one will give honest answers if they feel their direct manager will know who gave them critical scores.

If the interpretation of the survey is always based on majority rule, when you have a few People of Color, or other marginalized groups, their voice through the survey is fundamentally minimized. To overcome bias, what most companies do is try to protect the anonymity of the respondents by taking extraordinary measures. So, let's look at the same example: We have ten employees. One person says they don't like the policy you are polling, that gives you one out of ten. That's 10%. But you can't use that data or share it with the leadership team because they would immediately know the respondent in question was a Person of Color, LGBTQ+, and so on. So, what do you do? One strategy many companies use is to combine their responses with another department, a larger department. So, let's combine, for example, marketing with accounting. Therefore, it helps keep the results anonymous. Seems like that would work, right? Wrong. The problem is, if you put them in with accounting, which has twenty employees including three People of Color who are all happy with the policy, you have the same problem. You've just taken somebody who was 10% of a group, put them in a larger group, and now their vote is only 3%. It's actually decreased in importance. You have less reason to do any actionable things, because, guess what, nobody makes changes in policy or procedures or work culture, if you have 97% approval. There's no reason to change, and the only way this process of combining departments works is if all the members of the underrepresented group have the same opinion or response in the survey.

Not only that, you've now confused the data because you put the one Person of Color in another department. So how do you know which manager to deal with? You don't, because you keep combining department results into bigger and bigger datasets. This makes it hard to train the right person because you've promised everybody that the survey is anonymous. Therefore, efforts to keep surveys anonymous make the responses from underrepresented employees less statistically significant. The minute you show up and say, People of Color are not happy, and there's only one Person of Color, everybody knows who it is. The only way you can address their concerns using surveys is to violate any promise of anonymity.

All three of these issues make survey data difficult to act on. Generally, if you say, “The survey shows that there's a problem in the accounting department,” the accounting manager's response will typically be: What is the issue? Who has a problem? Can I see the surveys? By and large, you can't answer those questions or share the surveys, so it makes it very difficult for you to effectively execute on initiatives related to survey responses. Additionally, the leader of the accounting department could rightly point out that 90% their department is happy. Once you share specifics about the 10% who are unhappy, any leader will quickly figure out who those people are, meaning the survey is no longer anonymous.

For these reasons, it is important to understand how surveys can actually work and why many times they can undermine your efforts. Employees often feel particularly frustrated by surveys. They think, I tell you every year what's wrong, and you do nothing about it. The reason you cannot do anything about it is because surveys are anonymous, which makes it difficult for you to present a real picture of the problem. This is why I don't recommend using surveys, because small groups of people will never have their concerns validated or changes made in order to improve employer/employee relations.

Diversity and Inclusion Matters

Подняться наверх