Hostname: page-component-cd9895bd7-gvvz8 Total loading time: 0 Render date: 2024-12-28T19:49:45.510Z Has data issue: false hasContentIssue false
  • English
  • Français

Identified Employee Surveys: Potential Promise, Perils, and Professional Practice Guidelines

Published online by Cambridge University Press:  07 January 2015

Lise M. Saari  and
Charles A. Scherbaum
Lise M. Saari*
Affiliation:
Baruch College and New York University
Charles A. Scherbaum
Affiliation:
Baruch College
*
E-mail: Lise.Saari@nyu.edu, Address: New York University, Department of Psychology, 6 Washington Place, New York, NY 10003
Get access Rights & Permissions [Opens in a new window]

Abstract

Over the years, employee opinion surveys have evolved in their use and how they are conducted. A major advancement has been the use of linkage analyses, whereby employee attitudes at a unit level are statistically related to other important organizational outcomes. A more recent development has been linkage analyses at the individual level and over time. In order to carry out these types of analyses, “identified surveys” must be used—surveys that retain identifying information on each survey respondent in order to link with other individual-level variables over time. The purpose of this article is to open up a discussion on identified surveys, describe under what circumstances they may be uniquely beneficial, and highlight potential concerns with them. We close with proposed guidelines for professional practice and recommend that our profession have a point of view on identified surveys for ourselves and to advise others.

Type
Focal Article
Information
Industrial and Organizational Psychology , Volume 4 , Issue 4 , December 2011 , pp. 435 - 448
Copyright
Copyright © Society for Industrial and Organizational Psychology 2011 

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

Footnotes

The authors greatly appreciate the comments of Allen Kraut, Karen Paul, Steven Rogelberg, Peter Rutigliano, Benjamin Schneider, Sara Weiner, and David Youssefnia on various stages of this manuscript.

The order of the authors is alphabetical but each author contributed equally.

References

American Association for Public Opinion. (2010). AAPOR Code of Professional Ethics & Practice. Retrieved from www.aapor.org/ethics.Google Scholar
American Psychological Association. (1992). Ethical principles of psychologists and code of conduct. Retrieved from www.apa.org/ethics/code.Google Scholar
Antón, A. I., Earp, J. B., & Young, J. D. (2010). How internet users' privacy concerns have evolved since 2002. IEEE Security and Privacy, 8, 21–27. Google Scholar
Belmont Report. (1979). Ethical principles and guidelines for the protection of human subjects of research. Washington, DC: Government Printing Office. Google Scholar
Bowling, A. (2005). Mode of questionnaire administration can have serious effects on data quality. Journal of Public Health, 27, 281–291. Google Scholar
Cascio, W., & Boudreau, J. (2008). Investing in people. Upper Saddle Ridge, NJ: FT Press. Google Scholar
Cho, H., & LaRose, R. (1999). Privacy issues in internet surveys. Social Science Computer Review, 17, 421–434. Google Scholar
Church, A. H., & Waclawski, J. (1998). Designing and using organizational surveys. San Francisco, CA: Jossey-Bass. Google Scholar
Cook, C., Heath, F., & Thompson, R. L. (2000). A meta-analysis of response rates in web- or internet-based surveys. Educational and Psychological Measurement, 60, 821–836. Google Scholar
Council of American Survey Research Organizations. (2011). Code of standards and ethics for survey research. Retrieved from www.casro.org.Google Scholar
Davenport, T., Harris, J., & Morison, R. (2010). Analytics at work. Boston, MA: Harvard Business Press. Google Scholar
Dunnette, M. D., & Heneman, H. G. (1956). Influence of scale administrator on employee attitude responses. Journal of Applied Psychology, 40, 73–77. Google Scholar
Durant, L. E., Carey, M. P., & Schroder, K. E. (2002). Effects of anonymity, gender, and erotophilia on the quality of data obtained on socially sensitive behavior. Journal of Behavioral Medicine, 25, 438–467. Google Scholar
Fenlason, K. J., & Suckow-Zimberg, K. (2006). Online surveys: Critical issues in using the web to conduct surveys. In Kraut, A. I. (Ed.), Getting action from organizational surveys (pp. 183–212). San Francisco, CA: Jossey-Bass. Google Scholar
Fogel, J., & Nehmad, E. (2009). Internet social network communities: Risk taking, trust, and privacy concerns. Computers in Human Behavior, 25, 153–160. Google Scholar
Graeff, T. R., & Harmon, S. (2002). Collecting and using personal data: Consumers' awareness and concerns. Journal of Consumer Marketing, 19, 302–318. Google Scholar
Groves, R. M. (2004). Survey methodology. New York, NY: Wiley. Google Scholar
Harter, J. K., & Schmidt, F. L. (2006). Connecting employee satisfaction to business unit performance. In Kraut, A. I. (Ed.), Getting action from organizational surveys (pp. 33–52). San Francisco, CA: Jossey-Bass. Google Scholar
Harter, J. K., Schmidt, F. L., & Hayes, T. L. (2002). Business-unit-level relationship between employee satisfaction, employee engagement, and business outcomes: A meta-analysis. Journal of Applied Psychology, 87, 268–279. Google Scholar
Heerwegh, D., Vanhove, T., Matthijs, K., & Loosveldt, G. (2005). The effect of personalization on response rates and data quality in web surveys. International Journal of Social Research Methodology, 8, 85–99. Google Scholar
James, L. R. (1982). Aggregation bias in estimates of perceptual agreement. Journal of Applied Psychology, 67, 219–229. Google Scholar
Joinson, A. (2001). Self-disclosure in computer-mediated communication: The role of self-awareness and visual anonymity. European Journal of Social Psychology, 31, 177–192. Google Scholar
Kantor, J. (1991). The effects of computer administration and identification on the Job Descriptive Index. Journal of Business and Psychology, 75, 309–323. Google Scholar
Kraut, A. I. (Ed.). (2006). Getting action from organizational surveys. San Francisco, CA: Jossey-Bass. Google Scholar
Kraut, A. I., & Saari, L. M. (1999). Organization surveys: Coming of age for a new era. In Kraut, A. I. & Korman, A. K. (Eds.), Evolving practices in human resource management: Responses to a changing world of work (pp. 302–327). San Francisco, CA: Jossey-Bass. Google Scholar
Lowman, R. L. (Ed.). (2006). The ethical practice of psychology in organizations (2nd ed.). Washington, DC: American Psychological Association & Society for Industrial and Organizational Psychology. Google Scholar
Madden, M., & Smith, A. (2010). Reputation management and social identity. Washington, DC: Pew Internet and American Life Project. Google Scholar
Mertler, C. A. (2003). Patterns of response and nonresponse from teachers to traditional and web surveys. Practical Assessment, Research & Evaluation, 8(22). Retrieved from http://www.pareonline.net/getvn.asp?v=8&n=22.Google Scholar
Mitchell, T. R., & James, L. R. (2001). Building better theory: Time and the specification of when things happen. Academy of Management Review, 26, 530–547. Google Scholar
Ostroff, C. (1992). The relationship between satisfaction, attitudes, and performance: An organizational level analysis. Journal of Applied Psychology, 77, 963–974. Google Scholar
Ployhart, R. E., Weekley, J. A., & Ramsey, J. (2009). The consequences of human resource stocks and flows: A longitudinal examination of unit service orientation and unit effectiveness. Academy of Management Journal, 52, 996–1015.Google Scholar
Postmes, T., & Spears, R. (1998). Deindividuation and anti-normative behavior: A meta-analysis. Psychological Bulletin, 123, 238–259. Google Scholar
Postmes, T., Spears, R., & Lea, M. (1998). Breaching or building social boundaries?: Side-effects of computer-mediated communication. Communication Research, 25, 689–715. Google Scholar
Pulakos, E. (2009). Performance management: A new approach for driving business results. Malden, MA: Wiley-Blackwell. Google Scholar
Reicher, S., Spears, R., & Postmes, T. (1995a). A social identity model of deindividuation phenomena. In Stroebe, W. & Hewstone, M. (Eds.), European review of social psychology (Vol. 6, pp. 161–198). Chichester, UK: Wiley. Google Scholar
Reicher, S. G., Spears, R., & Postmes, T. (1995b). A social identity model of deindividuation phenomena. European Review of Social Psychology, 6, 161–198. Google Scholar
Reynolds, D. (2010). A primer on privacy: What every I–O psychologist needs to know about data protection. The Industrial and Organizational Psychologist, 48(2), 27–32. Google Scholar
Richman, W. L., Kiesler, S., Weisband, S., & Drasgow, F. (1999). A meta-analytic study of social desirability distortion in computer administered questionnaires, traditional questionnaires, and interviews. Journal of Applied Psychology, 84, 754–775. Google Scholar
Rogelberg, S. G. (2006). Understanding nonresponse and facilitating response to organizational surveys. In Kraut, A. I. (Ed.), Getting action from organizational surveys (pp. 312–325). San Francisco, CA: Jossey-Bass. Google Scholar
Rogelberg, S. G., Spitzmüller, C., Little, I. S., & Reeve, C. L. (2006). Understanding response behavior to an online special topics organizational satisfaction survey. Personnel Psychology, 59, 903–923. Google Scholar
Rogelberg, S. G., & Stanton, J. M. (2007). Understanding and dealing with organizational survey nonresponse. Organizational Research Methods, 1, 195–209. Google Scholar
Rosenfeld, P., Booth-Kewley, S., Edwards, J., & Thomas, M. (1996). Responses on computer surveys: Impression management, social desirability, and the big brother syndrome. Computers in Human Behavior, 12, 263–274. Google Scholar
Rucci, A. J., Kirn, S. P., & Quinn, R. T. (1998). The employee-customer-profit chain at Sears. Harvard Business Review, 76, 82–97. Google Scholar
Saari, L. M., Scherbaum, C. A., Paul, K. B., Halamaj, J., Dawson, J. F., & DelDuco, S. (2010, April). Identified employee surveys: Pros, cons, what we know/don't know. Panel discussion at the 25th Annual Conference of the Society for Industrial and Organizational Psychology, Atlanta, GA.Google Scholar
Sashkin, M., & Prien, E. (1996). Ethical concerns and organizational surveys. In Kraut, A. I. (Ed.), Organizational surveys: Tools for assessment and change (pp. 381–403). San Francisco, CA: Jossey-Bass. Google Scholar
Schneider, B., Ashworth, S. D., Higgs, A. C., & Carr, L. (1996). Design, validity, and use of strategically focused employee attitude surveys. Personnel Psychology, 49, 685–705. Google Scholar
Schneider, B., & Bowen, D. E. (1985). Employee and customer perceptions of service in banks: Replication and extension. Journal of Applied Psychology, 83, 150–163. Google Scholar
Schneider, B., Macey, W. H., Lee, W. C., & Young, S. A. (2009). Organizational service climate drivers of the American Customer Service Index and financial and market performance. Journal of Service Research, 12, 3–14. Google Scholar
Singer, E., Mathiowetz, N. A., & Couper, M. P. (1993). The impact of privacy and confidentiality concerns on survey participation: The case of the 1990 U.S. census. Public Opinion Quarterly, 57, 465–482. Google Scholar
Singer, E., Van Hoewyk, J., & Neugebauer, R. (2003). Attitudes and behavior: The impact of privacy and confidentiality concerns on participation in the 2000 census. Public Opinion Quarterly, 65, 368–384. Google Scholar
Spears, R., & Lea, M. (1994). Panacea or panopticon? The hidden power in computer-mediated communication. Communication Research, 21, 427–459. Google Scholar
Stanton, J. (1998). An empirical assessment of data collection using the internet. Personnel Psychology, 51, 709–725. Google Scholar
Thompson, L. F., & Surface, E. A. (2007). Employee surveys administered online: Attitudes toward the medium, nonresponse, and data representativeness. Organizational Research Methods, 10, 241–261. Google Scholar
Thompson, L. F., Surface, E. A., Martin, D. L., & Sanders, M. G. (2003). From paper to pixels: Moving personnel surveys to the web. Personnel Psychology, 56, 197–227. Google Scholar
Tourangeau, R., & Yan, T. (2007). Sensitive questions in surveys. Psychological Bulletin, 133, 859–883. Google Scholar
Turner, C. F., Ku, L., Rogers, S. M., Lindberg, L. D., Pleck, J. H., & Sonenstein, F. L. (1998). Adolescent sexual behavior, drug use, and violence: Increased reporting with computer survey technology. Science, 280, 867–873. Google Scholar
Wiley, J., & Campbell, B. (2006). Using linkage research to drive high performance: A case study in organization development. In Kraut, A. I. (Ed.), Getting action from organizational surveys (pp. 312–325). San Francisco, CA: Jossey-Bass. Google Scholar