Hostname: page-component-78c5997874-ndw9j Total loading time: 0 Render date: 2024-11-10T15:00:10.272Z Has data issue: false hasContentIssue false
  • English
  • Français

Validation of a Professionals’ Satisfaction Questionnaire with Electronic Medical Records (PSQ-EMR) in Psychiatry

Published online by Cambridge University Press:  24 April 2010

L. Boyer ,
K. Baumstarck-Barrau ,
R. Belzeaux ,
J.M. Azorin ,
J.M. Chabannes ,
D. Dassa ,
C. Lancon ,
J. Naudin ,
F. Poinso  and
M. Rufo
...Show all authors
L. Boyer*
Affiliation:
Department of Public Health, La Timone Hospital, Assistance publique–Hôpitaux de Marseille, 264, rue Saint-Pierre, 13005Marseille, France
K. Baumstarck-Barrau
Affiliation:
Department of Clinical Research, Assistance publique–Hôpitaux de Marseille, 13005Marseille, France
R. Belzeaux
Affiliation:
Department of Psychiatry, Sainte-Marguerite Hospital, Assistance publique–Hôpitaux de Marseille, 13009Marseille, France
J.M. Azorin
Affiliation:
Department of Psychiatry, Sainte-Marguerite Hospital, Assistance publique–Hôpitaux de Marseille, 13009Marseille, France
J.M. Chabannes
Affiliation:
Department of Psychiatry, La Conception Hospital, Assistance publique–Hôpitaux de Marseille, 13005Marseille, France
D. Dassa
Affiliation:
Department of Psychiatry, La Conception Hospital, Assistance publique–Hôpitaux de Marseille, 13005Marseille, France
C. Lancon
Affiliation:
Department of Psychiatry, Sainte-Marguerite Hospital, Assistance publique–Hôpitaux de Marseille, 13009Marseille, France
J. Naudin
Affiliation:
Department of Psychiatry, Sainte-Marguerite Hospital, Assistance publique–Hôpitaux de Marseille, 13009Marseille, France
F. Poinso
Affiliation:
Department of Psychiatry, Sainte-Marguerite Hospital, Assistance publique–Hôpitaux de Marseille, 13009Marseille, France
M. Rufo
Affiliation:
Department of Psychiatry, Sainte-Marguerite Hospital, Assistance publique–Hôpitaux de Marseille, 13009Marseille, France Department of Psychiatry, Salvator Hospital, Assistance publique–Hôpitaux de Marseille, 13009Marseille, France
J.C. Samuelian
Affiliation:
Department of Psychiatry, La Conception Hospital, Assistance publique–Hôpitaux de Marseille, 13005Marseille, France
A. Loundou
Affiliation:
Department of Clinical Research, Assistance publique–Hôpitaux de Marseille, 13005Marseille, France
M. Fieschi
Affiliation:
Department of Public Health, La Timone Hospital, Assistance publique–Hôpitaux de Marseille, 264, rue Saint-Pierre, 13005Marseille, France
P. Auquier
Affiliation:
Department of Public Health, EA3279 research unit, University hospital, Assistance publique–Hôpitaux de Marseille, 13005Marseille, France
*
⁎Corresponding author. Tel.: +06 86 93 62 76. E-mail address:laurent.boyer@ap-hm.fr(L. Boyer).
Get access

Abstract

Background

Electronic medical records (EMR) are currently being implemented in psychiatric hospitals throughout Europe. The perceptions of health care professionals can contribute important information that may predict their acceptance of and desired mode of use for EMR, thus guiding EMR implementation.

Aims

To develop a self-administered instrument designed to assess health care professionals’ satisfaction regarding EMR in a psychiatric hospital, based only on the professional point of view, according to the psychometric standards.

Methods

The development was supervised by a steering committee and undertaken by three standard steps. Item generation was derived from 115 face-to-face interviews with health care professionals in a French, public, psychiatric hospital. The item-reduction process resulted in a 25-item questionnaire. The validation process was based on construct validity, reliability and some aspects of external validity.

Results

The final version of the questionnaire contained 25 items that described five dimensions, leading to a global score. The factor structure accounted for 72% of the total variance. Internal consistency was satisfactory (item-internal consistency over 0.40 and Cronbach's alpha coefficients ranged from 0.86 to 0.95). The scalability was satisfactory with INFIT statistics inside an acceptable range. Scores of dimensions were strongly positively correlated with visual analogue scale scores (all p < 0.001). External validity showed statistical associations between scores and age, gender, seniority in psychiatry and ward type. Participation rate was 66%.

Conclusion

The availability of a reliable and valid questionnaire (professionals’ satisfaction questionnaire with electronic medical records [PSQ-EMR]) concerning health care professionals’ satisfaction regarding EMR in psychiatry, exclusively generated from interviews with health care professionals, enables legitimate feedback to be incorporated into EMR implementation in order to formulate a high-quality health care.

Keywords

Electronic medical recordInstrument validationUser satisfaction
Type
Original article
Information
European Psychiatry , Volume 26 , Issue 2 , March 2011 , pp. 78 - 84
Copyright
Copyright © Elsevier Masson SAS 2010

Access options

Get access to the full version of this content by using one of the access options below. (Log in options will check for institutional or personal access. Content may require purchase if you do not have access.)

References

Abate, M.A.Shumway, J.M.Jacknowitz, A.I.Use of two online services as drug information sources for health professionals. Methods Inf Med 1992; 31: 153–158Google ScholarPubMed
Adams, W.G.Mann, A.M.Bauchner, H.Use of an electronic medical record improves the quality of urban pediatric primary care. Pediatrics 2003; 111: 626–632CrossRefGoogle ScholarPubMed
Alquraini, H.Alhashem, A.M.Shah, M.A.Chowdhury, R.I.Factors influencing nurses’ attitudes towards the use of computerized health information systems in Kuwaiti hospitals. J Adv Nurs 2007; 57: 375–381CrossRefGoogle ScholarPubMed
Antoniotti, S.Baumstarck-Barrau, K.Simeoni, M.C.Sapin, C.Labarere, J.Gerbaud, L., et al.Validation of a French hospitalized patients’ satisfaction questionnaire: the QSH-45. Int J Qual Health Care 2009; 21: 243–252CrossRefGoogle ScholarPubMed
Appelbaum, P.S.Privacy in psychiatric treatment: threats and responses. Am J Psychiatry 2002; 159: 1809–1818CrossRefGoogle ScholarPubMed
Boyer, L.Francois, P.Doutre, E.Weil, G.Labarere, J.Perception and use of the results of patient satisfaction surveys by care providers in a French teaching hospital. Int J Qual Health Care 2006; 18: 359–364CrossRefGoogle Scholar
Boyer L, Renaud MH, Baumstarck-Barrau K, Fieschi M, Samuelian JC. Establishment of an electronic medical record in a psychiatric hospital: evolution of professionals’ perceptions. L’Encéphale 2009: doi:10.1016/j.encep.2009.05.004.CrossRefGoogle Scholar
Boyer L, Renaud MH, Limousin S, Henry JM, Caïetta P, Fieschi M, et al. Perception and use of an electronic medical record system by professionals of a public psychiatric hospital. L’Encéphale 2009;35:454–60.CrossRefGoogle Scholar
Britten, N.Qualitative interviews in medical research. BMJ 1995; 311: 251–253CrossRefGoogle ScholarPubMed
Campbell, D.T.Fiske, D.W.Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull 1959; 56: 81–105CrossRefGoogle ScholarPubMed
Carey, R.G.Seibert, J.H.A patient survey system to measure quality improvement: questionnaire reliability and validity. Med Care 1993; 31: 834–845CrossRefGoogle ScholarPubMed
Cork, R.D.Detmer, W.M.Friedman, C.P.Development and initial validation of an instrument to measure physicians’ use of, knowledge about, and attitudes toward computers. J Am Med Inform Assoc 1998; 5: 164–176CrossRefGoogle ScholarPubMed
Counte, M.A.Kjerulff, K.H.Salloway, J.C.Campbell, B.C.Adapting to the implementation of a medical information system: a comparison of short- versus long-term findings. J Med Syst 1987; 11: 11–20CrossRefGoogle ScholarPubMed
Crocker, L.Algina, J.Introduction to classical and modern test theory. New York: Holt, Rinehart and Winston: 1986Google Scholar
Crow, R.Gage, H.Hampson, S.Hart, J.Kimber, A.Storey, L., et al.The measurement of satisfaction with healthcare: implications for practice from a systematic review of the literature. Health Technol Assess 2002; 6: 1–244CrossRefGoogle ScholarPubMed
Cruz, M.Pincus, H.A.Research on the influence that communication in psychiatric encounters has on treatment. Psychiatr Serv 2002; 53: 1253–1265CrossRefGoogle ScholarPubMed
Delpierre, C.Cuzin, L.Fillaux, J.Alvarez, M.Massip, P.Lang, T.A systematic review of computer-based patient record systems and quality of care: more randomized clinical trials or a broader approach? Int J Qual Health Care 2004; 16: 407–416CrossRefGoogle ScholarPubMed
Etter, J.F.Perneger, T.V.Analysis of non-response bias in a mailed health survey. J Clin Epidemiol 1997; 50: 1123–1128CrossRefGoogle Scholar
Fischer, E.P.Marder, S.R.Smith, G.R.Owen, R.R.Rubenstein, L.Hedrick, S.C., et al.Quality enhancement research initiative in mental health. Med Care 2000; 38: I70–81CrossRefGoogle ScholarPubMed
Francois, P.Boyer, L.Weil, G.Implementation of quality management in medical departments of a teaching hospital: accelerators and inhibitors. Rev Epidemiol Sante Publique 2008; 56: S189–S195Google ScholarPubMed
Gadd, C.S.Penrod, L.E.Dichotomy between physicians’ and patients’ attitudes regarding EMR use during outpatient encounters. Proc AMIA Symp 2000; 275-279Google ScholarPubMed
Gadd, C.S.Penrod, L.E.Assessing physician attitudes regarding use of an outpatient EMR: a longitudinal, multi-practice study. Proc AMIA Symp 2001; 194-198Google ScholarPubMed
Hudson, T.J.Owen, R.R.Thrush, C.R.Armitage, T.L.Thapa, P.Guideline implementation and patient-tailoring strategies to improve medication adherence for schizophrenia. J Clin Psychiatry 2008; 69: 74–80CrossRefGoogle Scholar
Jha, A.K.DesRoches, C.M.Campbell, E.G.Donelan, K.Rao, S.R.Ferris, T.G., et al.Use of electronic health records in U.S. hospitals. N Engl J Med 2009; 360: 1628–1638CrossRefGoogle ScholarPubMed
Juniper, E.F.Guyatt, G.H.Mesbah, M.P.R.Quality of life and pharmacoeconomics in clinical trials. Philadelphia: Lippincott-Raven 1996Google Scholar
Kaiser, H.F.Caffrey, J.Alpha factor analysis. Psychometrika 1965; 30: 1–14CrossRefGoogle ScholarPubMed
Kjerulff, K.H.Counte, M.A.Salloway, J.C.Hospital employee satisfaction with a medical information system. J Health Hum Resour Adm 1988; 11: 141–158Google ScholarPubMed
Laerum, H.Ellingsen, G.Faxvaag, A.Doctors’ use of electronic medical records systems in hospitals: cross sectional survey. BMJ 2001; 323: 1344–1348CrossRefGoogle ScholarPubMed
Laerum, H.Karlsen, T.H.Faxvaag, A.Use of and attitudes to a hospital information system by medical secretaries, nurses and physicians deprived of the paper-based medical record: a case report. BMC Med Inform Decis Mak 4 2004; 18CrossRefGoogle ScholarPubMed
Lorenzi, N.M.Kouroubali, A.Detmer, D.E.Bloomrosen, M.How to successfully select and implement electronic health records (EHR) in small ambulatory practice settings. BMC Med Inform Decis Mak 9 2009; 15CrossRefGoogle ScholarPubMed
Nunnaly, J.C.Bernstein, I.C.Psychometric theory. New York: Mc Graw-Hill: 1994Google Scholar
Ong, C.Lai, J.Gender differences in perceptions and relationships among dominants of elearning acceptance. Comput Hum Behav 2004; 816-829Google Scholar
Otieno, O.G.Toyama, H.Asonuma, M.Kanai-Pak, M.Naitoh, K.Nurses’ views on the use, quality and user satisfaction with electronic medical records: questionnaire development. J Adv Nurs 2007; 60: 209–219CrossRefGoogle ScholarPubMed
Ovretveit, J.Scott, T.Rundall, T.G.Shortell, S.M.Brommels, M.Implementation of electronic medical records in hospitals: two case studies. Health Policy 2007; 84: 181–190CrossRefGoogle ScholarPubMed
Ovretveit, J.Scott, T.Rundall, T.G.Shortell, S.M.Brommels, M.Improving quality through effective implementation of information technology in healthcare. Int J Qual Health Care 2007; 19: 259–266CrossRefGoogle ScholarPubMed
Owen, R.R.Hudson, T.Thrush, C.Thapa, P.Armitage, T.Landes, R.D.The effectiveness of guideline implementation strategies on improving antipsychotic medication management for schizophrenia. Med Care 2008; 46: 686–691CrossRefGoogle Scholar
Owen, R.R.Thrush, C.R.Cannon, D.Sloan, K.L.Curran, G.Hudson, T., et al.Use of electronic medical record data for quality improvement in schizophrenia treatment. J Am Med Inform Assoc 2004; 11: 351–357CrossRefGoogle ScholarPubMed
Palm, J.M.Colombet, I.Sicotte, C.Degoulet, P.Determinants of user satisfaction with a clinical information system. AMIA Annu Symp Proc 2006; 614-618Google ScholarPubMed
Penrod, L.E.Gadd, C.S.Attitudes of academic-based and community-based physicians regarding EMR use during outpatient encounters. Proc AMIA Symp 2001; 528-532Google ScholarPubMed
Perneger, T.V.Chamot, E.Bovier, P.A.Non response bias in a survey of patient perceptions of hospital care. Med Care 2005; 43: 374–380CrossRefGoogle Scholar
Shiffman, R.N.Liaw, Y.Brandt, C.A.Corb, G.J.Computer-based guideline implementation systems: a systematic review of functionality and effectiveness. J Am Med Inform Assoc 1999; 6: 104–114CrossRefGoogle ScholarPubMed
Shortell, S.M.O’Brien, J.L.Carman, J.M.Foster, R.W.Hughes, E.F.Boerstler, H., et al.Assessing the impact of continuous quality improvement/total quality management: concept versus implementation. Health Serv Res 1995; 30: 377–401Google ScholarPubMed
Shumway, J.M.Jacknowitz, A.I.Abate, M.A.Analysis of physicians’, pharmacists’, and nurses’ attitudes toward the use of computers to access drug information. Methods Inf Med 1990; 29: 99–103Google ScholarPubMed
Verdoux, H.The current state of adult mental health care in France. Eur Arch Psychiatry Clin Neurosci 2007; 257: 64–70CrossRefGoogle ScholarPubMed
Wakefield, D.S.Halbesleben, J.R.Ward, M.M.Qiu, Q.Brokel, J.Crandall, D.Development of a measure of clinical information systems expectations and experiences. Med Care 2007; 45: 884–890CrossRefGoogle ScholarPubMed
Submit a response

Comments

No Comments have been published for this article.