Hostname: page-component-cd9895bd7-hc48f Total loading time: 0 Render date: 2024-12-26T03:28:51.121Z Has data issue: false hasContentIssue false

Perceived support and psychological outcome following the 2004 tsunami: a mixed-methods study

Published online by Cambridge University Press:  02 January 2018

Jonathan I. Bisson*
Affiliation:
Cardiff University School of Medicine Cardiff and Vale University Health Board
Catrin Lewis
Affiliation:
Cardiff University
Michael Howlett
Affiliation:
Zito Trust
Daniela Corallo
Affiliation:
National Audit Office
Ellen Davies
Affiliation:
Cardiff and Vale University Health Board
Vivien Norris
Affiliation:
Powys Local Health Board
*
Jonathan I. Bisson (bissonji@cf.ac.uk)
Rights & Permissions [Opens in a new window]

Abstract

Aims and method

The effectiveness of official support provided following a disaster has not been fully evaluated. This study aimed to ascertain whether there was an association between perceived support shortly after the 2004 Indian Ocean tsunami and later mental health symptoms in those affected, and to explore the factors associated with this. A survey, semi-structured interviews and focus group were used to explore the experiences and perceptions of 116 individuals severely affected by the tsunami.

Results

Agency or official support was perceived as poor overall. Perceived ineffectiveness of support available within a few days after the tsunami was associated with increased symptoms of post-traumatic stress disorder 15–19 months later. The strongest themes that emerged from our study were that support provided in a humane manner was perceived as effective and that uncoordinated support, poor communication and limited accessibility to support and information were perceived as ineffective.

Clinical implications

Improved planning of coordinated, flexible, multi-agency responses to traumatic events before they occur is required.

Type
Original Papers
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution (CC-BY) license (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
Copyright © Royal College of Psychiatrists, 2011

Natural disasters affect individuals in various ways. The physical, social and psychological demands can be overwhelming and are often accompanied by loss of resources that impairs the ability of individuals and communities to function optimally and deal with the effects of them. Reference Hobfoll, Watson, Bell, Bryant, Brymer and Friedman1 Natural disasters can precipitate specific psychological sequelae, including post-traumatic stress disorder (PTSD), not only in those directly involved, but also in relatives and friends who become aware that a loved one is missing. 2,Reference Galea, Nandi and Vlahov3

Systematic reviews have demonstrated good evidence that perceived lack of social support is associated with the development of PTSD. Reference Brewin, Andrews and Valentine4,Reference Ozer, Best, Lipsey and Weiss5 This and the apparent ineffectiveness of routine structured psychological interventions, such as single-session individual psychological debriefing or trauma-focused cognitive-behavioural therapy (CBT) for everyone involved in traumatic events, Reference Rose, Bisson, Churchill and Wessely6-8 has resulted in the recommendation that initial support is primarily practical and pragmatic, and delivered in a sympathetic manner by non-mental health professionals. 8 Trauma-focused CBT has been shown to be effective for individuals who develop severe early symptoms or symptoms that do not resolve over a period of weeks to months Reference Bryant, Sackville, Dang, Moulds and Guthrie9,Reference Ehlers, Clark, Hackmann, McManus, Fennell and Herbert10 and should be reserved for such individuals.

Social support is difficult to define precisely but can be considered a significant resource for individuals and family members encountering stress. It has been argued that early and mid-term interventions should promote a sense of safety, calming, sense of self- and community efficacy, connectedness and hope. Reference Hobfoll, Watson, Bell, Bryant, Brymer and Friedman1 The Inter-Agency Standing Committee (IASC), formed by the heads of a broad range of United Nations (UN) and non-UN humanitarian organisations, produced guidelines on mental health and psychosocial support in emergency settings 11 in which they described a pyramid of interventions based on the specific needs of individuals and communities. Everyone would receive varying levels of basic support and security, a smaller number would receive more specific community and family support, and a still smaller number would receive focused non-specialised support, with specialised services being mobilised for the minority who continue to have unmet needs. Official agencies have a major role in the provision of social support shortly after natural disasters. Previous studies have not, however, focused on the influence of this form of support on later traumatic stress symptoms. This is a mixed-methods study to describe the impact of support provided by official organisations in the aftermath of a disaster.

On the morning of 26 December 2004 an undersea earthquake measuring 9.3 on the Richter scale occurred near the Indonesian island of Sumatra. The earthquake triggered a series of devastating tsunamis that spread throughout the Indian Ocean hitting the coasts of 13 neighbouring countries including parts of Thailand, Indonesia, Sri Lanka and India. As many as 230 000 people lost their lives. Approximately 10 000 British citizens were in the affected area at the time the tsunami struck. It is believed that 151 were killed and many others injured. Many more were affected indirectly by having had loved ones in one of the affected areas.

In 2005 the National Audit Office commissioned the Zito Trust to assess the views and experiences of support offered by government departments and agencies to UK citizens directly affected by the tsunami. The National Audit Office report was published in November 2006. 12 This study aimed to ascertain whether there was an association between perceived support shortly after the tsunami and later mental health symptoms, and to explore the factors associated with positive and negative perceptions of social support. We hypothesised that there would be a relationship between perceived poor support and later mental health symptoms.

Method

A qualitative and quantitative approach to data gathering was adopted, with questionnaires, semi-structured interviews and a focus group. The study used a sequential explanatory design, whereby qualitative data were gathered to explore and explain the quantitative results.

Participants

We invited 290 people to take part in the study. The majority of these individuals attended a memorial service in London and were among the most severely affected by the tsunami. Of those contacted, 116 completed the survey (40%); 66 were in the affected areas at the time of the tsunami (57%) and 50 were in the UK or elsewhere in the world (43%). The latter group was included on account of their traumatic experiences and extensive contact with UK agencies in the weeks and months after the tsunami. Many flew to the affected areas to search for loved ones, whereas others identified bodies from photographs on the internet or waited at home anxiously watching media coverage. Gathering their opinions was considered vital to generate a comprehensive view of the UK government’s response. Participants’ ages ranged from 18 to 75 and above; 63 were female (54%) and 53 male (46%). One-hundred and ten (95%) described their ethnic origin as ‘White British’. Sixty-three had lost a loved one in the tsunami (54%). Ninety-three questionnaire respondents (80%) agreed to be interviewed and the 29 who participated were chosen purposively from this sample to ensure a range of different experiences, various ages and that both males and females were included. The focus group comprised ten survivors and family members who were already participants.

Measures

A mixed-methods approach using the combination of quantitative and qualitative data was adopted, with survey questionnaires, semi-structured interviews and a focus group. The study used a sequential explanatory design, Reference Creswell and Plano Clark13 whereby qualitative data were gathered to explore and explain the quantitative result. Data collection was carried out between April and July 2006, i.e. 15-19 months after the tsunami.

Survey

A questionnaire (available from the authors on request) was developed with significant input from tsunami survivors to generate quantitative and qualitative information regarding experiences and perceptions of efficacy of support from various agencies during the first few days, the first 2 months and subsequently. It consisted of a combination of multiple choice questions, open-ended questions and 1-7 visual analogue scales where 1 indicated ‘as ineffective as I can imagine’, 4 ‘neither effective nor ineffective’ and 7 ‘as effective as I can imagine’. Separate versions were developed to gather the views of those who were in the affected areas at the time of the tsunami and those who were in the UK or elsewhere in the world. Participants were also asked to complete the revised Impact of Event Scale (IES-R) Reference Weiss, Marmer, Wilson and Keane14 and the Hospital Anxiety and Depression Scale (HADS), Reference Zigmond and Snaith15 well-validated self-report measures to determine PTSD, anxiety and depression symptomatology.

Semi-structured interviews

Interviews were conducted throughout the UK by trained professionals and sought to elaborate on information gained through the written questionnaire.

Focus group

Preliminary findings were shared with a group of ten survivors and family members to ascertain whether emerging themes corresponded with their experiences. The focus group was facilitated by a consultant clinical psychologist (V.N.).

Analysis

A triangulation approach using the information gained from the survey, the semi-structured interviews and the focus group was adopted to ensure reliability. The quantitative data from the survey were analysed using SPSS software for Windows. Independent sample t-tests were used to examine hypothesised relationships between different groups of participants using the total IES-R score as the outcome variable. The qualitative data were analysed by two researchers using an interpretive phenomenological analysis approach and the software package NVivo 7 (www.qsrinternational.com) for Windows. Emerging themes were developed by reading and re-reading the verbatim data until a number of meaningful categories were created. Towards the end of the qualitative analysis process no new categories were created, suggesting that all major themes had been identified.

Results

Quantitative data

Perceived effectiveness of support

People’s experiences of official/agency support following the tsunami were extremely variable. Table 1 shows the perceived levels of effectiveness of various people/agencies using mean scores from the 1-7 visual analogue scales.

Table 1 Overall effectiveness of agencies for all participants Footnote a

First hours
and days
During the first 2 months
after return
From first 2 months
to present
n Footnote b Mean score
(s.d.)
n Footnote b Mean score
(s.d.)
n Footnote b Mean score
(s.d.)
Average scores on effectiveness of different agencies
 Tourists 37 5.7 (1.5) Footnote * Footnote * Footnote * Footnote *
 Local people/services 57 5.6 (1.5) Footnote * Footnote * Footnote * Footnote *
 People travelling with my loved ones 21 5.0 (2.2) Footnote * Footnote * Footnote * Footnote *
 Friends/contacts in other areas 27 5.0 (2.5) Footnote * Footnote * Footnote * Footnote *
 UK emergency telephone line 48 2.4 (1.9) Footnote * Footnote * Footnote * Footnote *
 Non-UK agencies 37 4.0 (2.2) Footnote * Footnote * Footnote * Footnote *
 Unknown officials 20 2.6 (2.5) Footnote * Footnote * Footnote * Footnote *
 Red Cross 38 3.1 (2.2) Footnote * Footnote * Footnote * Footnote *
 Embassy/consul of the relevant country 32 3.1 (2.1) Footnote * Footnote * Footnote * Footnote *
 FCO/UK embassy 77 2.7 (2.0) 51 3.5 (2.1) Footnote * Footnote *
 Police family liaison officers 22 2.4 (2.1) 68 4.9 (2.1) 56 5.1 (2.1)
 Tsunami Support Network via the Red Cross and FCO Footnote * Footnote * 56 5.1 (2.1) 66 5.6 (1.7)
 Local GP Footnote * Footnote * 65 4.8 (2.2) 50 4.9 (2.0)
 Police Footnote * Footnote * 54 4.8 (2.1) 42 5.0 (2.1)
 Privately funded counselling/therapy Footnote * Footnote * 28 4.6 (2.1) 25 4.7 (2.1)
 Local hospitals - physical care Footnote * Footnote * 27 4.4 (2.3) 21 4.1 (2.6)
 FCO assistance package Footnote * Footnote * 36 4.2 (2.5) 44 4.8 (2.3)
Experience of how well agencies worked together 30 2.8 (2.0) 54 3.5 (2.1) 52 3.7 (2.2)
 Department for Work and Pensions Footnote * Footnote * 14 3.1 (2.4) 19 3.9 (2.5)
 NHS-funded counselling/therapy Footnote * Footnote * 38 3.0 (2.1) 28 3.8 (2.3)
 Voluntary agencies Footnote * Footnote * 17 2.5 (2.0) 24 3.7 (2.6)
 Local Social Services Footnote * Footnote * 17 2.1 (1.9) 15 2.3 (2.0)
 Memorial service organised by the Department for Culture, Media and Sport Footnote * Footnote * Footnote * Footnote * 64 5.2 (2.2)
 FCO assistance to return for anniversary Footnote * Footnote * Footnote * Footnote * 41 4.4 (2.7)

FCO, Foreign and Commonwealth Office; GP, general practitioner; NHS, National Health Service.

a. The rating of effectiveness was on a scale from 1 to 7, where 1 was ‘as ineffective as I can imagine’, 4 was ‘neither effective nor ineffective’ and 7 was ‘as effective as I can imagine’.

b. Number reporting contact with specific agency.

* Question not asked.

Immediate aftermath Overall, individuals felt that the level of agency support was ineffective in the minutes and hours after the tsunami (mean = 3.0, s.d. = 1.8, n = 60) and a few days afterwards (mean = 3.7, s.d. = 2.0, n = 51). In the first hours and days, local people/services and fellow travellers were perceived as providing the most effective support. There was no expectation of significant external help until day 2-3 but even after this time no UK agency was perceived as providing effective support.

The weeks and months after the tsunami The assistance that was felt to be most effective in the following weeks and months was from the Tsunami Support Network (TSN), police family liaison officers and general practitioners (GPs). The memorial service was also very well received. Assistance provided by voluntary agencies, Social Services and National Health Service (NHS)-funded counsellors/therapists was rated least effective.

Symptoms reported

The scores on the questionnaires indicated relatively high levels of reported symptomatology 15-19 months after the tsunami. Forty-two individuals (37%) scored above 33 on the IES-R, a cut-off found to predict the presence of PTSD. The mean score on the IES-R was 25.3 (s.d. = 19.1). Fifty-three individuals (46%) scored above 10 on the HADS-anxiety, a cut-off found to predict the presence of clinically significant anxiety. The mean score on the HADS-anxiety was 9.8 (s.d. = 3.3). Twenty-three individuals (20%) scored above 10 on the HADS-depression, a cut-off found to predict the presence of clinically significant depression. The mean score on the HADS-depression was 9.2 (s.d. = 2.3).

There were no significant differences between the IES-R results of those in the affected regions or those in the UK or elsewhere at the time of the tsunami, or between males and females. Those respondents who lost family, friends or relatives to the tsunami scored significantly higher on the IES-R than those who did not lose any loved ones (mean difference = 8.86, 95% CI 1.99-15.73). There were no significant differences between participants in the affected areas who rated the overall support in the first minutes and hours after the tsunami as ineffective (>4) and those who rated it effective (>4). However, those who rated the overall support ineffective in the first few days after the tsunami scored significantly higher on the IES-R than those who rated it effective (mean difference = 14.26, 95% CI

Box 1 Key qualitative themes that emerged after analysing the study data

Key themes associated with negative perceptions of support:

  1. inability to access UK official assistance

  2. lack of effective information

  3. insensitivity of officials

  4. perception of lack of a coordinated plan

  5. difficulties accessing services.

Key themes associated with positive perceptions of support:

  1. sensitivity

  2. well-organised, efficient responses

  3. provision of a supportive advocacy role

  4. bringing people together.

4.13-24.4). This result links to the distinction between the first 24-48 hours when external assistance was not expected and after 2 or 3 days when it was.

Qualitative data

Emergent themes are presented in Box 1 and discussed below, with reference to associations with negative and positive perceptions of support.

Themes associated with negative perceptions of support

Inability to access UK official assistance Those in the affected areas did not expect an official UK presence in the first 24-48 hours. After this time, perceived lack of support led to feelings of isolation, frustration and abandonment.

‘I believed that your government, with all its immense resources, after about 24-48 hours, would be there in some force to help you. And I found that wasn’t so.’

Lack of information There did not appear to be a clear system in place for gathering or disseminating information. This was perceived as a fundamental need that was not met.

‘If there had been a telephone number to call who could have answered questions or at least updated us on search activities. As it was, there was absolutely no support.’

Insensitivity of officials Respondents reported encounters with officials who appeared to lack empathy and understanding.

‘The British embassy didn’t have a clue. They had no emotional connection, no attempt to say “Are you ok?”’

Perception of lack of a coordinated plan Respondents described a response which lacked organisation and coordination.

‘There was no equipment there, no computers. I don’t think they even had a telephone to be honest.’

In the longer term, individuals were often unaware of available services. Legislation aimed at data protection prevented the sharing of information between departments.

‘So I think it would have been useful for departments to share information much more efficiently than they did.’

Bureaucracy and difficulties accessing services One of the most prevalent difficulties after returning to the UK was accessing support.

‘I wasn’t trying to screw the system, but it was a nightmare you know… they should have a record of me being there.’

Difficulties accessing psychological support through the NHS were also reported.

Themes associated with positive perceptions of support

Sensitivity The strongest theme concerned the power of humanity - help given when required, with sensitivity, was deeply comforting.

‘The embassy staff when we got to Bangkok were wonderful. She sat and cried with me.’

Well-organised efficient responses Some individuals reported receiving a well-organised, efficient response to their practical needs. This was appreciated.

‘But I do remember thinking we have been very well processed through their system.’

Provision of a supportive advocacy role Services that provided a supportive advocacy role were highly valued. This included family liaison officers, GPs and British Red Cross personnel.

‘The Red Cross have helped us gain information on the inquest, memorial services and psychological support package.’

Bringing people together On return to the UK, people valued enormously the opportunity to meet others, share experiences and spend time together.

‘I think what helped… was the fact that other people would be there who were similarly affected.’

Discussion

Participants perceived the official support received in the aftermath of the tsunami as poor overall. There was a strong relationship between perceived ineffectiveness of support within a few days of the tsunami and symptoms of PTSD 15-19 months later. This relationship was not present for perceived support in the first minutes and hours at which point there was no expectation of assistance, suggesting that it is only when assistance is expected but not received that there is an impact on later PTSD symptoms. The strongest themes were that support provided in a humane manner was perceived as effective and that uncoordinated support, poor communication and limited accessibility to support and information were perceived as ineffective.

Strengths and weaknesses of the study

This is the first study of psychosocial disaster response to use a robust qualitative method with a combination of data collection methods. Two researchers independently went backwards and forwards between the raw data and the process of conceptualisation to make sense of the data. Reference Pope and Mays16 The emerging themes were tested for validity using recognised techniques, Reference Mays and Pope17 including regular discussion of emerging themes by the research team; triangulation to compare the results from different sources; review of the emerging themes in a focus group and deviant case analysis; and the use of quantitative evidence to test the conclusions where appropriate.

The sampling strategy was theoretically comprehensive and saturation of themes appeared to be achieved, but the study was not designed to determine the views of everyone affected by the tsunami. Indeed, the focus was on those most affected by it. Only 40% of those contacted took part, which may have introduced bias to the results, although we have no evidence for or against this. The number of people invited to participate was limited by the lack of a comprehensive list of those affected by the tsunami and Data Protection Act issues. They may not have been representative of typical individuals affected and we suspect are likely to be at the more affected end of what is likely to be a spectrum of experiences. As a result, caution should be exercised in terms of the generalisability of the results to everyone affected by the tsunami or by other natural disasters.

The quantitative measures employed were designed to measure symptoms of PTSD, anxiety and depression but other issues may have contributed to the scores, including grief. It is possible that perceptions of helpfulness are shaped by the degree of response and therefore do not truly reflect how appropriate the level of support actually was. It is also possible that particular individuals are predisposed to viewing events in particular ways. The fact that the significant difference emerged at the time when it was reasonable to expect help, and not at all time periods, does not support this, but without characterising participants before they were exposed to the traumatic experience this is impossible to fully address. The results were limited to the perception of support as it was not possible for any objective measurement of service provision to be made. It is, however, possible that higher-quality services would have been associated with better outcomes.

Finally, it is important to note that data collection occurred 15-19 months after the tsunami. This introduces the issue of reliability of memories of traumatic events and the possibility of recall bias. Recent research has suggested that individuals who experience more symptoms may be prone to increased reporting of precipitating traumatic events over time. Reference Engelhard, van den Hout and McNally18

Clinical implications

The results of this study should inform improved planning of coordinated, flexible, multi-agency responses to traumatic events before they occur in line with previously published guidelines. 8,11 Psychosocial components should be fully integrated with other aspects of the plan. The association between perceived ineffective support and PTSD symptoms is consistent with previous research Reference Brewin, Andrews and Valentine4,Reference Ozer, Best, Lipsey and Weiss5 and underlines the fact that an inadequate response magnifies the psychological risks consequent upon involvement in a traumatic event. The finding that humanity was appreciated even when there was little that could be done suggests the need for a basic level of training in effective communication for all providers of assistance following traumatic events.

This study has major implications for many organisations including emergency services, government departments, Social Services, voluntary bodies, non-governmental organisations and health providers, whose staff often have early contact with traumatised people. The limited perceived effectiveness of the psychological and emotional support provided by the UK’s NHS is a major concern, particularly seeing that over a half of study participants described clinically significant levels of traumatic stress, depression or anxiety. This figure may well have been higher sooner after the tsunami, given the tendency for symptoms to improve over time. Reference Galea, Vlahov, Resnick, Ahern, Susser and Gold19 Some issues can be addressed more easily than others. For example, improving the communication skills of staff has been achieved in other areas. Reference Fallowfield, Jenkins, Farewell and Solis-Trapala20 Other issues require more detailed planning and have greater resource implications, for example enhancing health services to meet the recommendations of the National Institute for Health and Clinical Excellence for PTSD. 8

Future research

There remain unanswered questions including exactly what should be provided, when and by whom following a disaster. It is hoped that new approaches will be developed and properly evaluated incorporating the lessons that have already been learnt. This will avoid the now all too familiar sight of officials apologising for an inadequate response. Reference Brash21 As one participant said, ‘No help is better than bad help’.

Funding

The study was funded by the National Audit Office.

Acknowledgements

The Zito Trust was commissioned to gather the views of victims and their families who needed these services.

Footnotes

Declaration of interest

None.

References

1 Hobfoll, SE, Watson, P, Bell, CC, Bryant, RA, Brymer, MJ, Friedman, MJ, et al. Five essential elements of immediate and mid-term trauma intervention: empirical evidence. Psychiatry 2007; 70: 283315.CrossRefGoogle ScholarPubMed
2 American Psychiatric Association. Diagnostic and Statistical Manual of Mental Disorders (4th edition) (DSM-IV). APA, 1994.Google Scholar
3 Galea, S, Nandi, A, Vlahov, D. The epidemiology of post-traumatic stress disorder after disasters. Epidemiol Rev 2005; 27: 7891.CrossRefGoogle ScholarPubMed
4 Brewin, CR, Andrews, B, Valentine, JD. Meta-analysis of risk factors for posttraumatic stress disorder in trauma-exposed adults. J Consult Clin Psychol 2000; 68: 748–66.CrossRefGoogle ScholarPubMed
5 Ozer, EJ, Best, SR, Lipsey, TL, Weiss, D. Predictors of posttraumatic stress disorder and symptoms in adults: a meta-analysis. Psychol Bull 2008; 129: 5273.CrossRefGoogle Scholar
6 Rose, S, Bisson, J, Churchill, R, Wessely, S. Psychological Debriefing for Preventing Post Traumatic Stress Disorder (PTSD). Cochrane Library, Issue 1. Update Software, 2005.Google Scholar
7 van Emmerick, A, Kamphuis, J, Hulsbosch, A, Emmelkamp, D. Single session debriefing after psychological trauma: a meta-analysis. Lancet 2002; 360: 766–71.Google Scholar
8 National Collaborating Centre for Mental Health. Post-Traumatic Stress Disorder: The Management of PTSD in Adults and Children in Primary and Secondary Care. Gaskell, British Psychological Society, 2005.Google Scholar
9 Bryant, RA, Sackville, T, Dang, ST, Moulds, M, Guthrie, R. Treating acute stress disorder: an evaluation of cognitive behavior therapy and counselling techniques. Am J Psychiatry 1999; 156: 1780–6.CrossRefGoogle ScholarPubMed
10 Ehlers, A, Clark, DM, Hackmann, A, McManus, F, Fennell, M, Herbert, C, et al. A randomized controlled trial of cognitive therapy, a self-help booklet, and repeated assessments as early interventions for posttraumatic stress disorder. Arch Gen Psychiatry 2003; 60: 1024–31.CrossRefGoogle ScholarPubMed
11 Inter-Agency Standing Committee. IASC Guidelines on Mental Health and Psychosocial Support in Emergency Settings. IASC, 2007.Google Scholar
12 The National Audit Office. Review of the Experiences of United Kingdom Nationals Affected by the Indian Ocean Tsunami. National Audit Office, 2006.Google Scholar
13 Creswell, JW, Plano Clark, VL. Designing and Conducting Mixed Methods Research. Sage, 2007.Google Scholar
14 Weiss, DS, Marmer, CR. The Impact of Event Scale – Revised. In Assessing Psychological Trauma and PTSD (eds Wilson, JP, Keane, TM): 399411. Guilford Press, 1997.Google Scholar
15 Zigmond, AS, Snaith, RP. The hospital anxiety and depression scale. Acta Psychiatr Scand 1983; 67: 361–70.CrossRefGoogle ScholarPubMed
16 Pope, C, Mays, N. Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research. BMJ 1995; 311: 42–5.CrossRefGoogle ScholarPubMed
17 Mays, N, Pope, C. Assessing quality in qualitative research. BMJ 2000; 320: 50–2.CrossRefGoogle ScholarPubMed
18 Engelhard, IM, van den Hout, MA, McNally, RJ. Memory consistency for traumatic events in Dutch soldiers deployed to Iraq. Memory 2008; 16: 39.CrossRefGoogle ScholarPubMed
19 Galea, S, Vlahov, D, Resnick, H, Ahern, J, Susser, E, Gold, H, et al. Trends of probable post-traumatic stress disorder in New York City after the September 11 terrorist attacks. Am J Epidemiol 2003; 158: 514–24.CrossRefGoogle ScholarPubMed
20 Fallowfield, L, Jenkins, V, Farewell, V, Solis-Trapala, I. Enduring impact of communication skills training: results of a 12-month follow-up. Br J Cancer 2003; 89: 1445–9.CrossRefGoogle ScholarPubMed
21 Brash, W. Bush apologises for Katrina, and he should. Online Opinion 2005; 20 September (http://www.onlineopinion.com.au/view.asp?article= 32).Google Scholar
Figure 0

Table 1 Overall effectiveness of agencies for all participantsa

Submit a response

eLetters

No eLetters have been published for this article.