Hostname: page-component-78c5997874-4rdpn Total loading time: 0 Render date: 2024-11-10T06:51:59.679Z Has data issue: false hasContentIssue false

The Community Assessment to Inform Rapid Response (CAIRR): A Novel Qualitative Data Collection and Analytic Process to Facilitate Hyperlocal COVID-19 Emergency Response Operations in New York City

Published online by Cambridge University Press:  30 May 2022

Madhury Ray*
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
Rachel Dannefer
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
Jennifer Pierre
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
Lauren J Shiman
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
Hannah L Helmy
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
Shelby R Boyle
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
Jae Eun M Chang
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
Alyssa Creighton
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
Maria A Soto
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
Jacqlene Moran
Affiliation:
New York City Department of Health and Mental Hygiene, New York, NY, USA
*
Corresponding author: Madhury Ray, Email: madhury.ray@alumni.harvard.edu
Rights & Permissions [Opens in a new window]

Abstract

All disasters are local but implementing a hyperlocal response in the midst of a public health emergency is challenging. The availability of neighborhood-level qualitative data that are both timely and relevant to evolving objectives and operations is a limiting factor. In 2020, the New York City Department of Health and Mental Hygiene (NYC DOHMH) responded to the COVID-19 emergency using a novel, hyperlocal approach. Key to the implementation of this approach was the creation of the Community Assessment to Inform Rapid Response (CAIRR), a process for rapid collection and analysis of neighborhood-specific, objective-focused, qualitative data to inform tailored response operations. This paper describes the process of developing the CAIRR and its contribution to the NYC DOHMH’s hyperlocal response in order to guide other jurisdictions seeking to employ a hyperlocal approach in future disaster responses.

Type
Concepts in Disaster Medicine
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (https://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited.
Copyright
© New York City Department of Health and Mental Hygiene, 2022. Published by Cambridge University Press on behalf of Society for Disaster Medicine and Public Health, Inc.

The first case of COVID-19 in New York City (NYC) was confirmed on February 29, 2020, though data suggest that community transmission of SARS-CoV-2 was already widespread at that point. Reference Gonzalez-Reiche, Hernandez and Sullivan1 By the end of March 2020, NYC had become the global epicenter of the COVID-19 pandemic. Reference Thompson, Baumgartner and Pichardo2 Significant racial and ethnic disparities in SARS-CoV-2 transmission as well as COVID-19-related morbidity and mortality soon became evident in NYC, including a disproportionate impact among Black, Latinx, Asian, and Indigenous individuals relative to White individuals. Reference Thompson, Baumgartner and Pichardo2Reference Yan, Hwang, Ng, Chu, Tsoh and Nguyen6 This pattern of disparity by race in NYC is consistent with population-level observations of racial inequity in chronic health conditions and life expectancy, 7 as well as in the impacts of other public health emergencies. Reference Medwinter8Reference Mattingly, Lawlor and Jacobs-Huey10 Numerous studies have described the mechanisms of structural racism underlying and amplifying these inequities, notably that generations of practices and policies have resulted in the ongoing exclusion of communities of color from resources and conditions that promote health and increase resilience. Reference Bailey, Feldman and Bassett11Reference Bethel, Burke and Britt15

In NYC, many of these policies targeted neighborhoods based explicitly on their racial demographics, creating health inequities that are both racial and geographic. Reference Shiman, Freeman, Bedell and Bassett16Reference Novick18 In the context of the early COVID-19 emergency, those geographic disparities in health translated to persistently differential rates of SARS-CoV-2 transmission and COVID-19 related morbidity and mortality across different NYC neighborhoods, despite the implementation of citywide response operations (See Figure 1). Reference Chan, Greene, Woo, Fine and Thompson3 At the same time, neighborhood-level work by the NYC Department of Health and Mental Hygiene (NYC DOHMH) suggested that as the impacts of COVID-19 differed by neighborhood, so too did the constellation of public health barriers and resources shaping SARS-CoV-2 transmission in each neighborhood. The persistence of geographic disparities despite multilayered non-pharmaceutical interventions at the city level uncovered an urgent need for a novel, place-based approach to emergency response, tailored to the unique public health barriers, and resources in neighborhoods disproportionately impacted by the pandemic.

Figure 1. Cumulative confirmed SARS-CoV-2 case rates by neighborhood in NYC (July 2020). The map illustrates the disparities in cumulative SARS-CoV-2 PCR postive case rates by neighborhood in NYC, with darker areas corresponding to higher case rates (range 645-4,587 per 100,000 residents) Neighborhoods are defined as modified zip code tabulation areas. Data are from July 31, 2020 but the disparities were evident before, and after this date. Data collection and analysis was carried out by the NYC DOHMH’s Surveillance and Epidemiology Branch, while the data were collated by the NYC DOHMH’s Integrated Data Team.

Indeed, place-based approaches are increasingly utilized by public health organizations to combat health inequity and as a key reinvestment strategy to address ongoing structural and institutional racism. 19Reference Dankwa-Mullan and Pérez-Stable21 A place-based approach centers the unique determinants of health in a neighborhood, such as the quality of local housing or specific barriers to accessing healthcare. Similarly, a place-based approach leverages the unique resources and assets of a neighborhood, such as shared spaces in houses of worship, existing networks for health promotion, or the participation of trusted leaders. It is not difficult to anticipate the utility of a similar approach in public health emergency response, where disaster impacts often have inherent geographic attributes and where existing neighborhood level inequities compound those impacts. Reference Lowe, McGrath and Young22Reference Gill and Ritchie24

Place-based approaches have been implemented successfully in disaster preparedness and recovery phases Reference Muir25,Reference Naylor, Fall and Fox26 ; however, translation of the place-based approach to the context of disaster response has not been straightforward. A significant limiting factor is the ability to collect and analyze data, particularly qualitative data, that are both directly relevant to evolving Incident Command System (ICS) objectives and operations, and are also timely and neighborhood-specific. This paper describes the design and implementation of the Community Assessment to Inform Rapid Response (CAIRR), a process for rapid collection and analysis of neighborhood-specific, objective-focused, qualitative data to inform tailored response operations, and its contribution to the NYC DOHMH’s novel hyperlocal approach, a rapid and time-limited place-based approach to disaster response, in the COVID-19 emergency. The aim of this paper is to share the NYC DOHMH’s experience and methods so that other jurisdictions seeking to implement a more equitable response can adapt the CAIRR for their own hyperlocal responses, not only to COVID-19, but also in future disasters.

CAIRR development and initial implementation

Overview

In the Spring of 2020, the NYC DOHMH’s ICS added a high priority incident objective to its COVID-19 emergency response: to stem transmission of SARS-CoV-2 in neighborhoods disproportionately impacted by COVID-19 through a hyperlocal approach. Recognizing the role of racial and other structural inequities in the geographic disparity of COVID-19 impact in NYC, 4 Neighborhood Response Teams (NRTs) were mobilized under the ICS Equity Officer as geographic divisions corresponding to 4 NYC boroughs (geographic units similar to counties) to achieve this objective. NRTs were responsible for coordinating operations in selected neighborhoods within their respective boroughs. Each NRT included operations, community engagement, data, and support staff.

This new hyperlocal approach built on prior emergency response efforts by NYC during Zika virus and measles outbreaks to leverage community partners’ input in response development. Conceptually, the hyperlocal approach drew heavily from the NYC DOHMH’s decades of place-based work to address health inequities in conditions such as HIV, maternal health, and chronic disease in neighborhoods most impacted by structural racism and disinvestment, exemplified by the establishment of NYC DOHMH’s Bureaus of Neighborhood Health (BNH) in 2003. Reference Pierre, Letamendi and Sleiter27 Indeed, based on observations by the BNH early in the pandemic, the NRTs recognized the need for nuanced, neighborhood-specific operations that both leveraged existing community assets and addressed the specific barriers faced by these communities, but lacked neighborhood-specific contextual data to drive the design and implementation of such operations. At the same time, the demand for a response in the most impacted neighborhoods was urgent, requiring rapidity, scalability, flexibility in data (specifically qualitative data) collection, analysis, and operational design.

The CAIRR was created to satisfy each of these potentially conflicting requirements. To facilitate the rapid translation of qualitative data into operations, the NRTs first identified an existing operational framework already in use across the NYC DOHMH’s ICS, comprising 4 operational strategies which comprehensively encompassed all NYC DOHMH operations to stem transmission of SARS-CoV-2. These strategies were: testing, source control, time, and space (see definitions of strategies in Table 1). Second, the NRTs developed a simple qualitative tool based on this ‘4 strategy’ framework, allowing the NRTs to sort and categorize data according to each strategy at the time of collection. Given the urgency of the objective and safety considerations related to COVID-19, rather than in-person field data collection, selected community partners who maintained regular communication with residents in the neighborhoods of interest were interviewed by phone. These interviews served as a proxy for direct field data collection from community residents, consistent with previously described rapid assessment processes. Reference Beebe28 Finally, the use of the 4 strategy operational framework as an initial coding frame facilitated the rapid analysis and translation of collected data within each strategy, in order to directly inform corresponding operations.

Table 1. Key themes by operational strategy to stem SARS-CoV-2 transmission

The table illustrates some key themes that emerged from various neighborhoods and the tailored operations designed to address those particular themes. Themes were often common among 1 or more neighborhoods but the overal profile of themes from each neighborhood was unique; similarly, the suite of operations and operational details were unique for each neighborhood.

The CAIRR was integrated into the wider hyperlocal response, which operated across the ICS (Table 2) and engaged each selected neighborhood intensely for an operational period of several weeks (Figure 2) Upon selection of a neighborhood for hyperlocal response, the NRT corresponding to that neighborhood’s borough initiated the CAIRR and oversaw neighborhood-level joint operations. The entire CAIRR process spanned about 5 days. By day 6 after neighborhood selection, summary CAIRR data were shared with operational groups in a template-based report and through integration of an NRT representative into joint operational planning processes. Tailored neighborhood operations began around day 10 and lasted for a period of approximately 2-3 weeks. NRT staff led and participated in joint tailored operations based on CAIRR findings and other neighborhood-level data (see Table 1 for examples of findings and corresponding operations). The CAIRR was performed once for each neighborhood during this period of early implementation.

Table 2. Groups involved in the early implementation of the hyperlocal response

Under NYC’s Citywide Incident Management System, a local adaptation of the National Incident Management System, the NYC DOHMH is a primary agency in a public health emergency, sharing unified command with the Fire Department of New York and the NYC Police Department. 58 This phase of the hyperlocal response focused on NYC DOHMH and NYC Health & Hospitals’ activities, though other NYC Agencies provided support. Response groups marked with an asterisk (*) attended joint operational planning sessions.

Figure 2. General timeline of hyperlocal response, including the CAIRR. The graphic illustrates a general timeline of the hyperlocal response in each neighborhood, beginning with neighborhood selection. The NRT assigned to a neighborhood’s borough was responsible for overseeing that borough. Shaded steps indicate the CAIRR, while those in outline were joint operational pieces. During the CAIRR’s early implementation, this timeline was executed once per neighborhood.

Neighborhood selection

Assignment of neighborhood priority for hyperlocal response, including the CAIRR, was determined by a steering committee comprised of the Incident Commander, the Equity Officer, and technical experts, and was based on multiple factors including historical disinvestment, assessment of social vulnerability, and the emergence of concerning COVID-19 epidemiological data such as SaTScan signals Reference Greene, Peterson and Balan29 or a relative increase in neighborhood percent positivity. Reference Cordes and Castro30 Modified zip code tabulation area boundaries were used to delineate neighborhoods in order to align with other emergency response operations. 31

Interview guide

A structured interview guide was developed based on the 4 strategy operational framework to stem SARS-CoV-2 transmission (testing, source control, space, and time). The guide consisted of open-ended questions focused on the needs, barriers, assets, and experiences community partners identified from resident interactions corresponding to each of the 4 strategies (see supplementary materials for an early iteration of the interview guide). To avoid a 1-sided interaction, interviewers also offered resources to partners, such as support finding nearby testing sites, webinars by NYC DOHMH experts, or flyers with locally relevant information. Development of the interview guide was an iterative process, so that questions evolved based on previous lessons and observations, existing neighborhood level data, and emerging COVID-19 concerns.

Community partner selection

Partners were identified using a number of sources, including established NYC DOHMH relationships, suggestions by staff with local knowledge, snowball selection via personal and professional networks, and existing partner databases and directories.

Since community partners acted as a proxy for direct data collection from neighborhood residents, only a subset of identified partners was selected strategically to reflect a variety of local organizations maintaining regular communication with a cross-section of neighborhood residents, such as community-based organizations, resident associations for public housing, faith-based organizations, schools, community boards, food pantries, and healthcare providers. An organization’s catchment population was also considered, and efforts were made to reach organizations serving specific priority populations such as seniors, immigrants, and LGBTQ+ individuals. Selected partners were listed on a shared spreadsheet where staff conducting phone interviews tracked all attempts and interactions.

Data collection

Interviews were conducted in English or Spanish and lasted between 15 and 30 minutes. All interviews were conducted by NYC DOHMH staff, including data analysts and operations staff, with experience in community engagement, and/or qualitative data collection. Additionally, all interviewers received a brief technical training. In most cases, interviewers conducted follow-up with organizations to provide COVID-19 related resources or share updated information. All interviews were typically completed over 2-3 days, accounting for delays in contacting partners due to lockdowns, Reference Woc-Colburn, Godinez, Hidalgo, Rodríguez-Vega and Pérez-Fernández32 and transition to remote work across NYC. Interview responses were recorded in an online Alchemer survey form and downloaded into Microsoft Excel (Microsoft Corp, Redmond, Washington, USA) for analysis.

Early experience revealed that with well trained staff, thematic saturation was achieved with 10 or fewer completed partner interviews per neighborhood. Not surprisingly, organizations with strong prior relationships with the NYC DOHMH were more likely to engage with the NRTs, though interactions with new partners often led to ongoing relationships that continued after the hyperlocal response was complete.

Rapid qualitative analysis

Analysis of partner interviews was conducted separately for each neighborhood. Responses were initially coded deductively using the 4 strategy operational framework, then inductively within each strategy utilizing the matrix analysis method, with the interview questions serving as the main domains, to produce 4 sets of key themes. This allowed for a quick understanding of the major findings, and could be completed by persons with minimal qualitative training. Reference Averill33 For each neighborhood, key themes were consolidated into a single table according to strategy and incorporated into a template report together with epidemiological and other quantitative data, neighborhood demographics, geographic information including mobility analyses, and a social vulnerability score. Reports were produced by the NYC DOHMH ICS Integrated Data Team and shared with operational groups from across the ICS by day 6 after the selection of a neighborhood for hyperlocal operations, ahead of joint operational planning sessions. When deemed relevant, more granular data were also shared internally with staff responsible for related field operations.

Coding, analysis of findings, and report writing were typically completed within 1 to 2 days immediately following completion of interviews. This time could be further reduced by beginning the process of coding and analysis of findings simultaneously with data collection.

Operationalization

General operational plans were tailored to meet neighborhood characteristics during joint operational planning sessions that included representatives from involved operations (see Table 2 for a list of groups involved in hyperlocal operations). Operational leads reviewed CAIRR findings as part of an integrated data report ahead of the meeting, and an NRT representative participated in operational planning to support the application of relevant CAIRR findings, and to define NRT-led operations. The entire operational planning process, from the first joint operational planning session to the deployment of field staff, spanned approximately 5 days, and executions of operations spanned approximately 2-3 weeks (Table 1 illustrates examples of operations tailored to CAIRR findings).

Assessment of success

Assessment of operational success varied across neighborhoods based on identified needs; for example, hyperlocal response in 1 neighborhood with low testing rates was deemed successful when that neighborhood’s SARS-CoV-2 testing rates rose to meet the citywide average, while response in another neighborhood with a SaTScan cluster was considered successful when the cluster was no longer detectable at the close of operations. Some outcomes, however, were difficult to quantify in the short term, such as development of new partnerships in a neighborhood previously distrustful of NYC DOHMH messaging, or correction of locally relevant misinformation through tailored webinars (see Table 1). The NYC DOHMH’s hyperlocal response would likely have benefited from a universal evaluation framework that matched the rapidity, scalability, and flexibility of the CAIRR.

Discussion

A place-based approach to ICS response

Geographic disparities in the impact of public health emergencies are not unique to COVID-19, nor are they limited to NYC. These disparities are explained through social vulnerability, a concept which encompasses downstream impacts of structural racism and other structural inequities (e.g., housing stability, health insurance access, and resiliency of the built environment), and can be estimated at the neighborhood level. Reference Flanagan, Gregory, Hallisey, Heitgerd and Lewis34Reference Wolkin, Patterson and Harris36 Simultaneously, people living in highly impacted communities are often the biggest asset to disaster response and recovery, serving as both the ‘first and last responders’ in an emergency. 37,38

Given that the geographic disparities encountered in public health emergencies have structural roots, it is not surprising that similar health disparities persist outside of an emergency context. Reference Nomura, Parsons, Hirabayashi, Kinoshita, Liao and Hodgson23,Reference Cuthbertson, Archer, Rodriguez-llanes and Robertson39 In public health, social vulnerability and community resiliency can be approximated by a neighborhood’s social determinants of health, defined as the conditions in the environment where people are born, live, learn, work, play, worship, and age, that affect a wide range of health and quality-of-life outcomes and risks. 40 The NYC DOHMH has a long history of place-based work, strengthened by renewed investment in neighborhoods with the development of the BNH teams in 2003. Reference Dannefer, Wong and John41

Disparities in COVID-19 outcomes stem from many of the social determinants of health addressed through the BNH’s place-based approach, but the scale of the pandemic required translation of the BNH’s long-term work to an emergency context. Reference Burström and Tao42Reference Singu, Acharya, Challagundla and Byrareddy47 The BNH’s place-based approach leverages deep, long-term partnerships to attack neighborhood-level health inequities at their roots. Reference Pierre, Letamendi and Sleiter27,Reference Dannefer, Wong and John41 Indeed, the BNH’s interventions early in the pandemic focused on addressing neighborhoods’ social determinants of health, such as food and housing insecurity, in addition to slowing SARS-CoV-2 transmission. However, given the urgency created by inequities in COVID-19 morbidity and mortality, the NRTs were mobilized for a much narrower and more time-bound task: the rapid execution of a suite of response operations to ensure a timely, specific response to concerning trends in SARS-CoV-2 transmission in neighborhoods impacted by racism and other structural inequities, or as the NYC DOHMH termed it, a hyperlocal approach.

A common operating picture at the hyperlocal level

The CAIRR was fundamental to the adaptation of the NYC DOHMH’s place-based approach to a hyperlocal response under the ICS. Consequences of COVID-19 in a neighborhood are uniquely amplified by its particular barriers to stemming transmission and minimized by its particular assets; qualitative data about those barriers and assets were essential to developing tailored operations.

The use of neighborhoods or ‘small geographic areas’ for operational scale has a clear benefit to operations. Operations covering a smaller area can be adapted much more quickly and with fewer resources relative to citywide operations if accurate and timely data at the neighborhood level are available. However, measurement of accurate and precise quantitative data at the level of a small geographic area can be complex, as conclusions based on small datasets are more subject to errors created by missing data or non-representative sampling of data. Reference Griffith, Chun and Lee48 Statistical data, epidemiological data, and other data such as mobility estimates are all critical to operations, but can be difficult to interpret at the neighborhood level without context. As such, the NYC DOHMH used epidemiologic data about SARS-CoV-2 transmission and outcomes, geographic and mobility data about high traffic locations, and demographic data about baseline health, race, and healthcare access to complement qualitative data, rather than using such data independently to develop hyperlocal operations.

Qualitative data collected and analyzed through the CAIRR provided nuanced, operationally relevant context in a timely fashion, acting as a narrative glue for disparate data from different ICS sections and branches collected through different methods. The CAIRR made a common operating picture possible for the hyperlocal response, allowing ICS leadership from the Incident Commander to Operational Leads to access a single, template-based report for situational awareness and informed decision-making, reflecting data collected in near-real time.

Different jurisdictions may find different geographic units more appropriate for the CAIRR and for a hyperlocal response. A few competing considerations are important to selecting a geographic unit. Administrative units are often selected because of data availability; response is not the ideal time to revamp statistical calculations to reshape epidemiological data. Reference Wang49 However, administrative boundaries may not reflect critical elements of a neighborhood such as community networks Reference Poland and Maré50,Reference Brown51 or common demographic characteristics. 52 Conversely, definitions of neighborhoods based on common demographics or community networks can be difficult operationally, requiring staff and partners in the field to navigate irregular operational boundaries. Another option is a grid-based system which does not take into account neighborhood dynamics or existing administrative boundaries, but simplifies turf-cutting and interoperability between jurisdictions. Reference Trainor53 Although the CAIRR can be adapted quickly if rough geographical information about partner catchment areas are available, units based on neighborhood dynamics or a grid system will require work in the preparedness phase to update quantitative and epidemiological analytic systems and to familiarize partners with new operational boundaries.

The NYC DOHMH used zip codes (defined as modified zip code tabulation areas 31 ) as its common geographical unit, sometimes extending operations to 2 or 3 adjacent zip codes depending on total area, population, and neighborhood context. Although zip codes in NYC often intersect haphazardly with community definitions of neighborhoods, they were a common enough boundary that community members, field staff, and groups outside of the jurisdiction had a reasonable understanding of the rough boundaries. Perhaps most critically, other ICS sections and branches had already established data systems for demographic, epidemiological, mobility, and other data at the zip code level. Still, use of zip codes did create confusion among external partners and community members about why 1 part of a community-defined neighborhood encompassing multiple zip codes was receiving attention while another was not; additionally, given that networks often extend across zip code lines, it is quite possible that responses may have missed drivers of transmission whose origin was just over the zip code border.

Rapidity and scalability in data collection

A salient feature of the CAIRR is the rapidity at which qualitative data are collected and analyzed; strategic partner selection is key to this rapidity. Through selection of well-connected and well-informed individuals from organizations that worked with a diversity of populations in each neighborhood, the NRTs were able to gather critical information on community perspectives and behavior, attaining thematic saturation after only a small number of interviews (see Table 1). Of note, while partner selection was easier in neighborhoods where the NYC DOHMH had strong pre-existing relationships, the model was still successful in other neighborhoods, although it required more effort to connect with new partners who were both informed and willing to participate. Partners also had an opportunity during the interview to request information and resources to support their COVID-19 prevention efforts, including webinars, literature, and data. This created a symbiotic relationship that went beyond the initial data collection process, and in some cases developed into an ongoing partnership with new partners, or deepened relationships with existing partners.

By design, the CAIRR did not attempt to obtain a representative sample of interview participants, but rather focused on strategic selection of key partners in the interest of rapid provision of appropriate services to those residents whose immediate, unmet needs the NYC DOHMH could gather specific data about. The CAIRR was intended to complement rather than replace more comprehensive research methods which may better assess the needs and assets of hard to reach communities but which may require more time to complete. Reference Vindrola-Padros, Chisnall and Cooper54,Reference Tremblay, Castiglione, Audet, Desmarais, Horace and Peláez55 Toolkits for rapid needs assessments do exist to achieve statistically representative qualitative data at the household level, particularly the Centers for Disease Control and Prevention’s (CDC) Community Assessment for Public Health Emergency Response (CASPER). 56 However, at the time the NYC DOHMH initiated the hyperlocal response, methods such as CASPER were not feasible. In particular, the CASPER requires field data collection; early in the COVID-19 response, staff were only deployed in-person if absolutely necessary due to SARS-CoV-2 transmission risk. Additionally, household-level sampling necessarily requires interviews with a random selection of community members. Trust in government was often very low amongst residents of neighborhoods experiencing high levels of SARS-CoV-2 transmission, while community partners such as faith-based organizations or mutual aid networks retained the confidence of their communities.

Other jurisdictions experiencing similar situational challenges or without the resources or the time to do comprehensive qualitative assessments can modify the CAIRR to enable rapid, hyperlocal, objective-focused emergency response applicable to their localities by leveraging the expertise of locally active community organizations.

An operational framework for analysis

The task of translating qualitative data to operations can be difficult and time consuming. The CAIRR, however, was designed with public health emergency operations in mind, particularly the primary objective of stemming SARS-CoV-2 transmission through a hyperlocal approach. Rather than explore root causes of disparities in SARS-CoV-2 transmission, the CAIRR adopted a simple, high-level operational framework for addressing transmission that was already in use in multiple ICS operations as an initial coding frame. Analysis did not begin with the question, ‘why is SARS-CoV-2 transmission different in some NYC neighborhoods than others?’ Instead, the CAIRR aimed to gather just enough data to deploy a field operation that met the specific needs of the neighborhood.

This approach facilitated rapid qualitative analysis and translation to objective-focused operations. Starting with the operational 4 strategy framework allowed analysts to begin with a deductive approach, guaranteeing the emergence of themes that could broadly inform operations at the neighborhood level and additionally saving time relative to approaching the full dataset inductively. Analysts could then use a secondary inductive approach leveraging matrix analysis methods within each of the strategies to qualify more granular neighborhood data (see Table 1), A similar process in which a high-level coding frame is mapped to potential operations prior to data collection has since been adopted in other emergency response toolkits, such as the CDC’s Vaccine Confidence Rapid Community Assessment. 57

Additionally, since the structured data collection and matrix analysis methods facilitated by the operational framework simplify an otherwise laborious process, the CAIRR can be adapted and implemented even in jurisdictions with limited qualitative research capacity. At the NYC DOHMH, NRT staff who brought other critical assets to the work (i.e., prior community engagement experience, fluency in relevant languages, and residence or lived experience in a community of focus) participated successfully as data collectors after just-in-time training in qualitative data collection. Similarly, the analytic team was limited to a small number of researchers with technical skills in Microsoft Excel (Microsoft Corp., Redmond, Washington, USA) who received just-in-time training on the analysis framework. This approach was not only sufficient to conduct the CAIRR, but also enriched its findings by leveraging the unique skills and abilities of individual team members. Furthermore, NRT staff who acquired new qualitative skills during the hyperlocal response simultaneously added to their own professional development and helped to increase NYC DOHMH’s overall qualitative research capacity, both for disaster response and for public health programming outside of an-emergency response context.

The value of the operational framework transcends its analytic speed and simplicity. Although community engagement response operations are often based on qualitative impressions of community needs, qualitative data without operational context can be difficult for leadership to respond to. By starting with an operational framework already familiar to leadership across the ICS, the NRTs were able to elevate timely data collected from impacted communities to leadership in language that was actionable and understandable. Additionally, the operational framework created a mechanism to “match” the community input represented in those data to existing operations categorized in the same strategy, thereby translating that input into governmental action within a few days (Table 1).

One should note that, significant adaptation of the operational framework in the midst of a response may require some forward planning, particularly around integration of CAIRR findings into citywide operations. For example, when themes around a potential COVID-19 vaccine emerged far ahead of any vaccine authorization, the CAIRR’s 4 strategy framework was easily expanded to include a fifth vaccine strategy for the purpose of data collection and analysis; however, the full benefits of these analyses could not be realized until they were integrated with neighborhood-level operational planning around vaccines.

Rapidity, flexibility, and other strengths of the CAIRR are not particular to the COVID-19 emergency nor to the specific operational framework used by the NYC DOHMH’s ICS. As long as a framework is consistent across the breadth of operational sections and branches in a response, jurisdictions can tailor the CAIRR to meet the demands of their individual objectives and associated operations.

Conclusion

Neighborhood-level differences in social vulnerability and community resilience create neighborhood-level differences in disaster impact, which demands a neighborhood-level response. Place-based approaches in public health acknowledge that the outcomes of structural racism and other inequities result in geographic differences within a jurisdiction. However, translation of the place-based approach to disaster response has previously been limited by the ability to collect timely, relevant qualitative data at the neighborhood level. In the face of mounting inequities in COVID-19 impact between neighborhoods, the NYC DOHMH developed the CAIRR, and consequently demonstrated the feasibility of a hyperlocal response to public health emergencies. The CAIRR produces the qualitative analyses necessary to tie together diverse emergency operations, contextualize complex datasets, and provide critical decision support to ICS leadership. While the CAIRR was not designed to produce comprehensive analyses at the neighborhood level, it is a scalable and flexible process that can be adapted for different jurisdictions facing different disasters and with different resource limitations. Jurisdictions seeking to implement a more equitable response can modify the CAIRR for their own hyperlocal responses to COVID-19 and future disasters.

Supplementary material

To view supplementary material for this article, please visit https://doi.org/10.1017/dmp.2022.135

Acknowledgments

We thank Torian Easterling (MD, MPH) and Demetre Daskalakis (MD, MPH) for their leadership and support, Jaimie Shaff (DrPH, MSc) for her insights into the operational framework and her support of the project, Corinne Thompson (PhD, MSc) for her input into the conceptual development of the project, and we thank all the Neighborhood Response Teams, and other Community Engagement Staff for their tremendous work in making this project a reality: Yisene Bello, Candida Bido, Karla Cabrera Carrera, Simone Colbert, Regina Conceicao, Stephen Cormier, Priscilla Dejesus, Isa Del Signore Dresser, Folake Eniola, Kim Freeman, Amanda Gonzalez, Terresa Gordon, Yomaha Gordon, Kisaan Howard, Padmore John, Beverly Johnson, Concessa Joseph, Jessie Lopez, Sharon Marshall-Taylor, Elana Martins, Shale Maulana, Gwendolyn McKenzie, Abigail Merced, Amjad Mujaahid, Ewel Napier, Zulma Novoa, Amina Pasha, Emmanuel Perez, Jose Quintana, Anita Reyes, Liz Rhee, Luis Rivera, Steven Rodriguez, Richard Sierra, Sherre Simmons-Bennett (in loving memory), Renasia Smith, Keira Sutton-Agnew, Masura Tidjani, Fernando Tirado, Alana Tornello, Kim Truong, and Shantel Tull.

Author contributions

All authors contributed to the writing of the paper. JM developed the COVID-19 Equity Officer role and organizational structure. MR created the initial concept, JM and MR produced the initial project plans, and secured project approval. HLH and MR led the overall project. JP developed the initial structure for the interview guide. RD, JP, LJS, and MAS led the final design of the interview guide and implementation of the process. SRB, JMC, AC, RD, HLH, JP, LJS, and MAS completed the qualitative data collection, analysis, and report preparation.

Conflicts of Interest

None.

Ethical standards

Activities described in the paper were authorized to drive public health action and not conducted for research. The survey described in the paper engaged organizations about the community and the write up is also descriptive and does not include a systematic investigation. IRB approval is not required for this paper. (Inquiry 9/15/2021)

References

Gonzalez-Reiche, AS, Hernandez, MM, Sullivan, MJ, et al. Introductions and early spread of SARS-CoV-2 in the New York City area. Science. 2020;369(6501):297-301. doi: 10.1126/science.abc1917 Google ScholarPubMed
Thompson, CN, Baumgartner, J, Pichardo, C, et al. COVID-19 Outbreak — New York City, February 29–June 1, 2020. MMWR. 2020;69. doi: 10.15585/mmwr.mm6946a2 Google ScholarPubMed
Chan, PY, Greene, SK, Woo, Lim S, Fine, A, Thompson, CN. Persistent disparities in SARS-CoV-2 test percent positivity by neighborhood in New York City, March 1–July 25, 2020. Ann Epidemiol. 2021;63:46-51. doi: 10.1016/j.annepidem.2021.07.032 Google ScholarPubMed
Ogedegbe, G, Ravenell, J, Adhikari, S, et al. Assessment of racial/ethnic disparities in hospitalization and mortality in patients with COVID-19 in New York City. JAMA Netw Open. 2020;3(12):e2026881. doi: 10.1001/jamanetworkopen.2020.26881 Google ScholarPubMed
Kalyanaraman Marcello, R, Dolle, J, Tariq, A, et al. Disaggregating Asian race reveals COVID-19 disparities among Asian American patients at New York City’s public hospital system. Public Health Rep. 2022;137(2):317-325. doi: 10.1177/00333549211061313 CrossRefGoogle ScholarPubMed
Yan, BW, Hwang, AL, Ng, F, Chu, JN, Tsoh, JY, Nguyen, TT. Death toll of COVID-19 on Asian Americans: disparities revealed. J Gen Intern Med. 2021;36(11):3545-3549.CrossRefGoogle ScholarPubMed
New York State Department of Health. New York City health indicators by race/ethnicity, 2016-2018. https://www.health.ny.gov/statistics/community/minority/county/newyorkcity.htm. Accessed October 27, 2021.Google Scholar
Medwinter, SD. Reproducing poverty and inequality in disaster: race, class, social capital, NGOs, and urban space in New York City after Superstorm Sandy. Environ Sociol. 2021;7(1):1-11. doi: 10.1080/23251042.2020.1809054 CrossRefGoogle Scholar
Faber, JW. Superstorm Sandy and the demographics of flood risk in New York City. Hum Ecol. 2015;43(3):363-378.CrossRefGoogle Scholar
Mattingly, C, Lawlor, M, Jacobs-Huey, L. Narrating September 11: race, gender, and the play of cultural identities. Am Anthropol. 2002;104(3):743-753. doi: 10.1525/aa.2002.104.3.743 Google ScholarPubMed
Bailey, ZD, Feldman, JM, Bassett, MT. How structural racism works — racist policies as a root cause of U.S. racial health inequities. N Engl J Med. 2021;384(8):768-773. doi: 10.1056/NEJMms2025396 Google ScholarPubMed
Bailey, ZD, Krieger, N, Agénor, M, Graves, J, Linos, N, Bassett, MT. Structural racism and health inequities in the USA: evidence and interventions. The Lancet. 2017;389(10077):1453-1463. doi: 10.1016/S0140-6736(17)30569-X Google ScholarPubMed
Fothergill, A, Maestas, EGM, Darlington, JD. Race, ethnicity, and disasters in the United States: a review of the literature. Disasters. 1999;23(2):156-173. doi: 10.1111/1467-7717.00111 Google ScholarPubMed
Maxwell, C. America’s sordid legacy on race and disaster recovery. Center for American Progress. Published April 5, 2018. https://www.americanprogress.org/issues/race/news/2018/04/05/448999/americas-sordid-legacy-race-disaster-recovery/. Accessed October 27, 2021.Google Scholar
Bethel, JW, Burke, SC, Britt, AF. Disparity in disaster preparedness between racial/ethnic groups. Disaster Health. 2013;1(2):110-116. doi: 10.4161/dish.27085 CrossRefGoogle ScholarPubMed
Shiman, LJ, Freeman, K, Bedell, J, Bassett, MT. Making injustice visible: how a health department can demonstrate the connection between structural racism and the health of whole neighborhoods. J Public Health Manag Pract. 2021;27(5):442-448. doi: 10.1097/PHH.0000000000001259 CrossRefGoogle ScholarPubMed
Nardone, A, Chiang, J, Corburn, J. Historic redlining and urban health today in U.S. cities. Environ Justice. 2020;13(4):109-119. doi: 10.1089/env.2020.0011 CrossRefGoogle Scholar
Novick, LF. Community segregation, redlining, and public health. J Public Health Manag Pract. 2021;27(5):435-436. doi: 10.1097/PHH.0000000000001403 CrossRefGoogle ScholarPubMed
The Institute for Family Health. Place based solutions to neighborhood health disparities; 2014. https://www.youtube.com/watch?v=Mhl80NVb9X0. Accessed October 27, 2021.Google Scholar
McGowan, VJ, Buckner, S, Mead, R, et al. Examining the effectiveness of place-based interventions to improve public health and reduce health inequalities: an umbrella review. BMC Public Health. 2021;21:1888. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-021-11852-z. Accessed October 27, 2021.CrossRefGoogle ScholarPubMed
Dankwa-Mullan, I, Pérez-Stable, EJ. Addressing health disparities is a place-based issue. Am J Public Health. 2016;106(4):637-639. doi: 10.2105/AJPH.2016.303077 CrossRefGoogle ScholarPubMed
Lowe, SR, McGrath, JA, Young, MN, et al. Cumulative disaster exposure and mental and physical health symptoms among a large sample of residents of the U.S. Gulf Coast residents. J Trauma Stress. 2019;32(2):196-205. doi: 10.1002/jts.22392 CrossRefGoogle ScholarPubMed
Nomura, S, Parsons, AJQ, Hirabayashi, M, Kinoshita, R, Liao, Y, Hodgson, S. Social determinants of mid- to long-term disaster impacts on health: a systematic review. Int J Disaster Risk Reduct. 2016;16:53-67. doi: 10.1016/j.ijdrr.2016.01.013 CrossRefGoogle Scholar
Gill, D, Ritchie, L. Considering cumulative social effects of technological hazards and disasters. Am Behav Sci. 2020;64(8):1145-1161. doi: 10.1177/0002764220938112 CrossRefGoogle Scholar
Muir, L. Whose plan is it?: the importance of place. Aust J Emerg Manag. 36(2):54-58. doi: 10.3316/informit.767305774573467 Google Scholar
Naylor, L, Fall, V, Fox, A. The power of place in disaster recovery: heritage-based practice in the post-Matthew landscape of Princeville, North Carolina. Parks Steward Forum. 2020;36(1). doi: 10.5070/P536146398 Google Scholar
Pierre, J, Letamendi, C, Sleiter, L, et al. Building a culture of health at the neighborhood level through governance councils. J Community Health. 2020;45(4):871-879. doi: 10.1007/s10900-020-00804-0 CrossRefGoogle ScholarPubMed
Beebe, J. Rapid Assessment Process: An Introduction. Rowman Altamira: Walnut Creek, CA; 2001.Google Scholar
Greene, SK, Peterson, ER, Balan, D, et al. Detecting COVID-19 clusters at high spatiotemporal resolution, New York City, New York, USA, June–July 2020. Emerg Infect Dis. 2021;27(5). doi: 10.3201/eid2705.203583 CrossRefGoogle ScholarPubMed
Cordes, J, Castro, MC. Spatial analysis of COVID-19 clusters and contextual factors in New York City. Spat Spatio-Temporal Epidemiol. 2020;34:100355. doi: 10.1016/j.sste.2020.100355 CrossRefGoogle ScholarPubMed
NYC: Modified ZCTA geography. https://nychealth.github.io/covid-maps/modzcta-geo/about.html. Accessed December 8, 2021.Google Scholar
Woc-Colburn, L, Godinez, D. Chapter 12 - Lockdown as a public health measure. In: Hidalgo, J, Rodríguez-Vega, G, Pérez-Fernández, J, eds. COVID-19 Pandemic. Elsevier; 2022:133-136. doi: 10.1016/B978-0-323-82860-4.00013-6 CrossRefGoogle Scholar
Averill, JB. Matrix analysis as a complementary analytic strategy in qualitative inquiry. Qual Health Res. 2002;12(6):855-866. doi: 10.1177/104973230201200611 CrossRefGoogle ScholarPubMed
Flanagan, BE, Gregory, EW, Hallisey, EJ, Heitgerd, JL, Lewis, B. A social vulnerability index for disaster management. J Homel Secur Emerg Manag. 2011;8(1). doi: 10.2202/1547-7355.1792 Google Scholar
Flanagan, BE, Hallisey, EJ, Adams, E, Lavery, A. Measuring community vulnerability to natural and anthropogenic hazards: the Centers for Disease Control and Prevention’s social vulnerability index. 2018;80(10):34-36.Google Scholar
Wolkin, A, Patterson, JR, Harris, S, et al. Reducing public health risk during disasters: identifying social vulnerabilities. J Homel Secur Emerg Manag. 2015;12(4):809-822. doi: 10.1515/jhsem-2014-0104 Google ScholarPubMed
Federal Emergency Management Agency (FEMA). A Whole Community Approach to Emergency Management: Principles, Themes, and Pathways for Action. 2011;FDOC 104-008-1:28.Google Scholar
Save the Children. Survivor- and community-led crisis response: practical experience and learning. Resource Centre. https://resourcecentre.savethechildren.net/document/survivor-and-community-led-crisis-response-practical-experience-and-learning/. Accessed October 27, 2021.Google Scholar
Cuthbertson, J, Archer, F, Rodriguez-llanes, J, Robertson, A. The social determinants of health in disaster risk reduction. Prehosp Disaster Med. 2019;34(s1):s95-s95. doi: 10.1017/S1049023X19001973 CrossRefGoogle Scholar
U.S. Department of Health and Human Services, Office of Disease Prevention and Health Promotion. Social determinants of health - Healthy people 2030. https://health.gov/healthypeople/objectives-and-data/social-determinants-health. Accessed October 27, 2021.Google Scholar
Dannefer, R, Wong, BC, John, P, et al. The neighborhood as a unit of change for health: early findings from the East Harlem Neighborhood Health Action Center. J Community Health. 2020;45(1):161-169. doi: 10.1007/s10900-019-00712-y CrossRefGoogle ScholarPubMed
Burström, B, Tao, W. Social determinants of health and inequalities in COVID-19. Eur J Public Health. 2020;30(4):617-618. doi: 10.1093/eurpub/ckaa095 CrossRefGoogle ScholarPubMed
Maness, SB, Merrell, L, Thompson, EL, Griner, SB, Kline, N, Wheldon, C. Social determinants of health and health disparities: COVID-19 exposures and mortality among African American people in the United States. Public Health Rep. 2021;136(1):18-22. doi: 10.1177/0033354920969169 CrossRefGoogle ScholarPubMed
Kaufman, HW, Niles, JK, Nash, DB. Disparities in SARS-CoV-2 positivity rates: associations with race and ethnicity. Popul Health Manag. 2021;24(1):20-26. doi: 10.1089/pop.2020.0163 CrossRefGoogle ScholarPubMed
Abrams, EM, Szefler, SJ. COVID-19 and the impact of social determinants of health. Lancet Respir Med. 2020;8(7):659-661. doi: 10.1016/S2213-2600(20)30234-4 CrossRefGoogle ScholarPubMed
Rollston, R, Galea, S. COVID-19 and the social determinants of health. Am J Health Promot. 2020;34(6):687-689. doi: 10.1177/0890117120930536b CrossRefGoogle ScholarPubMed
Singu, S, Acharya, A, Challagundla, K, Byrareddy, SN. Impact of social determinants of health on the emerging COVID-19 pandemic in the United States. Front Public Health. 2020;8:406. doi: 10.3389/fpubh.2020.00406 Google ScholarPubMed
Griffith, DA, Chun, Y, Lee, M. Deeper spatial statistical insights into small geographic area data uncertainty. Int J Environ Res Public Health. 2021;18(1):231. doi: 10.3390/ijerph18010231 CrossRefGoogle Scholar
Wang, Y. Comparison of methods for estimating prevalence of chronic diseases and health behaviors for small geographic areas: Boston validation study, 2013. Prev Chronic Dis. 2017;14. doi: 10.5888/pcd14.170281 CrossRefGoogle ScholarPubMed
Poland, M, Maré, DC. Defining Geographic Communities. Motu Economic and Public Policy Research; 2005. http://motu-www.motu.org.nz/wpapers/05_09.pdf. Accessed October 27, 2021.Google Scholar
Brown, P. Who is the Community?/What is the Community? Brown University Collaborative Initiative for Research Ethics. https://www.brown.edu/research/research-ethics/who-communitywhat-community. Accessed November 9, 2021.Google Scholar
CARTO. Stop using zip Codes for Geospatial Analysis. https://carto.com/blog/zip-codes-spatial-analysis/. Accessed October 27, 2021.Google Scholar
Trainor, T. Challenges for data dissemination: small geographic areas and statistical grids. Int Workshop Integrating Geospatial Stat Inf. Published online June 9, 2014. https://ggim.un.org/meetings/2014-IGSI_Beijing/documents/04_USA_UN_Grid_Admin_Trainor_6_5_14.pdf. Accessed October 27, 2021.Google Scholar
Vindrola-Padros, C, Chisnall, G, Cooper, S, et al. Carrying out rapid qualitative research during a pandemic: emerging lessons from COVID-19. Qual Health Res. 2020;30(14):2192-2204. doi: 10.1177/1049732320951526 Google ScholarPubMed
Tremblay, S, Castiglione, S, Audet, LA, Desmarais, M, Horace, M, Peláez, S. Conducting qualitative research to respond to COVID-19 challenges: reflections for the present and beyond. Int J Qual Methods. 2021;20:16094069211009680. doi: 10.1177/16094069211009679 Google Scholar
Centers for Disease Control and Prevention. Overview of Community Assessment for Public Health Emergency Response (CASPER). Published August 20, 2020. https://www.cdc.gov/nceh/casper/overview.htm. Accessed October 27, 2021.Google Scholar
Centers for Disease Control and Prevention. Examples of evidence-based solutions to increase vaccine confidence and uptake. Rapid Community Assessment Guide - COVID-19 Vaccination. https://www.cdc.gov/vaccines/covid-19/vaccinate-with-confidence/rca-guide/downloads/CDC_RCA_Guide_2021_Tools_AppendixG_InterventionTables-508.pdf Google Scholar
New York City Emergency Management. Citywide incident management system. https://www1.nyc.gov/site/em/about/citywide-incident-management-system.page. Accessed April 1, 2022.Google Scholar
Figure 0

Figure 1. Cumulative confirmed SARS-CoV-2 case rates by neighborhood in NYC (July 2020). The map illustrates the disparities in cumulative SARS-CoV-2 PCR postive case rates by neighborhood in NYC, with darker areas corresponding to higher case rates (range 645-4,587 per 100,000 residents) Neighborhoods are defined as modified zip code tabulation areas. Data are from July 31, 2020 but the disparities were evident before, and after this date. Data collection and analysis was carried out by the NYC DOHMH’s Surveillance and Epidemiology Branch, while the data were collated by the NYC DOHMH’s Integrated Data Team.

Figure 1

Table 1. Key themes by operational strategy to stem SARS-CoV-2 transmission

Figure 2

Table 2. Groups involved in the early implementation of the hyperlocal response

Figure 3

Figure 2. General timeline of hyperlocal response, including the CAIRR. The graphic illustrates a general timeline of the hyperlocal response in each neighborhood, beginning with neighborhood selection. The NRT assigned to a neighborhood’s borough was responsible for overseeing that borough. Shaded steps indicate the CAIRR, while those in outline were joint operational pieces. During the CAIRR’s early implementation, this timeline was executed once per neighborhood.

Supplementary material: PDF

Ray et al. supplementary material

Ray et al. supplementary material

Download Ray et al. supplementary material(PDF)
PDF 131.7 KB