Hostname: page-component-cd9895bd7-fscjk Total loading time: 0 Render date: 2024-12-27T12:21:02.222Z Has data issue: false hasContentIssue false

Unpacking second language writing teacher knowledge through corpus-based pedagogy training

Published online by Cambridge University Press:  04 July 2022

Nicole Schmidt*
Affiliation:
University of Arizona, United States (nicoleschmidt@arizona.edu)
Rights & Permissions [Opens in a new window]

Abstract

Corpus-based language teaching is one area of second language (L2) pedagogy in which L2 teachers may benefit from extensive guidance on how to integrate digital tools into pedagogical practices. Direct corpus approaches like data-driven learning (DDL) cultivate learner engagement and language discovery. However, second language writing (SLW) teachers face significant challenges using corpora in the classroom, and these challenges often go unaddressed in language teacher education, particularly for in-service teachers. This paper reports on a case study in which six university SLW teachers participated in an online corpus-based pedagogy workshop. Teachers developed DDL activity plans and wrote in reflective diaries. The analysis of these artifacts shows that the teachers tended to follow one of two paths toward knowledge integration, as either Planners or Seekers, when implementing corpus activities in their classrooms. The teachers also reported increased confidence in applying direct corpus methods to their lessons by the end of the workshops, though they expressed the need for continued, long-term support.

Type
Research Article
Creative Commons
Creative Common License - CCCreative Common License - BY
This is an Open Access article, distributed under the terms of the Creative Commons Attribution licence (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted re-use, distribution, and reproduction in any medium, provided the original work is properly cited
Copyright
© The Author(s), 2022. Published by Cambridge University Press on behalf of European Association for Computer Assisted Language Learning

1. Introduction

Corpus techniques garner language awareness in second language (L2) writers, consequently bolstering their writing proficiency, critical thinking skills, self-efficacy, and learner autonomy (Boulton & Cobb, Reference Boulton and Cobb2017). However, corpus approaches have yet to reach their full potential in the language classroom (Chen, Flowerdew & Anthony, Reference Chen, Flowerdew and Anthony2019; Pérez-Paredes, Reference Pérez-Paredes2022). This may be due to a lack of effective corpus-based training for L2 teachers (Chen et al., Reference Chen, Flowerdew and Anthony2019). Such training would ideally provide instruction on searching, analyzing, and interpreting corpus data, and guidance on how to evaluate the validity of these interpretations in specific communicative contexts (Ädel, Reference Ädel, Campoy-Cubillo, Bellés Fortuño and Gea-Valor2010). An effective corpus-based training would also cover a range of pedagogical strategies for developing students’ corpus literacy (Callies, Reference Callies, Kreyer, Schaub and Güldenring2016).

Despite such calls for an integrative approach, combining corpus techniques with pedagogical strategies, many teacher education programs isolate technology from its pedagogical application (Godwin-Jones, Reference Godwin-Jones2015), treating technology as a separate, general topic that is neither context nor content specific (Lee & Kim, Reference Lee and Kim2014). This results in a one-size-fits-all approach that ignores the individual needs of prospective teachers (Koehler & Mishra, Reference Koehler and Mishra2009).

Acquiring corpus literacy is a formidable hurdle for many teachers due to the time and effort it requires (Boulton, Reference Boulton2010; Çalışkan & Gönen, Reference Çalışkan and Gönen2018; Leńko-Szymańska, Reference Leńko-Szymańska2017). It should therefore be developed slowly and deliberately integrated into language teachers’ regular praxis. This agreement that corpus literacy is developed gradually and intentionally has lent itself to new inquiries regarding the integration of corpus knowledge with other knowledges required for language teaching.

The current study investigates the corpus literacy journey of six in-service university writing teachers, offering analysis of these teachers’ classroom practices and knowledge integration processes as they created and implemented data-driven learning (DDL) activities throughout their participation in a seven-week online corpus pedagogy workshop. This workshop was designed using the technology, pedagogy, and content knowledge (TPACK) framework (Mishra & Koehler, Reference Mishra and Koehler2006), which, unlike one-size-fits-all approaches to technology-focused teacher education, is a situated, integrative model of teacher knowledge.

2. Literature review

2.1 Data-driven learning and teaching

Data-driven learning (DDL) is a method for using corpora with language learners via direct classroom instruction. Tim Johns (Reference Johns1991) introduced this exploratory, inductive approach to corpus-based language teaching as an alternative to traditional prescriptivist grammar pedagogies, and recent scholarship has highlighted DDL’s potential to enhance L2 writing skills (e.g. Cotos, Reference Cotos2014; Han & Shin, Reference Han and Shin2017). However, most classroom-based corpus studies to date have focused on the student experience. Substantially fewer inquiries target DDL teacher training, and those that do tend to illuminate teachers’ perceptions and beliefs rather than their knowledge development. Teacher knowledge is one facet of language teacher cognition, which is defined as “the complex, practically-oriented, personalized, and context-sensitive networks of knowledge, thoughts, and beliefs that language teachers draw on” in their professional lives (Borg, Reference Borg2015: 272). Concepts and processes associated with teacher cognition include beliefs, interactive thoughts, decision-making, knowledge, motivation, attitudes, emotions, and identities (Schmid, Reference Schmid2017). These processes are envisioned as a complex, dynamic system, which integrates multiple facets of teachers’ internal processes (Feryok, Reference Feryok2010, Reference Feryok, Mercer and Kostoulas2018).

In one corpus-based teacher training study, Breyer (Reference Breyer2009) developed and taught a semester-long university course for EFL teachers. Following a learner-to-teacher approach, students viewed presentations and completed hands-on exercises before creating their own corpus activities. Breyer then analyzed students’ reflective writing and questionnaire responses to determine how they perceived the role of the teacher in corpus-based pedagogy. This study was largely conceptual; as all participants were pre-service teachers, they did not practice teaching their activities within an authentic context. Çalışkan and Gönen (Reference Çalışkan and Gönen2018) created and delivered a four-week corpus-based pedagogy workshop focused on vocabulary development for in-service EFL teacher trainees. Like Breyer’s study, participants in this study experienced the role of the student, completing coursework before designing and implementing their own corpus activities, but unlike Breyer’s study, these participants also implemented their activities in their respective classrooms. After the workshop, student teachers’ perceptions of corpus teaching were analyzed through semi-structured interviews, reflective logs, and questionnaires. Both studies produced valuable insight into the teacher trainees’ perspectives about corpus pedagogy and the need for in-service teacher training, though neither evaluated teacher knowledge development.

Other studies have integrated corpus tools into existing teacher education curricula. Farr (Reference Farr2008) introduced two consecutive semester-long courses into an ELT master’s program. Corpus research skills were taught the first semester, and a theory and practice module addressing the “use of ICT for teaching purposes” (p. 31) was delivered in the second semester. After taking these courses, student teachers completed a questionnaire to share their views on the corpus component of their studies. Again, this study focused on teacher perceptions rather than teacher knowledge and emphasized using corpora for research rather than teaching. Zareva (Reference Zareva2017) also integrated corpus literacy training into an existing master’s level grammar course to explore TESOL teachers’ “opinions, attitudes, and recommendations” on using corpus tools (p. 70). During five lessons in the semester-long grammar course, students workshopped using corpus tools to explore grammar topics. While this additional corpus literacy training guided them to conduct linguistic research, it did not focus on teaching with corpora.

In a rare corpus study exploring teacher knowledge development, a group of MA TESOL trainee teachers completed a four-week training embedded into an existing vocabulary teaching course (Ma, Tang & Lin, Reference Ma, Tang and Lin2021). Drawing from Shulman’s model of pedagogical content knowledge, the authors divided this training into two main sections: corpus literacy development (knowing how to work with a corpus) and corpus-based language pedagogy (knowing how to integrate corpus tools into the classroom for meaningful learning). Participants attended corpus literacy workshops and collaborated to produce corpus-based lesson plans. Most reported substantial gains in their corpus literacy, and the lesson plans demonstrated increased competence implementing corpus techniques. Based on these promising results, the authors argue that teacher trainees need to develop corpus literacy before practicing corpus-based pedagogy. However, the authors do not articulate how teachers approached lesson design nor how lesson design related to knowledge development. In a similar study, Ma, Yuan, Cheung and Yang (Reference Ma, Yuan, Cheung and Yang2022) followed two language teachers who each attended corpus workshops and designed and implemented a corpus activity in their classrooms. Although Ma et al. uncovered valuable insight into the complexity of the interacting knowledge domains involved in corpus-based language pedagogy, they did not implement an iterative approach utilizing reflection and redesign into their exploration of teacher knowledge development. Unlike these studies, the current study analyzes the interplay between teachers’ DDL activity design approaches and their knowledge development as they create, reflect on, and revise three separate DDL activities.

2.2 Designing DDL teacher training programs

Among the corpus studies investigating teachers’ needs, knowledge, and perceptions, widespread consensus exists on how to teach corpus pedagogy to pre- and in-service teachers. Recommendations include starting corpus training as early as possible, during the initial pre-service training, and extending support to in-service initiatives (Çalışkan & Gönen, Reference Çalışkan and Gönen2018). Furthermore, DDL training should be structured so that “student teachers can experience the use of corpora for language learning from two perspectives: as learners and as teachers” (Breyer, Reference Breyer2009: 167).

Finally, most agree that corpus-based pedagogy is complex because teachers not only have to “assess the materials for their appropriateness in the respective learning context” but also must possess enough corpus literacy to “teach with these materials and integrate them meaningfully into the classroom” (Breyer, Reference Breyer2009: 156). To address this complexity, teachers need learning experiences that carefully scaffold corpus technology, research-focused skill development, and the situated application of corpus-based lessons into the classroom (Ma et al., Reference Ma, Tang and Lin2021; Zareva, Reference Zareva2017). Such training integrates the various skills teachers need to use corpus technology with their students. Pérez-Paredes (Reference Pérez-Paredes2022) found that the integration of technology and pedagogy is central to teaching DDL. Vyatkina (Reference Vyatkina, Kruk and Peterson2020) likewise discovered that “only a deep understanding of pedagogy, technology, and their interaction by teachers can lead to a successful implementation of instructional innovations” (p. 325). Leńko-Szymańska (Reference Leńko-Szymańska2017) addressed similar claims by citing the need for a conceptual model of teacher education that integrates technological skills, corpus linguistics knowledge, and pedagogical knowledge. As Boulton and Cobb’s (Reference Boulton and Cobb2017) meta-analysis revealed, such integrative learning experiences should also be situated within the context of teachers’ daily routines. Boulton (Reference Boulton2010) similarly asserts that teachers need training on “the implementation of DDL rather than the [isolated] nature of the techniques themselves” (p. 535).

Thus, it is established that DDL teacher training requires the integration of a complex knowledge base consisting of corpus literacy and corpus-based pedagogy, and it should be situated within a teacher’s daily learning and teaching environments. It is also a long-term endeavor, lasting well into a teacher’s in-service years. However, what remains to be articulated is precisely how teachers develop the complex knowledge base required for DDL implementation. The current study offers an integrative, situated model of DDL teacher training to monitor and hone this knowledge development for in-service second language writing (SLW) teachers.

2.3 The TPACK framework

The training developed for this study was designed in accordance with Mishra and Koehler’s (2006) framework of TPACK. The TPACK framework provides a theoretical foundation for explaining the integrated knowledge that a teacher must possess to implement technology for meaningful learning (see Figure 1). TPACK, emerging from professional development research of faculty in higher education, is based on the premise that teachers possess multiple knowledge domains (i.e. technological, pedagogical, and content knowledge) that interact with each other as a complex system during the act of teaching. TPACK is an extension of Shulman’s (1986) model of pedagogical content knowledge (PCK), with technological knowledge as an added construct.

Figure 1. TPACK framework. Reproduced with the permission of the publisher, © 2012 by tpack.org

In existing literature, TPACK has been applied to structure teacher education and to empirically investigate how teachers learn new skills and practices. TPACK is especially well suited to DDL teacher training due to its emphasis on both situated knowledge, or knowledge that teachers gain from practice (Angeli, Valanides & Christodoulou, Reference Angeli, Valanides, Christodoulou, Herring, Koehler and Mishra2016), and situated practice, which involves using one’s knowledge directly in the classroom (McLaughlin, Reference McLaughlin, Hargreaves, Lieberman, Fullan and Hopkins1998). Importantly, the situated nature of teacher cognition cannot be extracted from its physical environment and studied in an isolated fashion (Kubanyiova & Feryok, Reference Kubanyiova and Feryok2015). Like DDL training, TPACK-based training should be orchestrated in a way that allows teachers to apply what they are learning directly to their teaching (Angeli & Valanides, Reference Angeli and Valanides2009). Although few previous studies have applied the TPACK framework to design a corpus-based pedagogy workshop, the workshop design of the current study was influenced by various TPACK-based professional development initiatives (Jaipal Jamani & Figg, Reference Jaipal Jamani, Figg and Ivala2013; Lee & Kim, Reference Lee and Kim2014; Koh & Divaharan, Reference Koh and Divaharan2011; Tai, Reference Tai2015).

This case study explores in-service SLW teachers’ knowledge integration practices throughout their participation in a seven-week online DDL-TPACK workshop. During the workshop, each teacher’s use of DDL was explored through their lesson planning and reflective diaries to answer the following research questions:

  1. 1. What kinds of techniques and strategies do SLW teachers use when they integrate DDL in their classrooms?

  2. 2. How do SLW teachers apply TPACK when integrating DDL in their classrooms?

3. Method

3.1 Procedure

The purpose of this case study was to explore teachers’ knowledge integration processes as they completed workshop activities. After inductively establishing a set of open codes, these codes were deductively aligned with the TPACK knowledge domains. Such a case study as this is exploratory, and results are not intended to be generalizable. The goal was to implement an online workshop that builds teachers’ technological, pedagogical, and content knowledge of DDL for the SLW classroom. The principal investigator developed and facilitated the workshop and was, at the time of the study, a colleague (of equal rank) of each participant. The seven-week workshop, delivered via one southwestern US university’s learning management system, occurred during the fall 2018 semester. Throughout the workshop, teachers developed and implemented DDL course materials using a variety of corpora, including MICUSP, the BYU-BNC corpus, Crow (https://writecrow.org/), COCA, and AntConc concordance (http://www.laurenceanthony.net/) software.

3.1.1 Participants

Six SLW instructors from the same southwestern university were recruited via convenience sampling for this study (Table 1). A departmental email was sent to all writing program instructors via an official listserv; 18 of these instructors were SLW teachers. The first six respondents who were (1) actively teaching SLW students during the workshop session and (2) had minimal previous exposure to corpus linguistics were selected to participate. Only one of the teachers, Sabina (all names are pseudonyms), had undergone formal training in using a corpus. Sabina was exploring the use of corpus techniques for her dissertation in rhetoric, but she was unfamiliar with corpus-based pedagogy. Carlos and Lydia had heard about corpus linguistics from past professors, but neither had attempted to use one in their teaching. No participants had used a corpus in their writing classes before the study.

Table 1. Background of the participants

All six teachers, five females and one male, taught English composition to international university students. Carlos, Lydia, Maya, Pinar, and Alya taught either English 106, 107, or 108 courses, designed exclusively for SLW students. The sixth teacher, Sabina, taught English 101, built for domestic students, but had several English learners in her course. Sabina was a PhD student in rhetoric and composition. Sabina and Lydia, a full-time writing program lecturer, were US citizens. Alya and Pinar were Turkish PhD students studying L2 acquisition and teaching at the university. Carlos, a master’s student from Mexico, and Maya, a master’s student from Brazil, also studied L2 acquisition. All teachers spoke fluent English and had at least one year of experience teaching English language skills.

3.1.2 Workshop design

The workshop was divided into seven modules, one module to be completed per week. Each module applied a TPACK construct to DDL pedagogy. Module 1, the content knowledge (CK) module, involved a theoretical overview of corpus linguistics. Activities included conducting simple corpus searches, analyzing concordances, and relating corpus linguistics to language learning. The second module covered pedagogical knowledge (PK) and emphasized DDL teaching strategies. Module 3, the technological knowledge (TK) module, introduced teachers to the digital tools required for teaching corpus techniques, including online corpora and concordance software. In this module, teachers were guided to perform such tasks as importing corpus data into the AntConc concordance program, running coded searches, and exporting concordance data into spreadsheets. Following this, the technological pedagogical knowledge (TPK), technological content knowledge (TCK), and PCK modules (Modules 4, 5, and 6 respectively) explored the intersections between knowledge domains (see Table 2). The final week of the series combined all knowledge domains (TPCK) as teachers finalized instructional materials, used them in the classroom, and reflected on the experience.

Table 2. Corpus pedagogy workshop design

Each module began with an explicit discussion of TPACK to familiarize teachers with the knowledge domain targeted in that module. Following this were readings, activities, and interactive video lectures to engage teachers in pedagogical conversation about the module theme. During the final four weeks, teachers designed their own DDL activity sequence. They shared their activities with each other and offered feedback through asynchronous online discussions. At the end of each module, they reflected on what they had learned that week, created revision plans for their DDL activities, and submitted revised lessons from the previous week. This established an iterative redesign cycle within each module.

3.2 Data collection

Data collection included teachers’ DDL instructional materials, reflections, and revision checklists. Each teacher participant created and piloted three DDL activities in their classes. Activity descriptions were posted to the learning management system (LMS) discussion board, where peers were assigned to provide feedback. Additionally, weekly reflective diaries were posted privately in the LMS. In these reflections, participants described what they had learned from workshop activities, and they created a revision checklist for the DDL activity they had taught that week. The prompts for DDL activities, reflective diaries, and revision checklists can be viewed online as supplementary material.

3.2.1 Instructional materials

During the third and fourth weeks of the workshop series, each teacher selected a topic, or several topics related to their writing course, and used these topics to develop a sequence of DDL activities for their classes. During Weeks 5, 6, and 7, they developed and tested one new DDL activity each week. For each activity, they received a template to guide their response. Activities and supplementary materials, like worksheets, were posted to the LMS and were downloaded, archived, and analyzed. An example DDL activity description can be found in Figure 2.

Figure 2. Alya’s DDL Activity 1

3.2.2 Teacher reflections

In weekly reflective diaries, teachers described what they had learned during the workshop activities. In Modules 4–7, teachers critiqued their own DDL activities, reflecting on how the activities were applied in the classroom. They also reflected on peer feedback from other participants’ DDL activities, following prompts to guide their reflections.

3.2.3 Revision checklists

Along with weekly reflections, for Modules 5–7 of the workshop, each teacher submitted revision checklists for the DDL activity taught that week. The following week, they submitted their revised activity for feedback. An example of a participant reflection and revision checklist can be found in Figure 3.

Figure 3. Sabina’s Module 5 Reflection.

Note. Higher resolution versions of this figure can be viewed online as supplementary material

3.3 Data analysis

Data analysis consisted of two consecutive phases of coding. The inductive phase involved open coding (Saldaña, Reference Saldaña2013), and the deductive phase involved selective coding, using TPACK pre-codes (Lee & Kim, Reference Lee and Kim2014; Simons, Reference Simons2009) derived from the definition of each knowledge domain (see Table 3). To ensure reliability, the principal investigator recoded her data two months after the initial coding occurred.

Table 3. TPACK pre-codes

To answer the first research question, explaining each teacher’s DDL approach, teacher-created course materials and revision checklists were analyzed. An initial round of open coding targeted how each teacher developed their DDL activities. This open coding resulted in five codes: course embeddedness, lesson focus, corpus analysis, corpus tools, and content representation (see Table 4). These five open codes were discovered through an exploratory process that began by reading each text and adding general comments in the margins. Eventually, categories were designated for each comment, and through constant comparison of these categories, open codes were identified.

Table 4. Open codes and pre-codes

Open codes were analyzed for each teacher and then summarized across teachers. In the process of comparing codes across teachers, two dominant themes emerged, distinguishing each teacher as either an “Planner” or a “Seeker.” The Planner/Seeker patterns arose organically, based on the repeated observation that each teacher was either orchestrating DDL activities to support one main pedagogical goal or, conversely, they were using the DDL activities to explore a variety of pedagogical goals.

For the second research question, regarding the teachers’ use of TPACK, DDL open codes from RQ1 were mapped to the TPACK pre-codes and triangulated with teachers’ reflective diaries. In this mapping process, each open code was paired with the TPACK knowledge domain with which it was most closely aligned (see Table 4). Teacher’s reflections were layered into the analysis to provide insight into underlying knowledge processes.

4. Results

The participating teachers brought their unique backgrounds and teaching experiences to the corpus pedagogy workshop. Despite individual differences, two distinct knowledge integration approaches were discovered. Teachers tended to develop their DDL sequences either as Planners, who “stuck to the script” that they had prepared in advance, or as Seekers, who experimented with a patchwork of tools and techniques for teaching writing in a more improvisational manner.

It is important to acknowledge that Planner/Seeker approaches represent dual ends of a descriptive spectrum rather than strictly categorical or mutually exclusive phenomena. They describe trends found in the data, not the teachers themselves. Within the context of this workshop, some teachers displayed more Planner attributes, and others displayed more Seeker attributes. In this section, the open codes are used to characterize the Planner and Seeker paths to DDL knowledge integration, followed by a discussion of how the knowledge domains of TPACK were used when implementing DDL.

4.1 Lesson focus, corpus tools, and corpus analysis

The so-called Planners (Sabina, Lydia, and Alya) exhibited consistency and cohesion of corpus tools, corpus analysis, and lesson focus across their DDL activities. The Seekers (Maya, Pinar, and Carlos), conversely, experimented with myriad representations of instructional content and used various digital tools, corpus analysis techniques, and lesson topics across their three DDL activities.

As for her approach to DDL integration, Lydia offered clear signs of a Planner. She experimented less than the other teachers but compensated for this with consistency. In each activity, she utilized the same corpus (COCA), explored the same grammar point (prepositions), and employed the same analysis technique (concordance). Each lesson was reinforced through homework and in-class review at the start of the subsequent lesson. Similarly, Alya designed her three activities around the same lesson focus (reporting verbs), employing similar analyses (concordance) in her final two activities, and using the same corpus tools (AntConc and a self-developed mini-corpus of academic journal articles) in all three activities. Sabina developed a three-part lesson on register variation and used the same corpus (student-developed mini-corpus of spoken and written arguments) across all three activities, although her topic evolved slightly, from general register variation to a more focused rhetorical exploration of questions in written versus spoken language.

Carlos, in contrast, clearly exhibited the characteristics of a Seeker. His first lesson focused on the syntax and rhetorical functions of pronouns, determiners, and verbs across multiple genres (e.g. annotated bibliography, interview report, argumentative paper) using the Crow corpus. His second activity explored syntactic patterns accompanying affixes, using the BYU-BNC corpus, and his final activity was a syntactic analysis of random words selected by his students, allowing their choice of either MICUSP or Crow as a corpus tool.

Like Carlos, Maya leapt from Crow to MICUSP mid-sequence. Her analysis techniques transitioned from concordance to frequency to genre analysis, although she held a consistent focus on conjunctions as a lesson topic. Pinar dabbled in specific lexical constructions (“be allowed to” and “be supposed to”) in her first activity, coordinating conjunctions in her second activity, and rhetorical analysis of source integration in her third activity. She also transitioned from COCA and Crow to the MICUSP corpora as her topics evolved.

Interestingly, Planners began creating DDL activities by assessing students’ writing needs, whereas Seekers implemented dynamic assessment methods, learning about students’ needs as their courses progressed. Lydia, a Planner, noted in her second reflection, “I have just finished reading my students’ rhetorical analysis essays, and I have a list of language features where I think DDL would be helpful.” She chose one of those language features, prepositions, and used it in all three lessons. Lydia asked her students, who “indicated a desire to gain more proficiency with prepositions,” to help her choose the topic for this assignment. Thus, she was able to embed DDL content into the writing curriculum while also being responsive to student needs. Similarly, Alya, when planning her first DDL activity, “put myself into the shoes of the students when I decided on what kind of activities would work.”

On the other hand, Pinar, a Seeker, reflected on how, throughout the workshops, she had gradually sharpened her focus on her students:

… when we first talked about a DDL sequence, I did not think critically about the needs of my students. However, as time went by, I deduced (and even asked my students) what would be important to study in the class as a corpus DDL activity.

Meanwhile, Carlos structured his DDL activities in a way that allowed his students to “take the lead and discuss their own grammatical problems and ways that they could use corpus.”

In addition to lesson focus, corpus technology was another distinguishing factor. Generally, Planners selected technology to help them meet predetermined pedagogical goals. Alya’s decisions about corpus tools were based on her pedagogical goal of showing students “how reporting verbs could be explored in an ‘academic’ corpus.” She had initially intended to create her own corpus and analyze it using AntConc, but when she realized that she could analyze academic writing with the COCA corpus, she incorporated this corpus into her activity plans, noting her fear of technical constraints:

I was also afraid to use AntConc because in case of a failure that the students could have experienced while downloading the program. I would probably not be able to help them, which could ruin all the following activities.

Planners expressed trepidation over using tools with which they were not yet entirely comfortable. As Lydia explained, “I am the type of learner who needs to review unfamiliar things, like certain technology, several times in order to feel comfortable using it.”

Seekers, on the other hand, were content to experiment with new technologies, to take risks, and to learn from them. They were also more open to defining pedagogical goals spontaneously as they went along. Carlos, reflecting on his final activity, in which he gave his students a choice of three corpora (COCA, MICUSP, and Crow), wrote, “I liked giving them a chance to go and choose their own.” Pinar, who tried each tool presented in the workshops, spontaneously transitioned from COCA to Crow in the middle of her first activity because she realized during the writing lesson that she wanted students to compare native speaker language use (in COCA) with English learner use (in Crow). Although she felt that “it would be better to use one platform,” Pinar also believed introducing multiple corpora gave her more troubleshooting options. Finally, Maya, who experimented with both Crow and MICUSP, noticed that Crow exposed students to genres that they were using in their English course, whereas MICUSP offered authentic “examples of texts from disciplines [students] are pursuing in their majors.”

4.2 Course embeddedness

Course embeddedness, or the extent to which the DDL activities were integrated into the writing course curriculum, was another point of distinction between Planners and Seekers. Planners tended to embed DDL activities into their courses by connecting them to major writing projects. Lydia, for instance, integrated her DDL sequence into a public argument assignment, explaining in her final reflection that embeddedness had been a long-term predetermined goal:

My understanding of corpus-based teaching has changed in that I have learned to scaffold and to incorporate the activities into the rest of the unit. I know this may sound obvious, but it was not until this workshop that I began to realize the importance of this organization and implementation.

Alya, another Planner, developed a three-part lesson on reporting verbs to prepare her students for the upcoming argumentative essay assignment, stating she hoped these activities would help students “integrate sources into their essay using various reporting verbs.” The third Planner, Sabina, explained that her corpus activities would guide students to “understand how questions function rhetorically [to] help them prepare for [their graded] presentation.”

Seekers, however, targeted language issues not explicitly linked to course content. Pinar did not explain her topic selection, but Carlos described how his second activity resulted from his general perception that “prefixes and suffixes are a big part of the English language, and I know that some students study them heavily to get good scores on the TOEFL test.” In his third activity description, Carlos expressed that he was less concerned about targeting a specific grammar point than cultivating students’ “general appreciation/understanding of corpus, so that they might use it later in their academic careers.”

Maya’s activity selection was not embedded into the writing course per se, but it was based on her assessment of student needs (“I have noticed that conjunctions are tricky for most of them, [so] I prepared a lesson about that grammar topic”). In her final activity description, Maya stated that her current and previous activities were meant to support students in completing their argument narrative assignment and their rhetorical analysis essay, but this connection was not stated in earlier activity descriptions or reflections, which suggests that Maya, a Seeker, gradually began to embed her DDL activities into the curriculum.

Like Planners, Seekers were concerned with course embeddedness, although their course content showed that they did not practice it as much as the Planners. Pinar reflected on her attempt to connect her final DDL activity to other course content, though she had not mentioned this in previous activity plans. Carlos considered embedding DDL activities into his course before he developed his lessons, but he did not ultimately do so. Maya expressed that she was concerned with embeddedness, but she was uncertain how to achieve it. This suggests that Seekers were actively thinking about ways to pursue course embeddedness, although this practice was not clearly reflected in their DDL content.

4.3 Content representation

Regarding content representation, Planners were more likely to use computer-based approaches whereas Seekers preferred paper-based methods. In one reflection, Alya wrote of paper-based materials: “I do not prefer to use such mechanical practices in my classes, as I do not see them as authentic enough for the students.” Sabina also explained that her students tended to use computers in her class, though she did not explicitly connect this to her decision for computer-based DDL. Lydia, however, transitioned from a paper-based to a computer-based approach. While her first DDL activity was paper-based, her second was computer-based because she had not found the time to create a worksheet before the lesson. She was surprised that her pacing had improved without the worksheet, remarking that “it worked out for the best.” So she continued with computer-based content for her third activity.

Conversely, Pinar, a Seeker with some Planner attributes, initially expressed a preference for computer-based DDL because she saw it as more “flexible and enhanced.” However, she ultimately transitioned to using paper-based worksheets for all three DDL activities, finding the worksheet approach extremely useful for classroom management (“Everything went well as I used a worksheet again. The students followed each step with me. I was able to control the students.”). Other Seekers concurred that paper-based approaches were easier and safer options. Carlos elaborated on this sentiment, stating his intention to “start with a paper corpus [activity] just to get students – and myself – a bit more comfortable with corpus.” Maya also wrote, “Based on the context of my class and on the fact that students are novice to corpus, I would use paper-based resources.”

5. Discussion

From the Vygotskian (1987) perspective, concept development becomes unified when teachers integrate a coherent set of ideas and practices into their daily routines. The current study uncovered the knowledge processes of six in-service SLW teachers as they attempted to integrate new and complex concepts into daily praxis. Although the teachers expressed and demonstrated knowledge gains after completing the workshop, the concepts embodied by corpus pedagogy had not yet been united into a coherent system for them.

The main finding of this study is that teacher participants tended to follow one of two overarching patterns of knowledge integration using corpus tools in the classroom. They either planned a coherent DDL sequence, or they experimented with a variety of corpus tools, techniques, and pedagogical goals. Notably, all teachers strove for embeddedness, though Seekers did not generally achieve it to the degree that the Planners did. Perhaps the curiosity to explore a variety of tools and techniques deprioritized course embeddedness for Seekers. Teacher reflections suggest that some Seekers simply did not know how to embed their DDL activities into their courses effectively, despite their motivation to do so. At least once during the workshop, each teacher expressed a desire to integrate DDL activities into the writing curriculum. This is a promising finding, as syllabus integration is a laudable goal within the field of DDL research (Crosthwaite, Luciana & Schweinberger, 2021; Pérez-Paredes, Reference Pérez-Paredes2022). Ultimately, the ability to meet such a goal was likely impacted by contextual factors like teaching experience. Lydia and Alya, who displayed the most dominant Planner attributes, had each taught writing for 10 years at the time of the study. The Seekers, Maya and Pinar, had taught SLW for two years, and Carlos had taught for only one year.

Finally, it is important to reiterate that the Planner–Seeker spectrum describes knowledge integration processes based on empirical data; this does not encompass the more complex notion of teacher cognition, which, according to Borg (Reference Borg2015) includes “what language teachers think, know and believe” (p. 1). Teachers’ internal processes are complex and dynamic (Feryok, Reference Feryok, Mercer and Kostoulas2018) and often lead to inconsistencies that cannot be categorically reduced. For example, there were instances when Seekers, like Maya, displayed Planner attributes by eventually embedding her DDL activities into regular course content. In other instances, Planners, like Alya, who changed her selection of corpus tools after learning more about them, acted as Seekers. As this was a case study, it was meant to be exploratory and hypothesis generating rather than generalizable to all SLW teachers.

6. Implication and suggestions

Everyone learns differently, but when teacher-developed content and teacher reflections are analyzed, patterns emerge. The fact that all teachers wanted to embed new practices into their existing curriculum suggests that syllabus integration could be a goal for future in-service teacher training initiatives. However, trial and error is equally, if not more, important than embeddedness to some teachers. Considering this, it is advisable for future DDL teacher trainings to provide space for exploration while scaffolding explicitly toward course embeddedness.

Another important finding of this study is the clear need for long-term teacher support, especially considering the complexity of DDL. Although each teacher progressed in their knowledge and application of DDL during the workshop, this progress was sometimes hampered by frustration. Like previous studies (Abdel Latif, Reference Abdel Latif2021; Çalışkan & Gönen, Reference Çalışkan and Gönen2018), the teachers acknowledged their increased language awareness through their participation in the workshop while also reflecting on their difficulties navigating corpus technology. One conclusion, similar to Leńko-Szymańska’s (2014), is that SLW teachers need long-term guidance to fully conceptualize and implement corpus-based techniques. Seven weeks, or even a full semester of training, may not be enough. On an optimistic note, in correspondence with Ebrahimi and Faghih (Reference Ebrahimi and Faghih2017), these struggles evoked metacognitive awareness and inspiration to continue using corpora in the classroom. In her final reflection, Alya summarized the general sentiment expressed by most participants:

These seven modules have provided me with a brief introduction to the use of corpus in language classes. I cannot say that I feel very confident now about the use of corpus tools in my classes, or I know how to use them exactly for various purposes, yet I believe that I had a nice mini step into the corpus world, and it is a matter of creativity and practice from now on.

7. Conclusions and limitations of the study

This workshop offered in-service SLW teachers a situated professional development opportunity to integrate DDL into their teaching. Its main contributions are twofold. First, it applied an empirically validated framework of teacher knowledge to structure the workshop and to analyze how teachers approached DDL activity design in response to workshop guidance. Also, it identified two possible pathways to teacher knowledge development, as either Planners or Seekers. These knowledge integration approaches support the notion of differentiated structures for teacher education. As Harris (Reference Harris, Herring, Koehler and Mishra2016) noted in her review of TPACK professional development models, there is no “one-size-fits-all” approach. Teacher educators should consider the full range of professional development approaches and methods to suit a particular context.

While this study has contributed some valuable results to the literature, there were several limitations that should not be ignored. An important part of teacher education research is the setting in which the teaching occurs (Cook, Smagorinsky, Fry, Konopak & Moore, Reference Cook, Smagorinsky, Fry, Konopak and Moore2002). Much teacher cognition research has explored the “ecologies of teachers’ inner lives without considering how this connects to student learning” (Johnson & Golombek, Reference Johnson and Golombek2020: 125). Although the current study applied a situated approach to the workshop design, it did not consider each teacher’s actual teaching environment. Future studies might observe DDL activities within a classroom setting, evaluating the connection between teachers’ experiences in the workshop and their students’ learning. Moreover, while this study yielded insight into the knowledge integration processes of SLW teachers, the data analysis did not focus on the efficacy of the workshop. A future study could adopt a design-based approach to evaluate the workshop according to the Planner/Seeker patterns identified in this study.

Finally, this study merely grazes the surface regarding the complex relationship between corpus-based pedagogy and the university SLW teachers’ TPACK. Not only were the teachers grappling with new pedagogical and technological knowledges, but they were also sifting through multiple layers of content knowledge (i.e. language acquisition, university writing, corpus linguistics), along with pre-existing teaching, learning, and language ideologies. Future DDL research could probe more deeply into the complex web of teacher ideology, practice, and knowledge.

Ethical statement and competing interests

This study was approved by the Institutional Review Board (IRB) at the University of Arizona. Voluntary consent was obtained for all participants using an IRB-approved protocol. All data were de-identified, and pseudonyms were used for each participant. The author declares no competing interests in this research.

About the author

Nicole Schmidt earned her PhD in second language acquisition and teaching from the University of Arizona, where she investigated language teacher cognition and technology integration in second language writing courses. She has taught undergraduate composition and English as a second/foreign language in the United States, Japan, the Netherlands, and Spain.

Author ORCIDs

Nicole Schmidt, https://orcid.org/0000-0003-1151-9310

References

Abdel Latif, M. M. M. (2021) Corpus literacy instruction in language teacher education: Investigating Arab EFL student teachers’ immediate beliefs and long-term practices. ReCALL, 33(1): 3448. https://doi.org/10.1017/S0958344020000129 CrossRefGoogle Scholar
Ädel, A. (2010) Using corpora to teach academic writing: Challenges for the direct approach. In Campoy-Cubillo, M. C., Bellés Fortuño, B. & Gea-Valor, M. L. (eds.), Corpus-based approaches to English language teaching. London: Continuum International Publishing Group, 3955.Google Scholar
Angeli, C. & Valanides, N. (2009) Epistemological and methodological issues for the conceptualization, development, and assessment of ICT–TPCK: Advances in technological pedagogical content knowledge (TPCK). Computers & Education, 52(1): 154168. https://doi.org/10.1016/j.compedu.2008.07.006 CrossRefGoogle Scholar
Angeli, C., Valanides, N. & Christodoulou, A. (2016) Theoretical considerations of technological pedagogical content knowledge. In Herring, M. C., Koehler, M. J. & Mishra, P. (eds.), Handbook of technological pedagogical content knowledge (TPACK) for educators (2nd ed.). New York: Routledge, 1132. https://doi.org/10.4324/9781315771328 Google Scholar
Borg, S. (2015) Teacher cognition and language education: Research and practice (Bloomsbury classics in linguistics). London: Bloomsbury Academic.Google Scholar
Boulton, A. (2010) Data-driven learning: Taking the computer out of the equation. Language Learning, 60(3): 534572. https://doi.org/10.1111/j.1467-9922.2010.00566.x CrossRefGoogle Scholar
Boulton, A. & Cobb, T. (2017) Corpus use in language learning: A meta-analysis. Language Learning, 67(2): 348393. https://doi.org/10.1111/lang.12224 CrossRefGoogle Scholar
Breyer, Y. (2009) Learning and teaching with corpora: Reflections by student teachers. Computer Assisted Language Learning, 22(2): 153172. https://doi.org/10.1080/09588220902778328 CrossRefGoogle Scholar
Çalışkan, G. & Gönen, S. İ. K. (2018) Training teachers on corpus-based language pedagogy: Perceptions on using concordance lines in vocabulary instruction. Journal of Language and Linguistic Studies, 14(4): 190210.Google Scholar
Callies, M. (2016) Towards corpus literacy in foreign language teacher education: Using corpora to examine the variability of reporting verbs in English. In Kreyer, R., Schaub, S. & Güldenring, B. (eds.), Angewandte Linguistik in Schule und Hochschule: Neue Wege für Sprachunterricht und Ausbildung. Frankfurt: Peter Lang, 391415. https://doi.org/10.3726/978-3-653-05953-3/26 Google Scholar
Chen, M., Flowerdew, J. & Anthony, L. (2019) Introducing in-service English language teachers to data-driven learning for academic writing. System, 87: 102148. https://doi.org/10.1016/j.system.2019.102148 CrossRefGoogle Scholar
Cook, L. S., Smagorinsky, P., Fry, P. G., Konopak, B. & Moore, C. (2002) Problems in developing a constructivist approach to teaching: One teacher’s transition from teacher preparation to teaching. The Elementary School Journal, 102(5): 389413. https://doi.org/10.1086/499710 CrossRefGoogle Scholar
Cotos, E. (2014) Enhancing writing pedagogy with learner corpus data. ReCALL, 26(2): 202224. https://doi.org/10.1017/s0958344014000019 CrossRefGoogle Scholar
Crosthwaite, P., Luciana & Schweinberger, M. (2021) Voices from the periphery: Perceptions of Indonesian primary vs secondary pre-service teacher trainees about corpora and data-driven learning in the L2 English classroom. Applied Corpus Linguistics, 1(1): 112. https://doi.org/10.1016/j.acorp.2021.100003 CrossRefGoogle Scholar
Debbagh, M. & Jones, W. M. (2017) Examining English language teachers’ TPACK in oral communication skills teaching. In EdMedia: World Conference on Educational Media and Technology. Waynesville: Association for the Advancement of Computing in Education (AACE), 739751.Google Scholar
Ebrahimi, A. & Faghih, E. (2017) Integrating corpus linguistics into online language teacher education programs. ReCALL, 29(1): 120135. https://doi.org/10.1017/S0958344016000070 CrossRefGoogle Scholar
Farr, F. (2008) Evaluating the use of corpus-based instruction in a language teacher education context: Perspectives from the users. Language Awareness, 17(1): 2543. https://doi.org/10.2167/la414.0 CrossRefGoogle Scholar
Feryok, A. (2010). Language teacher cognitions: Complex dynamic systems? System, 38(2), 272279.CrossRefGoogle Scholar
Feryok, A. (2018) Language teacher cognition: An emergent phenomenon in an emergent field. In Mercer, S. & Kostoulas, A. (eds.), Language teacher psychology. Bristol: Multilingual Matters, 105121. https://doi.org/10.21832/9781783099467-011 CrossRefGoogle Scholar
Godwin-Jones, R. (2015) The evolving roles of language teachers: Trained coders, local researchers, global citizens. Language Learning & Technology, 19(1): 1022.Google Scholar
Graham, C. R., Borup, J. & Smith, N. B. (2012) Using TPACK as a framework to understand teacher candidates’ technology integration decisions. Journal of Computer Assisted Learning, 28(6): 530546. https://doi.org/10.1111/j.1365-2729.2011.00472.x CrossRefGoogle Scholar
Han, S. & Shin, J.-A. (2017) Teaching Google search techniques in an L2 academic writing context. Language Learning & Technology, 21(3): 172194.Google Scholar
Harris, J. B. (2016) In-service teachers’ TPACK development: Trends, models, and trajectories. In Herring, M. C., Koehler, M. J. & Mishra, P. (eds.), Handbook of technological pedagogical content knowledge (TPACK) for educators (2nd ed.). New York: Routledge, 191205.Google Scholar
Jaipal Jamani, K. & Figg, C. (2013) The TPACK-in-practice workshop approach: A shift from learning the tool to learning about technology-enhanced teaching. In Ivala, E. (ed.), Proceedings of the 8th International Conference on e-Learning. Reading: Academic Conferences and Publishing International, 215223.Google Scholar
Johns, T. (1991) Should you be persuaded – two samples of data-driven learning materials. ELR Journal, 4: 116.Google Scholar
Johnson, K. E. & Golombek, P. R. (2020) Informing and transforming language teacher education pedagogy. Language Teaching Research, 24(1): 116127. https://doi.org/10.1177/1362168818777539 CrossRefGoogle Scholar
Koehler, M. J. & Mishra, P. (2009) What is technological pedagogical content knowledge? Contemporary Issues in Technology and Teacher Education, 9(1): 6070.Google Scholar
Koh, J. H. L. & Divaharan, H. (2011) Developing pre-service teachers’ technology integration expertise through the TPACK-developing instructional model. Journal of Educational Computing Research, 44(1): 3558. https://doi.org/10.2190/ec.44.1.c CrossRefGoogle Scholar
Kubanyiova, M. & Feryok, A. (2015) Language teacher cognition in applied linguistics research: Revisiting the territory, redrawing the boundaries, reclaiming the relevance. The Modern Language Journal, 99(3): 435449. https://doi.org/10.1111/modl.12239 CrossRefGoogle Scholar
Lee, C.-J. & Kim, C. (2014) An implementation study of a TPACK-based instructional design model in a technology integration course. Educational Technology Research & Development, 62(4): 437460. https://doi.org/10.1007/s11423-014-9335-8 CrossRefGoogle Scholar
Leńko-Szymańska, A. (2014) Is this enough? A qualitative evaluation of the effectiveness of a teacher-training course on the use of corpora in language education. ReCALL, 26(2): 260278. https://doi.org/10.1017/s095834401400010x CrossRefGoogle Scholar
Leńko-Szymańska, A. (2017) Training teachers in data-driven learning: Tackling the challenge. Language Learning & Technology, 21(3): 217241.Google Scholar
Ma, Q., Tang, J. & Lin, S. (2021) The development of corpus-based language pedagogy for TESOL teachers: A two-step training approach facilitated by online collaboration. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2021.1895225 CrossRefGoogle Scholar
Ma, Q., Yuan, R., Cheung, L. M. E. & Yang, J. (2022) Teacher paths for developing corpus-based language pedagogy: A case study. Computer Assisted Language Learning. Advance online publication. https://doi.org/10.1080/09588221.2022.2040537 CrossRefGoogle Scholar
McLaughlin, M. W. (1998) Listening and learning from the field: Tales of policy implementation and situated practice. In Hargreaves, A., Lieberman, A., Fullan, M. & Hopkins, D. (eds.), International handbook of educational change. Dordrecht: Springer, 7084. https://doi.org/10.1007/978-94-011-4944-0_4 Google Scholar
Mishra, P. & Koehler, M. J. (2006) Technological pedagogical content knowledge: A framework for teacher knowledge. Teacher’s College Record, 108(6): 10171054. https://doi.org/10.1111/j.1467-9620.2006.00684.x CrossRefGoogle Scholar
Pérez-Paredes, P. (2022) A systematic review of the uses and spread of corpora and data-driven learning in CALL research during 2011–2015. Computer Assisted Language Learning, 35(1–2): 3661. https://doi.org/10.1080/09588221.2019.1667832 CrossRefGoogle Scholar
Saldaña, J. (2013) The coding manual for qualitative researchers (2nd ed.). London: SAGE.Google Scholar
Schmid, E. (2017). Peer-assisted collaborative learning. In Thomas, M., Peterson, M. & Warschauer M. (eds.), Teacher education in computer-assisted language learning: A sociocultural and linguistic perspective (Advances in digital language learning and teaching). London: Bloomsbury Academic, 129153. http://dx.doi.org/10.5040/9781474292788.0015 Google Scholar
Shulman, L. S. (1986) Those who understand: Knowledge growth in teaching. Educational Researcher, 15(2): 414. https://doi.org/10.3102/0013189x015002004 CrossRefGoogle Scholar
Simons, H. (2009) Case study research in practice. London: SAGE. https://doi.org/10.4135/9781446268322 CrossRefGoogle Scholar
Tai, S.-J. D. (2015) From TPACK-in-action workshops to classrooms: CALL competency developed and integrated. Language Learning & Technology, 19(1): 139164.Google Scholar
van Olphen, M. (2008) TPCK: An integrated framework for educating world language teachers. In AACTE Committee on Innovation and Technology (ed.), Handbook of technological pedagogical content knowledge (TPCK) for educators. New York: Routledge/Taylor & Francis Group for the American Association of Colleges for Teacher Education, 107128.Google Scholar
Vyatkina, N. (2020) Corpus-informed pedagogy in a language course: Design, implementation, and evaluation. In Kruk, M. & Peterson, M. (eds.), New technological applications for foreign and second language learning and teaching. Hershey: IGI Global, 306335. https://doi.org/10.4018/978-1-7998-2591-3.ch015 Google Scholar
Vygotsky, L. S. (1987) Thinking and speech. In Rieber, R. & Carton, A. (eds.), Collected works (Vol. 1; N. Minick, Trans.). New York: Plenum Press, 39285. https://doi.org/10.1017/s0142716400008341 Google Scholar
Zareva, A. (2017) Incorporating corpus literacy skills into TESOL teacher training. ELT Journal, 71(1): 6979. https://doi.org/10.1093/elt/ccw045 CrossRefGoogle Scholar
Figure 0

Figure 1. TPACK framework. Reproduced with the permission of the publisher, © 2012 by tpack.org

Figure 1

Table 1. Background of the participants

Figure 2

Table 2. Corpus pedagogy workshop design

Figure 3

Figure 2. Alya’s DDL Activity 1

Figure 4

Figure 3. Sabina’s Module 5 Reflection.Note. Higher resolution versions of this figure can be viewed online as supplementary material

Figure 5

Table 3. TPACK pre-codes

Figure 6

Table 4. Open codes and pre-codes