College Composition Weekly: Summaries of research for college writing professionals

Read, Comment On, and Share News of the Latest from the Rhetoric and Composition Journals


Leave a comment

Mays, Chris. Fact and Fabrication in Creative Nonfiction. Mar. 2018. Posted 04/04/2018.

Mays, Chris. ‘“You Can’t Make This Stuff Up’: Complexity, Facts, and Creative Nonfiction.” College English 80.4 (2018): 319-41. Print.

Chris Mays explores the creation of meaning in writing through an examination of the relationship between “fact” and “fabrication” in the genre of creative nonfiction (321). He links this analysis to a 1985 article by Jim W. Corder arguing that adherence to the “narrative” each of us creates to structure our lives makes it difficult to “accommodate . . . differences” we encounter with others’ narratives (319). Mays finds an illustration of this difficulty in debates over factual accuracy in creative nonfiction.

Mays argues that writing in general excels in giving an impression of representing facts in “straightforward” ways, often appearing most praiseworthy “when a writer ‘just tells it like it is’ . . . or writes in ‘plain language’” (320). Any “simplicity” thus created, Mays contends, masks writing’s “own incredible complexity” (320). Ultimately, in Mays’s view, the power of writing to make the meaning it creates appear straightforward and uncontestable, while hiding the process through which that meaning was produced, leads to the kind of insularity Corder describes (321, 337).

Mays approaches the issue of meaning in writing through genre theory. He reports scholarship on genre that depicts genre as a categorization that “organizes writing into recognizable forms” (326); quoting Carolyn R. Miller, he portrays genre as the “form” of writing that “shapes the response of the reader or listener to substance by providing instruction . . . about how to perceive and interpret” (qtd. in Mays 324). Genres, he writes, tend to look “stable” but are actually in constant flux, with the result that readers respond to representations of facts differently when they encounter them in different genres, which themselves are responsive to different contexts (325):

[F]acts emerge out of genres, and how the boundary lines of fact and fiction are drawn is dependent on the genres in which one is observing the facts. (325)

For Mays, looking at creative nonfiction as a contextualized, fluid genre illuminates how genre assumptions affect attitudes toward facticity particularly because the history of this genre reveals ongoing tensions over the degree to which authors of creative nonfiction deal with “facts” versus “subjective experience” (321). Mays finds that, even though writers in the genre acknowledge the subjectivity introduced by literary techniques, definitions of creative nonfiction emphasize its allegiance to facts (321, 324). He argues that the tension inherent in the genre is especially useful in revealing how concerns about the facticity of writing “shift the focus away from the complex mechanism by which all facts are created and maintained” (326), thus illustrating an important feature of writing itself.

To explore these issues, Mays dissects controversy over the use of facts in the satire of David Sedaris. He analyzes the critique of Alex Heard, who condemns Sedaris’s use of elaboration and apparent invention as violations of what Heard sees as a sacrosanct obligation of writers of creative nonfiction: not to “make things up” (qtd. in Mays 329). Other respondents defended Sedaris as engaged in telling stories in which fabrications lead to “composite truths” valuable in themselves (328, 335). Mays’s interest revolves around the degree to which the criteria applied to Sedaris are “extremely passionate” (328) and “rigid” (327). He argues that the negative critics of Sedaris create inviolate genres that they believe are stable and judge the handling of facts by these rules (330). “Observers” of the creative-nonfiction genre, he writes,

often just do not perceive that there are different ways of drawing genre boundaries and intensely defend the singularity of their views. (328)

For Mays, this reaction to fact within the genre, which he depicts as widespread (321), sheds light on the tendency to forget that writing as writing is always, in Kenneth Burke’s terms, both a “selectio[n]” and a “deflection of reality” (qtd. in Mays 338; emendation in Mays). Mays contends that writing disguises the process of selection that generates a multiplicity of “facts” (329).

Mays further argues for the contextual nature of facts by noting that although “community influence” (330), for example that of the community of creative nonfiction writers, may affect decisions about what counts as an acceptable allegiance to facts, even writers within the community still generate bounded genres that drive their attitude toward the representation of their material. Writers in the genre may contend that Sedaris’s exploitation of subjectivity shirks what Heard calls the “ethical requirements” of fidelity to reality in order to sell more effectively (qtd. in Mays 330), yet Mays also cites memoirist William Bradley, whose criteria recognize “different kinds of truths” (331), and the controversy surrounding Mike Daisey’s depiction of working conditions at Apple facilities in China. Daisey asserted that his genre was “theater,” not “journalism,” and thus his problematic representation of the conditions he reported was justified (333-34).

Mays ties the question of how facts are made to the classroom by referencing “the oft-made demand for a focus on plain facts in first-year writing” (336). This demand, in his view, can be attributed to an ongoing hope for “perfect writing” that fully represents reality (337). For Mays, such writing can never exist because “writers will never be able to fully control or stabilize what is truth, fact, or fabrication in their writing” (336). In his view, complexity theory suggests that problems arise because one’s construction of reality precludes the ability to perceive what is left out of that construction (332). The act of writing in itself creates complexity, which imbues writing with this characteristic blindness (332, 335). Thus, a section title asserts, “All Writing is Dishonest (and Honest)” (333).

Citing Bronwyn T. Williams to note that some reliance on facts is necessary for day-to-day living (325), and recognizing the challenge of a “workable” acceptance that all facts are contextual (332), Mays agrees with Jane Bennett that “recognit[ion] that . . . other divergent configurations exist, even if we cannot perceive them,” is “an ethical necessity” (333). He concludes that Corder’s exhortation to extend our awareness beyond our own narratives inevitably encounters the degree to which the creation of those narratives generates the very conditions that make moving beyond them so difficult (337). Mays argues for intensified awareness of the partiality of any written truth and of the degree to which a rigid insistence on facts can limit our appreciation of different kinds of writing and what this diversity can achieve (338).


Leave a comment

Accessibility to print for visually-impaired persons–The Marrakesh Treaty

This information may have been widely circulated among composition professionals; I have not encountered it in any of the journals I’ve been accessing for this blog. At the same time, I’ve summarized some articles dealing with access for students with different disabilities, so I felt it might be useful to supply a link on this issue.

I received this link through a controversy that arose through my creative-writing blog. If you’re interested in the specifics (which involve intellectual-property issues that may resonate for some in composition), you can read the posts here and here.

A respondent to the second post introduced me to the Marrakesh Treaty. This treaty, which the U.S. has joined, allows authorized non-profit sites to post works for “blind and print-disabled” persons regardless of copyright.

As an author with my own books for sale at commercial sites, I was unaware of this new treaty, and from what I’ve seen, few in the creative-writing blogosphere were aware of it. If you have had experience with its provisions, please share. If not, and you would like to know more, you can check out a brief discussion and links to both an overview article and the treaty itself.

You should be able to reblog and share both this notice and the posts regarding the intellectual-property discussion. The reader’s comments on the second post in the series provide useful information about access for print-disabled readers.

I hope this information is helpful to some visitors to this site.

 


Leave a comment

Blatant Self-Promotion: King of the Roses 99 cents at Amazon next week!

KOTR Tatiana300KING OF THE ROSES

Mystery and romance at the Kentucky Derby!

“An impressive debut by a superb writer!”–Publishers Weekly

Buy at Amazon


Leave a comment

Webber, Jim. Reframing vs. Artful Critique of Reform. Sept. CCC, 2017. Posted 10/31/2017.

Webber, Jim. ”Toward an Artful Critique of Reform: Responding to Standards, Assessment, and Machine Scoring.” College Composition and Communication 69.1 (2017): 118-45. Print.

Jim Webber analyzes the responses of composition scholars to the reform movement promoted by entities like College Learning Assessment (CLA) and Complete College America (CCA). He notes that the standardization agenda of such groups, intended to improve the efficiency of higher education, has suffered setbacks; for example, many states have rejected the Common Core State Standards (118-19). However, in Webber’s view, these setbacks are temporary and will be followed by renewed efforts by testing and measurement agencies to impose their own criteria for student success (119).

The standardization these groups urge on higher education will, they claim, give parents and students better information about institutions and will ultimately serve as grounds for such moves as “performance funding” (119). The overall goal of such initiatives is to move students through college as quickly as possible, especially into majors (119).

Webber recognizes two prongs of composition’s response to such pressures to portray “college students and parents as consumers” (119). One thread urges “reframing” or “redirecting” the efforts of the testing industry and groups like CLA and CCA. For Webber, this viewpoint adopts a “realist style.” Scholars who espouse reframing urge that compositionists work within the current realities created by the power of the testing and standardization apparatus to “expand” the meanings of terms like “college readiness” (120), adjusting them in ways that reflect composition’s inclusive, humanistic values (122)–that is, in Frank Farmer’s term, “insinuat[ing]” the professional ethos of composition and its authority into the standardization apparatus (qtd. in Webber 122).

Scholars who adopt this realist style, Webber claims, “figur[e] public policy as accommodation to the world” (141n5); moreover, in Webber’s view, they accept the description of “the way the world is” (133) put forward by CCA and others as “irreducibly competitive” and thus “[reduce] the scope of policy values to competition, efficiency, and instrumentality” (141n5).

Webber cites scholars in this vein who contend that the protests of scholars and writing professionals have been and will be effectively “ignored” by policymakers (137). More productive, in this view, is collaboration that will at least provide “a seat at the policy table,” giving professionals a chance to infuse the debate with their values (133).

Webber presents the 2011 Framework for Success in Postsecondary Writing as an example of how the reframing position “work[s] within the limits established by the dominant discourse of reform” (123). He notes that Bruce Comiskey was unable to discern any “apparent difference” between the aspirations of the Framework and those of the reform movement (125; emphasis original). For Webber, this approach sets up composition professionals as “competition” for the testing industry as the experts who can make sure students meet the reformers’ criteria for successful learning (124). Reframing in this way, Webber says, requires “message management” (123) to make sure that the response’s “strategic” potential is sustained (121).

Scholars who urge reframing invoke Cornel West’s “prophetic pragmatism” (122), which requires them to:

think genealogically about specific practices in light of the best available social theories, cultural critiques, and historiographic insights and to act politically to achieve certain moral consequences in light of effective strategies and tactics. (qtd. in Webber 122)

Webber contends that reframers interpret this directive to mean that “public critique” by compositionists “cannot deliver the consequences they desire” (123; emphasis original). Thus, a tactical approach is required.

The second thread in compositionists’ response to the reform movement is that of critique that insists that allowing the reform industry to set the terms and limits of the discussion is “to grant equivalence between our professional judgments and those of corporate-political service providers” (125-26). Webber quotes Judith Summerfield and Philip M. Anderson, who argue that “managing behavior and preparing students for vocations” does not accord with “a half-century (at the least) of enlightened classroom study and socio-psycholinguistic research” (qtd. in Webber 125).

In Webber’s view, the strands of reframing and critique have reached a “stalemate” (126). In response to the impasse, Webber explores the tradition of pragmatism, drawing on John Dewey and others. He argues that reframers call on the tenets of “melioration” and “prophetic critique” (127). “Meliorism,” according to Webber’s sources, is a linguistic process in that it works toward improving conditions through addressing the public discourse (127). In discussing West’s prophetic pragmatism as a form of “critical melioration,” Webber focuses on the “artfulness” of West’s concept (128).

Webber sees artfulness as critique “in particular contexts” in which ordinary people apply their own judgments of the consequences of a theory or policy based on the effects of these theories or policies on their lives (128-29). An artful critique invites public participation in the assessment of policies, an interaction that, according to West, functions as “antiprofessionalism,” not necessarily for the purpose of completely “eliminating or opposing all professional elites” but rather to “hold them to account” (qtd. in Webber 129).

Webber argues that proponents of reframing within composition have left out this aspect of West’s pragmatism (128). Webber’s own proposal for an artful critique involves encouraging such active participation by the publics actually affected by policies. He contends that policymakers will not be able to ignore students and parents as they have composition professionals (137).

His approach begins with “scaling down” by inviting public inquiry at a local level, then “scaling up” as the conversation begins to trigger broader responses (130). He presents the effects of student protests as the University of Missouri in 2015 as an example of how local action that challenges the power of elites can have far-reaching consequences (137-38). Compositionists, he maintains, should not abandon critique but should “expand our rhetoric of professionalism to engage the antiprofessional energy of local inquiry and resistance” (138).

As a specific application of his view, Webber provides examples of how composition professionals have enlisted public resistance to machine-scoring of student writing. As students experience “being read” by machines, he contends, they become aware of how such policies do not mesh with their concerns and experiences (137). This awareness engages them in critically “problematizing” their perspectives and assumptions (131). In the process, Webber argues, larger, more diverse audiences are encouraged to relate their own experiences, leading to “a broader public discussion of shared concerns” (131).

For Webber, drawing on the everyday judgments of ordinary people as to the value of policies put forward by professionals contrasts with the desire to align composition’s values with those of the standardization movement in hopes of influencing the latter from within. Opening the debate beyond strategic professionalism can generate a pragmatism that more nearly fits West’s prophetic ideals and that can “unsettle the inevitability of reform and potentially authorize composition’s professional perspectives” in ways that reframing the terms of the corporate initiatives cannot (135).

 

 


Leave a comment

Bailey & Bizzaro. Research in Creative Writing. August RTE. Posted 08/25/2017.

Bailey, Christine, and Patrick Bizzaro. “Research in Creative Writing: Theory into Practice.” Research in the Teaching of English 52.1 (2017): 77-97. Print.

Christine Bailey and Patrick Bizzaro discuss the disciplinarity of creative writing and its place in relation to the discipline of composition. They work to establish an aesthetic means of interpreting and representing data about creative writing in the belief that in order to emerge as a discipline its own right, creative writing must arrive at a set of shared values and understandings as to how research is conducted.

Bailey and Bizzaro’s concerns derive from their belief that creative writing must either establish itself as a discipline or it will be incorporated into composition studies (81). They contend that creative writing studies, like other emerging disciplines, must account for, in the words of Timothy J. San Pedro, “hierarchies of power” within institutions (qtd. in Bailey and Bizzaro 78) such that extant disciplines control or oppress less powerful disciplines, much as “teaching practices and the texts used in schools” oppress marginal student groups (78). A decision to use the methodologies of the “dominant knowledges” thus accedes to “imperial legacies” (San Pedro, qtd. in Bailey and Bizzaro 78).

Bailey and Bizzaro report that discussion of creative writing by compositionists such as Douglas Hesse and Wendy Bishop has tended to address how creative writing can be appropriately positioned as part of composition (79). Drawing on Bishop, the authors ascribe anxiety within some English departments over the role of creative writing to “genre-fear,” that is, “the belief that two disciplines cannot simultaneously occupy the same genre” (79).

They recount Bishop’s attempt to resolve the tension between creative writing studies and composition by including both under what she called a de facto “ready-made synthesis” that she characterized as the “study of writers writing” (qtd. in Bailey and Bizzaro 80). In the authors’ view, this attempt fails because the two fields differ substantially: “what one values as the basis for making knowledge differs from what the other values” (80).

The authors see creative writing studies itself as partially responsible for the difficulties the field has faced in establishing itself as a discipline (79, 80-81). They draw on Stephen Toulmin’s approach to disciplinarity: “a discipline exists ‘where men’s [sic] shared commitment to a sufficiently agreed set of ideals leads to the development of an isolable and self-defining repertory of procedures” (qtd. In Bailey and Bizzaro 80). The authors elaborate to contend that in a discipline, practitioners develop shared views as to what counts as knowledge and similarly shared views about the most appropriate means of gathering and reporting that knowledge (80).

Creative writing studies, they contend, has not yet acted on these criteria (81). Rather, they state, creative writers seem to eschew empirical research in favor of “craft interviews” consisting of “writers’ self-reports”; meanwhile, compositionists have undertaken to fill the gap by applying research methodologies appropriate to composition but not to creative writing (81). The authors’ purpose, in this article, is to model a research methodology that they consider more in keeping with the effort to define and apply the specific values accruing to creative writing.

The methodology they advance involves gathering, interpreting, and representing aesthetic works via an aesthetic form, in this case, the novel. Students in nine sections of first-year-writing classes in spring and fall 2013 responded to a “creative-narrative” prompt: “How did you come to this place in your life? Tell me your story” (84). Students were asked to respond with “a creative piece such as a poem, screenplay, or graphic novel” (84). All students were invited to participate with the understanding that their work would be confidential and might be represented in published research that might take on an alternative form such as a novel; the work of students who signed consent forms was duplicated and analyzed (84-85).

Data ultimately consisted of 57 artifacts, 55 of which were poems (85). Coding drew on the work of scholars like K. M. Powell, Elspeth Probyn, and Roz Ivanič to examine students’ constructions of self through the creative-narrative process, and on that of James E. Seitz to consider how students’ use of metaphor created meaning (85, 86). Further coding was based on Kara P. Alexander’s 2011 study of literacy narratives (86).

This analysis was combined with the results of a demographic survey to generate six groups revolving around “[c]ommon threads” in the data (86); “personas” revealed through the coded characteristics divided students into those who, for example, “had a solid identity in religion”; “were spiritually lost”; were “uncertain of identity [and] desiring change”; were “reclusive” with “strong family ties”; were interested in themes of “redemption or reformation”; or “had lived in multiple cultures” (86). This list, the authors state, corresponds to “a standard analysis” that they contrast with their alternative creative presentation (86).

In their methodology, Bailey and Bizzaro translate the “composites” identified by the descriptors into six characters for a young-adult novel Bailey developed (88). Drawing on specific poems by students who fell into each composite as well as on shared traits that emerged from analysis of identity markers and imagery in the poems, the authors strove to balance the identities revealed through the composites with the individuality of the different students. They explore how the characters of “Liz” and “Emmy” are derived from the “data” provided by the poems (89-90), and offer an excerpt of the resulting novel (90-92).

They present examples of other scholars who have “used aesthetic expressions in the development of research methods” (88). Such methods include ethnography, a form of research that the authors consider “ultimately a means of interpretive writing” (93). Thus, in their view, creating a novel from the data presented in poems is a process of interpreting those data, and the novel is similar to the kind of “storytell[ing]” (93) in which ethnography gathers data, then uses it to represent, interpret, and preserve individuals and their larger cultures (92-93).

They continue to contend that embracing research methods that value aesthetic response is essential if creative writing is to establish itself as a discipline (93). These methodologies, they argue, can encourage teachers to both value aesthetic elements of student work and to use their own aesthetic responses to enhance teaching, particularly as these methods of gathering and representing data result in “aesthetic objects” that are “evocative, engage readers’ imaginations, and resonate with the world we share not only with our students but also with our colleagues in creative writing” (94). They argue that “when the ‘literariness’ of data reports [becomes] a consideration in the presentation of research,” composition and creative writing will have achieved “an equitable relationship in writing studies” (95).

 


2 Comments

Skains, R. Lyle. Multimodal Creative Writing. C&C, March 2017. Posted 02/05/2017.

Skains, R. Lyle. “The Adaptive Process of Multimodal Composition: How Developing Tacit Knowledge of Digital Tools Affects Creative Writing.” Computers and Composition 43 (2017): 106-17. Web. 29 Jan. 2017.

R. Lyle Skains describes a “practice-based research” project conducted over a three-and-a-half year period in which she analyzed her development as a writer of digital fiction. In this project, Færwhile, Skains progresses through drafts of several stories, beginning with a traditional “analogue” story and culminating in stories in which she has internalized the knowledge needed to create successful digital compositions.

Skains argues that such research is needed because composition pedagogy does not fully account for the “fundamental, cognitive differences between writing for the page and writing for digital media” (106). While students may engage with digital media as readers, she contends, they have little practice in actually exploiting the possibilities of digital media as writers (115). She emphasizes the need for explicit knowledge of the demands of a new medium to become internalized as tacit knowledge; students come to multimodal assignments with tacit knowledge of print from their long experience with it, but may not yet have gained the kind of tacit knowledge of digital media that will allow them to become fully accomplished multimodal writers (107).

Her own project involved reading digital fiction, reading theory on narrative and genre, and then working through several stories, beginning with a “zero-state” text: “an analogue short story” she undertook before delving into digital composition (107). Subsequent stories engaged more and more fully with the possibilities of digital fiction. Skains walks through her processes as she composes these stories.

Her method is “auto-ethnomethodological”; it consists of observations of herself at work and the states of mind through which she moves from conscious explicit knowledge to a fully functional tacit knowledge of the medium (108). Following advice from Deborah Brandt, Skains draws on “observable paratexts” to her process like “notes, journal entries, and comments on revised drafts”; these allow her to reconstruct her cognitive journey. She draws as well on the 1981 Cognitive Process Model advanced by Linda Flower and John R. Hayes, which she credits with the observation that a design or intention can be realized in many different ways and the specific realization emerges from the actual process of writing (108).

She cites other theories of narrative and creative processes including Gérard Genette’s invocation of “hypertextuality (playing the text off familiarity with other texts in the genre) and architextuality (exploring generic expectations in relation to other similar texts)” (107). Flower and Hayes’s Multiple Representation Theory suggests that “the initial mental model of a text is multimodal, then subsequently translated to written language” (107). Skains relates such theories to her own processes, for example noting how her reading interacted with her own texts as well as how the stories in her project contributed to an “intratextual” effect via a shared “element of parallel mythology,” the “Trickster” figure (111). In accordance with Flower and Hayes, she relates how her analogue short story “unfolded in [her] imagination on a visual reel, which then needed translation into written language” (110).

Skains argues for the importance of long-term memory that can draw on a “knowledge base” and allow fiction writers to construct characters and worlds (109). As short-term memory of actions involved in a medium is transferred to long-term memory, tacit knowledge is developed (110).

An important finding for her project is that the linear structuring and narrative processes she found most comfortable did not lend themselves to a simple “remediation” of the typical analogue text into a digital version (112). As she worked through a succession of stories, she continued to begin with these familiar invention and composing steps; the third story in her discussion, for example, shared features with the “zero-state” story: its “traditional, linear structure and minimal level of interactivity,” even though she “remediated” it into Adobe Flash (111). However, when she struggled with a story about a character whose “interaction with her world, both real and virtual, was hyperlinked,” Skains found that the character could not evolve if she was “stuck in sequential page turns” (112). The solution was to work through the digital version first, giving over fully to the hyperlinked world invoked by the story (112). Skains found that she was still working toward a fully developed “mental model that afforded a fully multimodal composition process” (112).

The author argues that first- or second-person points of view, increased interactivity that provides readers with agency, and intra- or intertextuality are defining features of digital fiction (111). Texts that are composed an analogue narratives, she posits, lack full commitment to these elements and will not lend themselves to revision in digital form (110): “the composition process for multimodal works must necessarily be multimodal” (112).

Skains reports that the means by which she addressed the original “rhetorical problem” for her stories was affected by her deeper and deeper engagement with digital composition (114). Writers of digital texts like hers, she writes, become programmers, with the result that “the text as composed (i.e., the source code) does not resemble the text-as-read/played” (113). She cites digital writer Jenny Weight to argue that a digital-composing experience becomes an “environment” in itself rather than a “traditional narrative” (113). Inventing a set of environments for a character to traverse in the digital composition influences the “world-building” efforts of the analogue version (113).

Similarly, she cites an example of a story in which providing a narrator with multiple voices led to the creation of a website for each voice, a move that in turn led her to experiment with visual font effects in the print version (113-14). In such cases, Skains’s “mental model of the narrative” had been influenced by the digital process (114).

Skains posits that students attempting to apply their tacit knowledge of print technology as they encounter multimodal assignments face a trajectory similar to hers, and that current composition-classroom practice does not facilitate this evolution (114). The addition of digital elements, she notes, adds many new layers to the composing process, “significantly increase[ing] the creative decisions that have to be made” (115). She contends that, like her, students must learn to adjust their creative processes to conform to the media rather than expecting the media to meet their original goals (115). The tacit knowledge and expertise to make this transition, Skains maintains, is “immersion” in the digital process, moving beyond reading to doing (115). She is currently engaged in ethnographical work to develop a “pedagogical model for teaching digital writing” (115).


1 Comment

Moore & MacArthur. Automated Essay Evaluation. JoWR, June 2016. Posted 10/04/2016.

Moore, Noreen S., and Charles A. MacArthur. “Student Use of Automated Essay Evaluation Technology During Revision.” Journal of Writing Research 8.1 (2016): 149-75. Web. 23 Sept. 2016.

Noreen S. Moore and Charles A. MacArthur report on a study of 7th- and 8th-graders’ use of Automated Essay Evaluation technology (AEE) and its effects on their writing.

Moore and MacArthur define AEE as “the process of evaluating and scoring written prose via computer programs” (M. D. Shermis and J. Burstein, qtd. in Moore and MacArthur 150). The current study was part of a larger investigation of the use of AEE in K-12 classrooms (150, 153-54). Moore and MacArthur focus on students’ revision practices (154).

The authors argue that such studies are necessary because “AEE has the potential to offer more feedback and revision opportunities for students than may otherwise be available” (150). Teacher feedback, they posit, may not be “immediate” and may be “ineffective” and “inconsistent” as well as “time consuming,” while the alternative of peer feedback “requires proper training” (151). The authors also posit that AEE will increasingly become part of the writing education landscape and that teachers will benefit from “participat[ing]” in explorations of its effects (150). They argue that AEE should “complement” rather than replace teacher feedback and scoring (151).

Moore and MacArthur review extant research on two kinds of AEE, one that uses “Latent Semantic Analysis” (LSA) and one that has been “developed through model training” (152). Studies of an LSA program owned by Pearson and designed to evaluate summaries compared the program with “word-processing feedback” and showed enhanced improvement across many traits, including “quality, organization, content, use of detail, and style” as well as time spent on revision (152). Other studies also showed improvement. Moore and MacArthur note that some of these studies relied on scores from the program itself as indices of improvement and did not demonstrate any transfer of skills to contexts outside of the program (153).

Moore and MacArthur contend that their study differs from previous research in that it does not rely on “data collected by the system” but rather uses “real time” information from think-aloud protocols and semi-structured interviews to investigate students’ use of the technology. Moreover, their study reveals the kinds of revision students actually do (153). They ask:

  • How do students use AEE feedback to make revisions?
  • Are students motivated to make revisions while using AEE technology?
  • How well do students understand the feedback from AEE, both the substantive feedback and the conventions feedback? (154)

The researchers studied six students selected to be representative of a 12-student 7th- and 8th-grade “literacy class” at a private northeastern school whose students exhibited traits “that may interfere with school success” (154). The students were in their second year of AEE use and the teacher in the third year of use. Students “supplement[ed]” their literacy work with in-class work using the “web-based MY Access!” program (154).

Moore and MacArthur report that “intellimetric” scoring used by MY Access! correlates highly with scoring by human raters (155). The software is intended to analyze “focus/coherence, organization, elaboration/development, sentence structure, and mechanics/conventions” (155).

MY Access provides feedback through MY Tutor, which responds to “non-surface” issues, and MY Editor, which addresses spelling, punctuation, and other conventions. MY Tutor provides a “one sentence revision goal”; “strategies for achieving the goal”; and “a before and after example of a student revising based on the revision goal and strategy” (156). The authors further note that “[a]lthough the MY Tutor feedback is different for each score point and genre, the same feedback is given for the same score in the same genre” (156). MY Editor responds to specific errors in each text individually.

Each student submitted a first and revised draft of a narrative and an argumentative paper, for a total of 24 drafts (156). The researchers analyzed only revisions made during the think-aloud; any revision work prior to the initial submission did not count as data (157).

Moore and MacArthur found that students used MY Tutor for non-surface feedback only when their submitted essays earned low scores (158). Two of the three students who used the feature appeared to understand the feedback and used it successfully (163). The authors report that for the students who used it successfully, MY Tutor feedback inspired a larger range of changes and more effective changes in the papers than feedback from the teacher or from self-evaluation (159). These students’ changes addressed “audience engagement, focusing, adding argumentative elements, and transitioning” (159), whereas teacher feedback primarily addressed increasing detail.

One student who scored high made substantive changes rated as “minor successes” but did not use the MY Tutor tool. This student used MY Editor and appeared to misunderstand the feedback, concentrating on changes that eliminated the “error flag” (166).

Moore and MacArthur note that all students made non-surface revisions (160), and 71% of these efforts were suggested by AEE (161). However, 54.3% of the total changes did not succeed, and MY Editor suggested 68% of these (161). The authors report that the students lacked the “technical vocabulary” to make full use of the suggestions (165); moreover, they state that “[i]n many of the instances when students disagreed with MY Editor or were confused by the feedback, the feedback seemed to be incorrect” (166). The authors report other research that corroborates their concern that grammar checkers in general may often be incorrect (166).

As limitations, the researchers point to the small sample, which, however, allowed access to “rich data” and “detailed description” of actual use (167). They note also that other AEE program might yield different results. Lack of data on revisions students made before submitting their drafts also may have affected the results (167). The authors supply appendices detailing their research methods.

Moore and MacArthur propose that because the AEE scores prompt revision, such programs can effectively augment writing instruction, but recommend that scores need to track student development so that as students score near the maximum at a given level, new criteria and scores encourage more advanced work (167-68). Teachers should model the use of the program and provide vocabulary so students better understand the feedback. Moore and MacArthur argue that effective use of such programs can help students understand criteria for writing assessment and refine their own self-evaluation processes (168).

Research recommendations include asking whether scores from AEE continue to encourage revision and investigating how AEE programs differ in procedures and effectiveness. The study did not examine teachers’ approaches to the program. Moore and MacArthur urge that stakeholders, including “the people developing the technology and the teachers, coaches, and leaders using the technology . . . collaborate” so that AEE “aligns with classroom instruction” (168-69).