Posts Tagged 'qualitative'
Tags: 635, ethics, ethnography, katherine schultz, methodology, methods, patricia sullivan, qualitative, stephen duncombe, teal triggs, thomas newkirk, zines
This week I’ve been knee-deep in ethnographic studies, compiling a bibliography on zines and self-sponsored writing. Depending on how you define ethnography, I’ve been hard-pressed to find any other method at work except historical analysis. Granted, some of these studies are more empirical than others, but pretty much every one of them has used a combination of textual analysis, interview, and observation (with some more emic in their perspective than others). Interestingly, in the intro to one of the least transparent studies (yet unarguably the most influential), Notes From Underground (1997), Stephen Duncombe illustrates “the anxiety of authority” that Patricia Sullivan identifies in “Ethnography and the Problem of the ‘Other’”:
Still others will be disappointed that I’ve written a book on zines at all. Isn’t this just another exploitation of zines, “selling out” the underground to the above-ground world? Perhaps. But alternative culture has already been discovered — the more important question is who will represent it and how. The ways in which I explore and explain the world of zines certainly bear the mark of my theoretical interests and political concerns, but I’m of the world I write and my concern for the underground runs deeper than its status as this (or last) season’s cultural exotica. More important, I’m a conscientious observer and a careful listener. And I believe that what zinesters have to say and what zines represent are too important to stay sequestered within the walls of a subcultural ghetto. (20)
Duncombe justifies his ethics by adopting the emic perspective of charitable participant-observer. And yet at the end of Notes he argues that as long as zines cling to a negative identity — an identity always at odds with but also attached to a dominant consumer culture — they will be politically ineffective. In fact, in a new afterward for the 2nd edition (2008) he accuses print zines of being little more than “an exercise in nostalgia,” characterizing zines as a bohemic ghetto (212). Of course Duncombe also lauds zines throughout Notes, but readers are left wondering how zinesters themselves — especially the thousands who still practice zine-ing — feel about this characterization of them.
Perhaps an even more problematic example is Fanzines (2010) by Teal Triggs, who has been accused of printing zine covers without the permission of the authors or barely dialoging with her research subjects at all, a problem that led her to get several facts wrong in her book. While Triggs employs a purely historical/textual analysis in Fanzines, if the accusations are true, this is not only a legal issue for the zine community, but an ethical one that puts folks like me — potential researchers of zine communities — on notice. At the very least, perception is reality and zinesters have good reason to doubt the intentions of academics who are interested in speaking for them. Luckily, as Janice Radway has recently argued, many zinesters are also academics and librarians (like Jerianne at Underground Press) so they’re not completely divided communities.
In any case, the ethics of ethnographers are taken up by several readings this week and I’d like to focus on two widely cited essays in particular from Ethics and Representation in Qualitative Studies of Literacy (1996): Tom Newkirk’s “Seduction and Betrayal in Qualitative Research” and Patricia Sullivan’s “Ethnography and the Problem of the ‘Other.’” Both advocate for a more critical understanding of ethnography, especially those that “study down” (e.g. examine the literate practices of those with less power), but represent slightly incompatible views of how to mitigate the ethical problems such qualitative work engenders.
For Newkirk, the problem is informed consent: how to make research subjects aware that the information they provide could render them negatively — as racist teachers, bourgeois professionals, or unethical citizens. For Sullivan, a research project should “ultimately aim to benefit those whose voices, texts, and circumstances make [our] understanding possible” (98). For Newkirk, ethnography should allow for (and probably require) some bad news; Sullivan, on the other hand, is less comfortable with those conclusions, seeking to not just inform subjects of their representation, but to include them in actively constructing it. For Sullivan, self-reflexivity — “the explicit rendering of one’s own theoretical and political assumptions and beliefs as well as one’s experiences and emotions in the process of fieldwork — isn’t enough. Power-sharing discourse should be present throughout the research process where, “[p]articipants are involved in framing research questions, collecting and interpreting data, commenting on, and sometimes in, the final text” (109).
This is perhaps where Sullivan and Newkirk are incompatible. While Newkirk argues for dialogue with participants within the process — especially with the consent agreement and “interpretation of problematical situations” during data gathering. Sullivan, though, would give participants more agency than this, involving them from the get-go when framing research questions and deciding which data is relevant data. I wonder, though, if Sullivan is painting too idealistic a picture of the research process. I wonder this partially because I can’t imagine wandering into a zine convention on onto an online zine community and asking them what questions should be asked. I’d receive empty looks or snide rebuttals. After all, if I don’t know what I’m looking for, then why am at that site.
One study I’ve encountered through my bib that does emulate an ideal research practice is Katherine Schultz’s “Looking across Space and Time” from RTE in 2002. In that fairly influential study, Schultz uses multi-site ethnography to understand the literacy practices of high school students across contexts, in school and out. From her data analysis, Schultz find three themes from out-of-school writing: “(a) writing was largely a private practice they kept separate from their school lives, (b) writing was used to take a critical stance, c) writing was a bridge between their homes and school worlds” (368). One of the major and important conclusions to evolve from this last pattern is that once students graduated, they stopped writing out of school. Part of what I liked about this study was Schultz’s narration of how she triangulated data with her student participants even as she helped cart them back and forth from school to job in her car: “I showed the findings to the research participants to determine if the findings seemed valid from their perspectives” (367). And when she discusses the teachers in the study, she characterizes them as thoughtful and relevant. In fact, one implication of her findings is that school sponsorships of literacy have an indirect effects on self-sponsorships of literacy.
Even though I think this is an ethical study, it makes me wonder what kinds of decisions she had to make throughout the process. Did she show her work to the teachers, who more or less have a back seat in the study? I wonder what other example studies in the field are useful for discussing Newkirk, Sullivan, and others this week. Thoughts?
Tags: 635, agency, context, form, genre, johanek, method, methodology, paradigm, process, product, qualitative, research, rhetoric, spinuzzi, techcomm
Tags: 635, CPLS, ethics, literacy, qualitative, research, stake
At the end of his book, Robert Stake characterizes the essence of qualitative research as innately limited to the specific:
“It has been important to learn that how the thing works in several small situations does not aggregate to solving a big-thing problem. Answers to macro problems call mostly for study of macro situations. Answers to micro problems call mostly for study of micro situations” (216).
However, for Purcell-Gates, Perry, and Briseño (“Analyzing Literacy Practice: Grounded Theory to Model”), aggregation of these small situations is the rub — perhaps not to solve a “big-thing problem” (such as illiteracy or social reproduction) but at least to perform replicable, cross-case analyses for “(a) the desire to reach for greater generalizability than that afforded by a single case and (b) to deepen understanding and explanation” (451, emphasis in original). The authors develop a theoretical and methodological model with the Cultural Practices of Literacy Study (CPLS), that collects specifically-coded ethnographic data from numerous sites, enters them into a database, for the purpose of more sophisticated theories of literacy that might lead to more effective pedagogies for “historically marginalized groups.”
Drawing from New Literacy Studies (NLS), the theoretical framework assumes that literate practices need to be “situated within social and cultural contexts and within relationships of power and ideology” (441). The researchers’ codes reflect this framework as they aim to document the context and the practice of the literacy events they observe. For example, they code a subject’s “social activity domain” based on the tokens of data observed (as folksomatic) in context (i.e. a person doing homework at a football game would be coded as SCH — schooling). Using genre theory as a guide, they code “text types” (e.g. novel) and “text forms” (e.g. book), the former nested within the latter.
Honestly, though, I found the examples of the coding scheme confusing. For social activity domain, they give the example of taxi driver reading the newspaper. Because he’s reading it while waiting in line for his fare turn, they coded it as Work. A paragraph later, however, they explain that they always “considered the nature of the activity, irrespective of where it occurred” when coding. Who’s to say the newspaper reading wasn’t serving some civic purpose (CIV) or communal one (COM)? Moreover, the authors locate social activity domain under literacy event codes, but then provide a figure on p. 450 that places “social activity” waaay outside the literacy event, rendering it unobservable according to NLS. My sense is that their coding scheme is an attempt to narrow the gap between literacy events — which are observable — and literacy practices — which are usually inferred, in order to more fully understand how literacy works in context of the subject (something that Theresa Lillis apparently attempts in our other reading this week). But despite reading this section multiple times, I’m just not sure.
The coding is obviously important as the authors aim to generalize from several ethnographic studies of various historically marginalized groups. The example research question given — “Does agency look different (is it instantiated differently) within different hegemonic contexts?” — leads to the conclusion that a more complex definition of hegemony (or more accurately hegemonies) is appropriate, given that resistance and appropriation of the historically marginalized are always situated. Although I didn’t think about this when I originally read the article, I now wonder about not only about the efficacy of such an aggregated approach, but also the ethics of it.
As Stake argues in the last chapter of Qualitative Research:
“I am not confident we serve the people we research well. How accurately do we read their need, their aspiration, their constraint? We are confident, sometimes overly confident, that the more we know about them, the better we tell their story. What is the evidence that the impoverished are empowered when we portray their impoverishment?” (202).
I suppose I wonder if this concern could be applied to macro qualitative research as well as micro? In exposing some of the hegemonies that historically marginalized groups have navigated, what is gained? The authors of argue that the third purpose of the CPLS is to design instruction that will “provide links between the literacy worlds of students and literacy instruction within formal educational contexts” (440), but how much of their research will actually support that goal? How much of it might actual objectify or homogenize “historically marginalized groups” under one rubric? I appreciated the sophistication of the CPLS and its goals (especially after discussing the potential and difficulty of the digital humanities last semester), but I did wonder if others had thoughts about both the possibility and the ethics of the database.