Friday, February 19, 2010

NAAL stats

Sheida White, Mark Kutner, Elizabeth Greenberg, Ying Jin, Bridget Boyle, Yung-chen Hsu, Eric Dunleavy. *Literacy in Everyday Life: Results From the 2003 National Assessment of Adult Literacy * Washington D.C.: National Center for Education Statistics, Institute of Education Sciences, 2007.

I want to look at this data because I think it shines a light on American literacy in a way theory cannot and because it helps me think about "literature" in terms of its social and political context.

The National Assessment of Adult Literacy (NAAL) tested adult Americans on a specific set of literacy skills, which they saw as essential to participation in the economic and political life of the nation. They divided these skills into three categories: prose, document, and qualitative literacies. Prose literacy will be the only category of concern here, since it is the one that most directly relates to the reading of creative work.

NAAL defines prose literacy as follows:
Prose literacy. The knowledge and skills needed to search, comprehend, and use information from continuous texts. Prose examples include editorials, news stories, brochures, and instructional materials. (iii)
Adults who are tested for this type of literacy achieve a sore between 0 and 500. NAAL divided these scores into four "levels" of prose literacy: proficient, intermediate, basic, and below basic. Adults unable to respond to the questions were not scored and were considered "non-literate in English." I've excluded "below basic" since this group is essentially unable to read and understand novels, poetry, or drama in English.

Here is how NAAL defined each level, by skill set and by score:
Basic: reading and understanding information in short, commonplace prose texts. Score: 210–264

Intermediate: reading and understanding moderately dense, less commonplace prose texts as well as summarizing, making simple inferences, determining cause and effect, and recognizing the author’s purpose. Score: 265–339

Proficient: reading lengthy,complex,abstract prosetexts as well as synthesizing information and making complex inferences. Score: 340–500 (4)
To give a more precise understanding of what skills were involved at each level, NAAL published a gradation of types of skills, each assigned a score according to its difficulty. For example, whereas below basic readers could not explain the meaning of a metaphor in a narrative, comprehension of metaphor increased in each literacy level:
241 [basic] Explain the meaning of a metaphor used in a narrative.
304 [intermediate] Infer the meaning of a metaphor in a poem.
345 [proficient] Compare and contrast the meaning of metaphors in a poem. (5)
I don't think I'm alone in saying that I consider the ability to compare and contrast metaphors in a poem to be a basic, essential requirement for reading and understanding literary poetry, and that persons not possessed of this skill are not likely to possess the necessary skills to read literary prose either. Consider, for example, this passage from *Ulysses*, which Wayne Booth makes us of in his study *The Company We Keep: An Ethics of Fiction*:
Ineluctable modality of the visible: at least that if no more, thought through my eyes. Signatures of all things I am here to read, seaspawn and seawrack, the nearing tide, that rusty boot. Snotgreen, bluesilver, rust: coloured signs. Limits of the diaphane. But he adds: in bodies. Then he was aware of them bodies before of them coloured. How? By knocking his sconce against them, sure. Go easy. Bald he was and a millionaire, *maestro di color che sanno*. Limit of the diaphane in. Why in? Diaphane, adiaphane. If you can put your five fingers through it it is a gate, if not a door. Shut your eyes and see.

Stephen closed his eyes to hear his boots crush crackling wrack and shells. You are walking through it howsomever. I am, a stride at a time. A very short space of time through very short times of space. Five, six: the *nacheinander*. Exactly: and that is the ineluctable modality of the audible. Open your eyes. No. Jesus! If I fell over a cliff that beetles o'er his base, fell through the *nebeneinander* ineluctably! I am getting on nicely in the dark. My ash sword hangs at my side. Tap with it: they do. My two feet in his boots are at the ends of his legs, *nebeneinander*. Sounds solid: made by the mallet of *Los Demiurgos*. Am I walking into eternity along Sandymount strand? Crush, crack, crick, crick. Wild sea money. Dominie Deasy kens them a'.
*Won't you come to Sandymount,
Madeline the mare?*
Rhythm begins, you see. I hear. Acatalectic tetrameter of iambs marching. No, agallop: *deline the mare*.

Open your eyes now. I will. One moment. Has all vanished since? If I open and am for ever in the black adiaphane. *Basta*! I will see if I can see.

See now. There all the time without you: and ever shall be, world without end. (273-4 in Booth)
Booth recommends we read the passage aloud. He's right. It's lovely to hear. High modernism at its finest. And it is, not, I think, a stretch to say that the skill set require to read such a passage far exceeds the ability to compare and contrast metaphors. One must be much more than proficient to get anything from the passage at all, except, perhaps, a feel for the music. Here's Booth explaining his reaction to the text:
When as a nineteen-year-old I first read the passage, in my often baffled but exhilarated plunge through the novel, I felt completely out-classed. I had never read Aristotle or Aquinas or any other philosopher bald or hairy who grappled with this problem in this way; all I knew was that Stephen is troubled by some mysterious phrase, one that was meaningless to me...And I can remember looking up some of the strange words, and mumbling that mouth-filler: "ineluctable modality of the visible."...One must, in short, become at least a bit philosophical to be able to enjoy the passage at all...//

The possible effects are of course not confined to philosophical inquiry. I am asked, secondly, to mime "being learned."...Even if I can't catch many of the allusions, I will suspect that many allusions are being made—at least that phrase in Italian, if that *is* Italian, is an allusion to *something*, as is the "*Basta!*" Who *is* this "he," this "bald millionaire"? Who or waht is "Madeline the mare?"...

If I happen to recognize the quotation from *King Lear*, I will feel that I am a *little bit* learned, but I'll suspect that there are more allusions that I miss. And what does *nacheinander* mean? I may look it // up, if I happen to recognize that it's German. Or I may simply aspire to become the sort of person, someday, who knows languages and doesn't *have* to look it up. (274-6)
Booth's point it to explain how good literature can inspire a young man to become a better, more intellectual man—philosophical and learned. But we have to remember that he is already a young man capable of reacting so positively due to his early literacy experiences, shaped by the value placed on reading and writing in his family of origin, his early schooling, his experience in the Morman Church, etc. When nineteen-year-old Wayne Booth first read Joyce, he was already functioning at the high-end of proficiency, and Joyce came along to show him that reading could be so much more, that he as a reader could be so much more.

Consider the same passage as read by someone at a low-proficient or intermediate level. There is every chance that he or she will find the passage meaningless. Perhaps the lower-level reader will recognize in it some literary value. If so, he or she may feel intimidated, or challenged, or humiliated, or disenfranchised, or whathaveyou. But he or she will *not* likely feel the same kind or degree of inspiration as Booth. He was at the apex of measurable literacy skill, ready to take wing; average readers, at best, simply recognize a gulf of skill and learning that stands between them and understanding the text.

This raises a line of ethical consideration not taken up by Booth in his reflection on Joyce: What is the meaning of such a text to the general public? How many people are able to react like Booth? Who are they? How do they get to be at their level of skill? How is this skill distributed among readers? By who and according to what criteria? Yes, *Ulysses* is lovely, but for whom?

Here are the NAAL stats on levels of prose literacy across the entire US population:
Below Basic:
1992---14%
2003---14%

Basic:
1992---28%
2003---29%

Intermediate
1992---43%
2003---44%

Proficient
1992---15%
2003---13% (13)
So if 15-13 percent of the US populace is proficient, and a smaller portion of that group is "high proficient," meaning capable of getting something from artists like Joyce or Pynchon or whoever else you want to name that writes difficult prose, then we have to conclude that *Ulysses* is lovely for only a few.

Three hundred million Americans (give or take). Maybe five percent at what I'm calling "high" literacy (which, admittedly, was not a category measured by the NAAL, so I'm guessing here, and I think I'm being generous with that 5%). That still makes 15,000,000 potential Joyce readers in the US. Not a bad audience for him at all, really. Even at 1% (more likely) there's still 3M potential fans for his type of thing. But still, a vast majority excluded. 297,000,000 Americans Joyce leaves out of his conversation.

In her new collection of essays, Elif Batuman asks: "What did craft ever try to say about the world, the human condition, or the search for meaning?" I want to answer that craft can't help but say something about the world, the human condition, the search for meaning. At all times, and in every way, craft is inextricably linked to such questions. Craft choices are choices from among social conventions, which themselves stand in relation to questions of equity, political questions concerning the relationship of the author to the reading (and non-reading) public. When an author makes craft choices, that author sets the terms of access to their text, including some readers, excluding some others. It is not possible to write an all-inclusive text, but this does not mean that as authors and as educators of future authors we should pretend that craft exists in a vacuum, apart from issues of race and class.

Here are the NAAL figures for average prose literacy score by race:
White
1992---287
2003---288

Asian/Pacific Islander
1992---255
2003---271

American Indian/Alaska Native
1992---254
2003---264

Black
1992---237
2003---243

Hispanic
1992---234
2003---216 (15)
The report acknowledges that "Hispanic" is an overly broad term, and then further breaks down that category by nation of origin, or ancestor's origin. Puerto Ricans were the only group that gained over the period.

Notice that no group is proficient on average (cut off for that level is 340) but, until 2003, only whites were intermediate on average (cut off 265). In 2003, whites were joined by the Asian/Pacific Islander grouping. All other groups are of basic proficiency on average. However, we should also note some significant gains in black and native populations. Inequality remains, and change is happening.

NAAL stats on the percent of adults at proficient or intermediate levels by race:
White
proficient
1992---18%
2003---17%
intermediate
1992---48%
2003---51%

Asian/Pacific Islander
proficient
1992---9%
2003---12%
intermediate
1992---36%
2003---42%

American Indian/Alaskan Native
proficient
1992---5%
2003---10%
intermediate
1992---35%
2003---41%

Hispanic
proficient
1992---5%
2003---4%
intermediate
1992---28%
2003---23%

Black
proficient
1992---2%
2003---2%
intermediate
1992---27%
2003---31% (16)
So, in 2003, when 68% of white adults were at intermediate or above, only 43% of black adults performed at the same level, and only 27% of Hispanics. Again, Puerto Ricans were the only group who gained over the period, with 44% of adults at intermediate or above in 2003.

An author who makes a choice to write complicated, beautiful, demanding prose, is an author who consents to exclude most Americans, including a disproportionate number of non-whites.

And, of course, money is a factor, too:

NAAL stats on average prose score by annual household income
<$10,000---229
$10,000-$14,999---237
$15,000-$19,999---244
$20,000-$29,999---257
$30,000-$39,999---268
$40,000-$59,999---282
$60,000-$99,999---303
$100,000 and up---316 (31)
That, I think, is a very impressive finding. Every increase in income bracket is an increase in prose literacy score.

Authors who aspire to write like Joyce also do so at the cost of excluding minorities and the poor.

The biggest objection I can think of to my reading of these stats is this: why should it be the author's job to set these things straight? Society is unfair, unequal; this is a question of social reform, not artistic integrity. If we were to take me seriously and attempt to write as inclusively as possible, it would mean the death of high literature in English and an impoverishment of our literary culture. Instead of asking authors to compromise their art, why not insist that society promote more minorities and more of the poor to "high proficient" literacy levels? Why not ask authors to help in this effort. In fact, Authors like Joyce, it could be argued, are the best advocates for the highest levels of literacy, since they show us what beauty can be achieved at those levels.

A good objection (if I do say so myself). And I can't disagree with it. Of course we should promote literacy more equitably. Of course we should not do anything to impoverish literary culture. We need Joyce. And we need more readers who can read Joyce. Absolutely.

So let me nuance my position a bit:
Authors who write in English for an American audience send their work out into the social realities of that audience. These authors have choices to make about audience. Who will read their work? What would they like their work to mean, do *do*, and to whom? As they consider these questions, they must have access to clear data about the realities of American literacy to guide them in their "craft" choices. All craft decisions, from genre to "level" of prose, are decisions that shape the potential audience for the work, including some and excluding others. Responsible participation in creative writing literacy requires that authors make their choices purposefully and address both form and content to the included recipients of their work.

The English Lit folks owe it to America to create more Wayne Booths. And especially more black, Latino Wayne Booths. Wayne Booths who are granted a leg-up from poverty.

We CW folks owe it to America to produce more black, Latino, poor James Joyces, yes. But also to create creative writers to are aware of and act as conscious participants in the social realities of American literacy.

Booth citation:
Booth, Wayne. *The Company We Keep: An Ethics of Fiction.* Berkley: University of California Press, 1988. Print.

1 comment:

  1. As a post-script, some more objections to this reading of these stats.

    First, these stats value a particular set of skills valued by the dominant culture. To say that only these skills constitute literacy, is to exclude all the other literacy skills and traditions that exist in the US, and these are many and various as literacy researchers have discovered. To insist on these skills is essentially to insist on "white middle- and upper-class" literacy at the expense of all other literacy forms.

    Rebuttal: because these particular skills are a part of white middle and upper class literacy, they are tied to participation in the economy. Attainment of proficient prose literacy is a necessary but not sufficient precondition for economic access. To examine these stats is not to insist on their skills as the be-all end-all of literacy. Rather, it is to discover social and economic inequality.

    Second, some would object that "Joycean" literacy, as the highest expression of this white middle- and upper-class literacy, is suspect and should not necessarily be valued and promoted. Nor enforced among the poor and minorities in the name of "equality" or "social progress." Rather, new literacies should be allowed to come their own highest expression, and be valued as such. We don't need new Joyces; we need new Amiri Barakas and the like. Not new Wayne Booths, but new Henry Louis Gates Jrs.

    This, I think is an excellent point. One deserving of more careful consideration. We must reexamine the NAAL skills and ask whether "black" or "latino" prose literacy would really require a different set of skills. If so, what are they? And surely, some of these skills must be the same or similar...am I naive to think that all poetry reading, regardless of ethnic origin, benefits from the ability to compare and contrast metaphors?

    ReplyDelete