A Rubric for Extracting Idea Density from Oral Language Samples

Vineeta Chand1, Kathleen Baynes2, Lisa M. Bonnici3, Sarah Tomaszewski Farias1

1 Department of Language and Linguistics, University of Essex, Colchester, United Kingdom, 2 Center for Mind and Brain, University of California at Davis, Davis, California, 3 Department of Linguistics, University of California at Davis, Davis, California
Publication Name:  Current Protocols in Neuroscience
Unit Number:  Unit 10.5
DOI:  10.1002/0471142301.ns1005s58
Online Posting Date:  January, 2012
GO TO THE FULL TEXT: PDF or HTML at Wiley Online Library


While past research has demonstrated that low idea density (ID) scores from natural language samples correlate with late life risk for cognitive decline and Alzheimer's disease pathology, there are no published rubrics for collecting and analyzing language samples for idea density to verify or extend these findings into new settings. This unit outlines the history of ID research and findings, discusses issues with past rubrics, and then presents an operationalized method for the systematic measurement of ID in language samples, with an extensive manual available as a supplement to this unit (Analysis of Idea Density, AID). Finally, reliability statistics for this rubric in the context of dementia research on aging populations and verification that AID can replicate the significant association between ID and late‐life cognition are presented. Curr. Protoc. Neurosci. 58:10.5.1‐10.5.15. © 2012 by John Wiley & Sons, Inc.

Keywords: idea density; Alzheimer's disease semantics; language; cognitive reserve

PDF or HTML at Wiley Online Library

Table of Contents

  • Introduction
  • Background
  • Previous Methods for Measuring ID
  • AID
  • Data Elicitation
  • Transcription
  • Word Count
  • Idea Coding
  • Additional Linguistic Measures in AID
  • AID Findings
  • AID Inter‐Rater Reliability
  • Discussion
  • Acknowledgements
  • Literature Cited
  • Tables
PDF or HTML at Wiley Online Library


PDF or HTML at Wiley Online Library



Literature Cited

Literature Cited
   Armstrong, E. 2005. Language disorder: A functional linguistic perspective. Clin. Linguist. Phon. 19:137‐153.
   Baird, A.D., Ford, M., and Podell, K. 2007. Ethnic differences in functional and neuropsychological test performance in older adults. Arch. Clin. Neuropsychol. 22:309‐318.
   Bayles, K.A., Tomoeda, C.K., and Trösset, M.W. 1992. Relation of linguistic communication abilities of Alzheimer's patients to stage of disease. Brain Lang. 42:454‐472.
   Baynes, K., Chand, V., Bonnici, L., and Farias, S.T. 2007. Idea density as a measure of communicative skill in Alzheimer's Disease. Advances in Basic and Clinical Neuropsychology, Midyear Meeting, Bilbao, Spain.
   Biber, D., Johansson, S., Leech, G., Conrad, S., and Finegan, E. 1999. Longman Grammar of Spoken and Written English. Longman Publications Group, Harlow, U.K.
   Boone, K.B., Victor, T.L., Wen, J., Razani, J., and Ponton, M. 2007. The association between neuropsychological scores and ethnicity, language, and acculturation variables in a large patient population. Arch. Clin. Neuropsychol. 22:355‐365.
   Brown, C., Snodgrass, T., Kemper, S.J., Herman, R., and Covington, M.A. 2008. Automatic measurement of propositional idea density from part‐of‐speech tagging. Behav. Res. Methods 40:540‐545.
   Brysbaert, M. and New, B. 2009. Moving beyond Kuéera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behav. Res. Methods 41:977‐990.
   Byrd, D.A., Miller, S.W., Reilly, J., Weber, S., Wall, T.L., and Heaton, R.K. 2006. Early environmental factors, ethnicity, and adult cognitive test performance. Clin. Neuropsychol. 20:243‐260.
   Causino Lamar, M.A., Obler, L.K., Knoefel, J.E., and Albert, M.L. 1994. Communication patterns in end‐stage Alzheimer's disease: Pragmatic analyses. In Discourse Analysis and Applications: Studies in Adult Clinical Populations (R.L. Bloom, L.K. Obler, S. De Santi, and J.S. Ehrlich, eds.) pp. 217‐235. Lawrence Erlbaum, Hillsdale, N.J.
   Chafe, W. 1985. Linguistic differences produced by differences between speaking and writing. In Literacy, Language, and Learning (D.R. Olson, A. Hildyard, and N. Torrance, eds.) pp. 105‐123. Cambridge University Press, Cambridge.
   Chafe, W. and Tannen, D. 1987. The relation between written and spoken language. Annu. Rev. Anthropol. 16:383‐407.
   Cosentino, S., Manly, J., and Mungas, D. 2007. Do reading tests measure the same construct in multiethnic and multilingual older persons? J. Int. Neuropsychol. Soc. 13:228‐236.
   Covington, M.A. 2007. CPIDR 3 User Manual. CASPR Research Report 2007‐3, Artificial Intelligence Center, The University of Georgia, Athens, Ga.
   Croisile, B., Ska, B., Brabant, M.‐J., Duchene, A., Lepage, Y., Aimard, G., and Trillet, M. 1996. Comparative study of oral and written picture description in patients with Alzheimer's disease. Brain Lang. 53:1‐19.
   Davis, B.H. and Maclagan, M. 2009. Examining pauses in Alzheimer's discourse. Am. J. Alzheimers Dis. Other Demen. 24:141‐154.
   Edwards, J.A. 1993. Principles and contrasting systems of discourse transcription. In Talking Data: Transcription and Coding in Discourse Research (J.A. Edwards and M.D. Lampert, eds.) pp. 3‐31. Lawrence Erlbaum Associates, Hillsdale, N.J.
   Ehrlich, J.S. 1994. Studies of discourse production in adults with Alzheimer's disease. In Discourse Analysis and Applications: Studies in Adult Clinical Populations (R.L. Bloom, L.K. Obler, S. De Santi, and J.S. Ehrlich, eds.) pp. 149‐160. Lawrence Erlbaum, Hillsdale, N.J.
   Ehrlich, J.S., Obler, L.K., and Clark, L. 1997. Ideational and semantic contributions to narrative production in adults with dementia of the Alzheimer's type. J. Comm. Disord. 30:79‐99.
   Engelman, M., Agree, E.M., Meoni, L.A., and Klag, M.J. 2010. Propositional density and cognitive function in later life: Findings from the precursors study. J. Gerontol. B Psychol. Sci. Soc. Sci. 65:706‐711.
   Fillmore, C.J. 1968. The case for case. In Universals in Linguistic Theory (E. Bach and R.T. Harms, eds.) pp. 1‐88. Holt, Rinehart & Winston, New York.
   Fillmore, C.J. 1969. Modern studies in English. In Toward a Modern Theory of Case (D.A. Reibel and S.A. Schane, eds.) pp. 361‐375. Prentice‐Hall, Englewood Cliffs, N.J.
   Fox, A.A. 2004. Real country: Music and Language in Working‐Class Culture. Duke University Press, Durham, N.C.
   Gales, T. and Chand, V. 2010. A Corpus‐Based Approach to Word Frequency and Syntactic Categories: Untangling Their Relationship Within Sound Change. Linguistic Society of America, Baltimore.
   Garcia, L.J. and Joanette, Y. 1994. Conversational topic‐shifting analysis in dementia. In Discourse Analysis and Applications: Studies in Adult Clinical Populations (R.L. Bloom, L.K. Obler, S. De Santi, and J.S. Ehrlich, eds.) pp. 161‐183. Lawrence Erlbaum, Hillsdale, N.J.
   Garrard, P., Maloney, L.M., Hodges, J.R., and Patterson, K. 2005. The effects of very early Alzheimer's disease on the characteristics of writing by a renowned author. Brain 128:250‐260.
   Gasquoine, P.G. 1999. Variables moderating cultural and ethnic differences in neuropsychological assessment: The case of Hispanic Americans. Clin. Neuropsychol. 13:376‐383.
   Guendouzi, J.A. and Müller, N. 2006. Approaches to discourse in dementia, Lawrence Erlbaum, Mahwah, N.J.
   Iacono, D., Markesbery, W.R., Gross, M., Pletnikova, O., Rudow, G., Zandi, P., and Troncoso, J.C. 2009. The Nun Study. Clinically silent AD, neuronal hypertrophy, and linguistic skills in early life. Neurology 73:665‐673.
   Ioannidis, J.P.A. 2005. Why most published research findings are false. PLoS Medicine 2:696‐701.
   Kave, G. and Levy, Y. 2003. Morphology in picture descriptions provided by persons with Alzheimer's disease. J. Speech Lang. Hear. Res. 44:341‐352.
   Kemper, S.J. 1992. Language and aging. In The Handbook of Aging and Cognition (F.I.M. Craik and T.A. Salthouse, eds.) pp. 213‐270. Lawrence Erlbaum, Hillsdale, N.J.
   Kemper, S.J. 1993. Language Across the Life Span: Coding Manual. Lawrence, Kansas.
   Kemper, S.J. and Summer, A. 2001. The structure of verbal abilities in young and older adults. Psychol. Aging 16:312‐322.
   Kemper, S.J., LaBarge, E., Ferraro, F.R., Cheung, H., Cheung, H., and Storandt, M. 1993. On the preservation of syntax in Alzheimer's disease: Evidence from written sentences. Arch. Neurol. 50:81‐86.
   Kemper, S.J., Greiner, L.H., Marquis, J.G., Prenovost, K., and Mitzner, T.L. 2001. Language decline across the life span: Findings from the nun study. Psychol. Aging 16:227‐239.
   Kintsch, W. 1974. The Representation of Meaning in Memory. Lawrence Erlbaum, Hillsdale, N.J.
   Liu, L.H. 1999. The question of meaning‐value in the political economy of the sign. In Tokens of Exchange: The Problem of Translation in Global Circulations (L.H. Liu, ed.) pp. 13‐41. Duke University Press, Durham, N.C.
   Long, D.L., Baynes, K., and Prat, C.S. 2005. The propositional structure of discourse in the two cerebral hemispheres. Brain Lang. 95:383‐394.
   Manly, J.J. and Echemendia, R.J. 2007. Race‐specific norms: Using the model of hypertension to understand issues of race, culture, and education in neuropsychology. Arch. Clin. Neuropsychol. 22:319‐325.
   Martin, J.R. and Rose, D. 2003. Working with Discourse: Meaning Beyond the Clause. Continuum, London.
   Miller, L.M.S. 2003. The effects of age and domain knowledge on text processing. J. Gerontol. B Psychol. Sci. Soc. Sci. 58:217‐223.
   Mitzner, T.L. and Kemper, S.J. 2003. Oral and written language in late adulthood: Findings from the nun study. Exp. Aging Res. 29:457‐474.
   Morris, J. 1993. The clinical dementia rating (CDR): Current version and scoring rules. Neurology 43:2412‐2414.
   Mortensen, L. 1992. A transitivity analysis of discourse in dementia of the Alzheimer's type. J. Neurolinguist. 7:309‐321.
   Müller, N. and Guendouzi, J.A. 2005. Order and disorder in conversation: Encounters with dementia of the Alzheimer's type. Clin. Linguist. Phonet. 19:393‐404.
   Mungas, D., Beckett, L., Harvey, D., Farias, S.T., Reed, B.R., Owen, C., Olichney, J., Miller, J., and DeCarli, C. 2010. Heterogeneity of cognitive trajectories in diverse older persons. Psychol. Aging 25:606‐619.
   Mungas, D., Harvey, D., Reed, B.R., Kagust, W.J., DeCarli, C., Beckett, L., Mack, W.J., Kramer, J.H., Weiner, M.W., Schuff, N., and Chui, H.C. 2005. Longitudinal volumetric MRI change and rate of cognitive decline. Neurology 65:565‐571.
   Pavlenko, A. 2008. Narrative analysis. In The Blackwell Guide to Research Methods in Bilingualism (M. Moyer and L. Wei, eds.) pp. 311‐325. Blackwell, Oxford.
   Ramanathan, V. 1997. Alzheimer Discourse: Some Sociolinguistic Dimensions. Lawrence Erlbaum, Mahwah, N.J.
   Reed, B.R., Chand, V., Baynes, K., Bonnici, L., and Farias, S.T. 2010. Is idea density in late life a marker of cognitive reserve? Effects on cognitive decline. 38th Annual Meeting of the International Neuropsychological Society, Acapulco, Mexico.
   Riley, K.P., Snowdon, D.A., Derosiers, M.F., and Markesbery, W.R. 2005. Early life linguistic ability, late life cognitive function, and neuropathology: Findings from the nun study. Neurobiol. Aging 26:341‐347.
   Snowdon, D.A., Kemper, S.J., Mortimer, J.A., Greiner, L.H., Wekstein, D.R., and Markesbery, W.R. 1996. Linguistic ability in early life and cognitive function and Alzheimer's disease in late life. Findings from the nun study. JAMA 275:528‐532.
   Snowdon, D.A., Greiner, L.H., Kemper, S.J., Nanayakkara, N., and Mortimer, J.A. 1999. Linguistic ability in early life and longevity: Findings from the nun study. In The Paradoxes of Longevity (J.‐M. Robine, B. Forette, C. Francheschi, and M. Allard, eds.) pp. 103‐113. Springer‐Verlag, Berlin, Germany.
   Snowdon, D.A., Greiner, L.H., and Markesbery, W.R. 2000. Linguistic ability in early life and the neuropathology of Alzheimer's disease and cerebrovascular disease: Findings from the nun study. Ann. New York Acad. Sci. 903:34‐>38.
   Stern, Y. 2002. What is cognitive reserve? Theory and research application of the reserve concept. J. Int. Neuropsychol. Soc. 8:448‐460.
   Stern, Y. 2003. The concept of cognitive reserve: A catalyst for research. J. Clin. Exp. Neuropsychol. 25:589‐593.
   Turner, A. and Greene, E. 1977. The construction and use of a propositional text base. Technical Report No. 63. Institute for the Study of Intellectual Behavior, University of Colorado, Boulder, Colo.
PDF or HTML at Wiley Online Library