Automated measures of speech content and speech organization in schizophrenia: test-retest reliability and generalizability across demographic variables

dc.contributor.authorMinor, Kyle S.
dc.contributor.authorLundin, Nancy B.
dc.contributor.authorMyers, Evan J.
dc.contributor.authorFernández Villardón, Aitana
dc.contributor.authorLysaker, Paul H.
dc.date.accessioned2025-11-03T10:51:50Z
dc.date.available2025-11-03T10:51:50Z
dc.date.issued2023-02
dc.date.updated2025-11-03T10:51:50Z
dc.description.abstractTechnological advances in artificial intelligence and natural language processing have increased efficiency of assessing speech content and speech organization in schizophrenia. Despite these developments, there has been little focus on the psychometrics of these approaches. Using two common assessments, the current study addressed this gap by: 1) measuring test-retest reliability; and 2) assessing whether speech content and/or speech organization generalize across demographics. To test these aims, we examined psychometric properties of the Linguistic Inquiry Word Count (LIWC), a speech content measure, and the Coh-Metrix, a speech organization measure. Across baseline to six month (n = 101) and baseline to one year (n = 47) narrative speech samples, we generally observed fair reliability for speech content measures and fair to good reliability for speech organization measures. Regarding demographics, multiple speech indices varied by race, income, and education. The lack of excellent reliability scores for speech indices holds important implications for examining speech variables in clinical trials and highlights the dynamic nature of speech. This work illustrates the importance of designing speech content and speech organization measures with external validity across demographic factors. Future studies examining speech in schizophrenia should account for potential biases against demographic groups introduced by linguistic analysis tools.en
dc.identifier.citationMinor, K. S., Lundin, N. B., Myers, E. J., Fernández-Villardón, A., & Lysaker, P. H. (2023). Automated measures of speech content and speech organization in schizophrenia: test-retest reliability and generalizability across demographic variables. Psychiatry Research, 320. https://doi.org/10.1016/J.PSYCHRES.2023.115048
dc.identifier.doi10.1016/J.PSYCHRES.2023.115048
dc.identifier.eissn1872-7123
dc.identifier.issn0165-1781
dc.identifier.urihttps://hdl.handle.net/20.500.14454/4225
dc.language.isoeng
dc.publisherElsevier Ireland Ltd
dc.rights© 2023 Elsevier B.V.
dc.subject.otherRace
dc.subject.otherReliability
dc.subject.otherSchizophrenia
dc.subject.otherSpeech content
dc.subject.otherSpeech organization
dc.titleAutomated measures of speech content and speech organization in schizophrenia: test-retest reliability and generalizability across demographic variablesen
dc.typejournal article
dcterms.accessRightsmetadata only access
oaire.citation.titlePsychiatry Research
oaire.citation.volume320
Archivos
Colecciones