Resumo

PERALTA, Nathaly Rayen Reyes; RAMIREZ-PENA, Pamela Francesca; SOTO, Christian  e  PALMA, Diego. AUTOMATED ASSESSMENT AND EXPERT JUDGMENT IN ESTIMATING TEXTUAL COMPLEXITY: AN ANALYSIS APPLIED TO SCIENCE SCHOOL TEXTS. Lingüística [online]. 2025, vol.41, e205.  Epub 25-Ago-2025. ISSN 2079-312X.  https://doi.org/10.5935/2079-312x.20250009.

Reading comprehension in school contexts is influenced not only by the reader’s characteristics but also by the linguistic features of the texts. Within this framework, textual complexity has become a relevant research focus, particularly for improving the criteria used to select educational materials. This study analyzes the relationship between teachers’ judgments regarding the complexity of school science texts and the automated linguistic indices generated by TRUNAJOD, a computational tool designed to assess readability in Spanish.

A quantitative, non-experimental, correlational design was used. Reading and writing specialists participated by evaluating a corpus of 80 science texts extracted from secondary school textbooks. The texts were grouped by educational level, and the data were analyzed using hierarchical regressions, Student’s t-tests, and Kendall’s coefficient of concordance. Results indicate that the most predictive indices of perceived textual complexity are lexical (familiarity, frequency, diversity, imageability) and cohesive (verb overlap, causal markers). Furthermore, variation in evaluation criteria was observed by educational level, with broader linguistic attention in lower grades and a narrower focus on lexical elements in higher grades. It is concluded that teachers’ judgments reflect sensitivity to the linguistic properties of texts, although mediated by their disciplinary background. This study provides evidence for the development of hybrid tools for textual evaluation and encourages further research using expanded corpora and evaluators from diverse subject areas.

Palavras-chave : Textual complexity; expert judgment; readability; school texts; computational linguistics.

        · resumo em Português | Espanhol     · texto em Espanhol     · Espanhol ( pdf )