Skip to content

Manual vs automated identification of English L2 suffixes and complex words across levels of proficiency

Jul 2026 · International Journal of Learner Corpus Research · 0 citations · 35 references

TL;DR

The efficiency metrics showed the tool to be effective in accurately identifying the target suffixes across proficiency levels, with a significant reduction in time and effort.

Abstract

This report presents the preliminary evaluation of Morph , a web-based tool for the automatic counting of 51 English noun derivational suffixes in a controlled corpus of Mexican learners of English with proficiency levels from A2 to C1 on the Common European Framework of Reference for Languages (CEFR) scale. The evaluation consisted of a quantitative analysis of agreement between human annotators and Morph , a qualitative analysis to obtain the sources of disagreement, and finally, the evaluation of the tool’s efficiency using precision, recall, and F1 score metrics. Results displayed a high level of agreement between the human annotators and Morph . The main sources of disagreement were found to be human errors, learner misspellings, and automatic tagger issues. Finally, the efficiency metrics showed the tool to be effective in accurately identifying the target suffixes across proficiency levels, with a significant reduction in time and effort.

View source

Similar papers

Open access Jul 2026

Morphologically Annotated Lexical Decision Data for 12,242 Czech Word Forms

We present CzeLeD, a large-scale lexical decision dataset for Czech containing 12,242 lemmas and inflected word forms derived from the HeCz self-paced reading corpus and supplemented with pseudowords. A total of 1,977 participants contributed over 849,000 trials, accompanied by demographic data and extensive linguist...

J. Chromý, Markéta Ceháková, Mikuláš Preininger et al. · 0 citations
Open access Aug 2026

An improved metric for estimating morphological information in corpora

This paper uses morphological feature annotations from the Universal Dependencies corpora to quantify information carried by morphology across 154 different datasets spanning 72 language varieties, and proposes an information-theoretic approach that measures how surprising morphological feature values are given a token...

Hedvig Skirgård, S. Mann · 1 citation
Jul 2026

Challenges in annotations by humans and LLMs: A case study of evaluative language

In this paper, we draw a comparison between linguists in training, a trained linguist, and annotations generated by large language models (LLMs) to find out if they struggle with complex linguistic phenomena in a similar way. For this purpose, we analyse evaluative language in spoken popular science discourse, with the...

Mirela Imamović, Aenne Knierim, Khushi Pitroda et al. · 0 citations
Open access Aug 2026

An Investigation of L2 Preposition Usage and Error Types: The Case of Turkish-English Bilinguals

Acquiring L2 prepositions is a complex process, as bilinguals often find it difficult to use the correct preposition in a target language such as English. While frequency of prepositions and prepositional phrases can help this acquisition process, additional factors such as L1 influence also play an important role. Fur...

Enis Oğuz · 0 citations
Review Open access 2026

Comparative Evaluation of Latin Natural Language Processing Tools for Pedagogical Applications

A narrative review compares contemporary Latin Natural Language Processing tools and their use cases for pedagogical applications and concludes that an integrated, multi-tool approach is most effective for supporting Latin pedagogy.

Aidan Han · 0 citations
#natural language process... Preprint Aug 2026

PERCEPT: A Corpus for POS Tagging and Analysis of Persian-English Code-Mixing

This work introduces PERCEPT, the first publicly available large-scale Persian-English code-mixed corpus annotated with Universal Dependencies POS tags for code-mixed words, and conducts the first comprehensive linguistic analysis of Persian-English code-mixing across multiple social media platforms.

Ghazal Kalhor, Zahra Jafari, Amirarsalan Shahbazi et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.