Skip to content
Review

Identifying and modeling careless and insufficient effort responding in continuous rating scale: A response-time-based mixture model.

Sep 2026 · Psychological methods · 0 citations
Medicine

Abstract

With the rise of computerized testing platforms, social science surveys increasingly use continuous rating scales (CRS), such as visual analog scales and sliders, to capture nuanced respondent data. However, careless and insufficient effort responding (C/IER), driven by low respondent motivation, introduces significant response bias, compromising measurement accuracy and the validity of statistical analyses. Traditional methods for detecting C/IER, developed for Likert-type responses, are incompatible with the continuous bounded data from CRS. This study develops the continuous bounded item response model for C/IER (CBIRM-C/IER), which integrates continuous bounded item response theory modeling with response-time-based mixture modeling to identify and model C/IER at the person-by-item level. Through two simulation studies, we evaluated the model's parameter recovery under various conditions, demonstrating consistent accuracy and robust performance with C/IER-contaminated data compared with conventional item response theory models. An empirical application evaluated the CBIRM-C/IER model's fit and parameter estimation against traditional models. By detecting and modeling C/IER at the person-by-item level, CBIRM-C/IER provides more reliable estimates of the trait of interest. In summary, CBIRM-C/IER can help practitioners identify and model C/IER within CRS data to obtain more accurate estimates of the trait of interest. (PsycInfo Database Record (c) 2026 APA, all rights reserved).

View source

Similar papers

Open access Oct 2026

Understanding when mixture models effectively identify careless responding: Simulation and validity evidence

Careless and insufficient effort responding (C/IER) in self-report questionnaires refers to responses provided without adequate attention to item content. Latent variable mixture models have recently been proposed as a promising approach for detecting and accounting for C/IER. This study systematically evaluates the pe...

I. Uglanova, Gabriel Nagy, Esther Ulitzsch · 0 citations
Open access Oct 2026

ierfair: An R Package for Ability-Conditioned Fairness Diagnostics of Insufficient-Effort Responding on Background Questionnaires.

Insufficient-effort/careless responding (IER) on self-report background questionnaires attached to large-scale assessments (e.g., PIRLS, PISA, and TIMSS) is routinely screened with indicator-based methods (e.g., longstring, response variability, Mahalanobis distance, and psychometric synonym/antonym consistency). These...

Diana Rosita, Muhammad Sukirlan, Nurlaksana Eko Rusminto et al. · 0 citations
Review Open access Sep 2026

Insufficient Effort Responding and Adolescent Respondents: Measurement, Extent, and Prediction

This article addresses insufficient effort responding (IER), an issue in survey research affecting data quality. We focus on predicting reactive-check-based IER classifications through nonreactive measures and estimating the proportion of respondents classified as IER in a pupil population, using a sizeable adolescent...

Thomas Krause, S. Vogl, Christine Sälzer · 0 citations
Open access Oct 2026

Homogeneity-Pursuit Calibration of Item Response Theory Models with Limited Samples and Sparse Response Data.

Calibrating item response theory models is challenging when item banks are large relative to available sample sizes and response data are sparsely observed, as commonly occurs in classroom assessment, low-stakes testing, and early-stage item bank development. These challenges are particularly pronounced for the two-par...

Shi-Yu Wang, Cong Cheng, Yuan Ke et al. · 0 citations
Review Oct 2026

Dynamic Extended Generalized Many-Facet Rasch Model: A Unified Approach to Rater-Mediated Assessment

Rating procedures are crucial in psychological and medical diagnosis, educational assessment, peer review, and grant evaluation. A major methodological challenge is disentangling multiple sources of variability in ratings, such as subject ability, rater behavior, and item characteristics. Item Response Theory-based mod...

Giuseppe Mignemi, Patrícia Martinková, S. Paganin · 0 citations
Open access Sep 2026

Assessing Threshold Ordering and Advancement in the Polytomous Rasch Model: A Probability-Based Framework.

Rating scales are widely used to measure attitudes, personality traits, and other psychological constructs, yet their response categories may not function as intended. This paper introduces a probability-based framework for interpreting threshold ordering and threshold advancement in the polytomous Rasch model. Specifi...

P. Anselmi, D. Colledani, E. Robusto et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.