Skip to content
Open access

FactUEP at SemEval-2026 Task 4: Structured Narrative Similarity Scoring with Aspect Decomposition and Weak-Signal Gating

2026 · SemEval@ACL · pp. 1075-1088 · 1 citation · ⚡ 1 influential · 11 references
Computer Science

TL;DR

An LLM-based sys-tem is introduced that operationalizes the three core dimen-sions—Abstract Theme, Course of Action, and Outcomes—via schema-constrained prompting to enforce structured outputs and alignment with the annotation protocol.

Abstract

This paper presents approach to narrative similarity prediction for SemEval-2026 Task 4 Track A. We introduce an LLM-based sys-tem that operationalizes the three core dimen-sions—Abstract Theme, Course of Action, and Outcomes—via schema-constrained prompting to enforce structured outputs and alignment with the annotation protocol. The sys-tem proceeds in three stages: structured aspect decomposition and scoring, weak-signal gating for low-confidence cases, and a targeted LLM-based tiebreak. The final model achieved near-human performance and ranked second on the Track A leaderboard.

Read PDF

Similar papers

Jul 2026

The Maskability Index: Predicting Task-Objective Alignment in Pretrained Language Models

The Maskability Index (MI) is introduced, a quantitative metric that estimates whether a knowledge relation is better suited to masked-style prompting or prefix-style prompting in few-shot generation, providing a principled measure of objective-template alignment.

Ahmad Pouramini, Mahsa Afsharzadeh · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.