Skip to content

ActReview: Rebuttal-Guided Training Data and Rubric Rewards for Actionable Peer Review Generation

Sep 2026 · 0 citations · 28 references
Computer Science

TL;DR

This work introduces ActReview, a rebuttal-guided post-training framework that connects paper-specific diagnoses to concrete, grounded revision plans, and introduces ActReview-Bench, a human-curated benchmark of 1,000 instances for evaluating diagnostic quality and revision usefulness.

Abstract

As LLMs are increasingly used for pre-submission self-review, there is growing demand for feedback that not only identifies weaknesses but also guides authors toward concrete revisions. We study this as Actionable Peer-review Generation and decompose it into two subtasks: diagnostic claim generation and revision suggestion generation. We introduce ActReview, a rebuttal-guided post-training framework that connects paper-specific diagnoses to concrete, grounded revision plans. Our central insight is that author rebuttals reveal plausible actions for addressing reviewer concerns and can therefore provide latent supervision for revision-oriented feedback. From real review-rebuttal threads on OpenReview, we construct ActReview-40K by aligning reviewer weaknesses with author responses and grounding the resulting feedback in localized paper evidence. We post-train Qwen3-8B-Base with multi-task supervised fine-tuning followed by GRPO using candidate-aware, weakness-specific rubric rewards. We also introduce ActReview-Bench, a human-curated benchmark of 1,000 instances for evaluating diagnostic quality and revision usefulness. Experiments show that ActReview outperforms prior specialized review-generation models on actionability and grounding while remaining competitive with strong prompt-based LLMs. Human evaluation confirms improved revision usefulness while revealing a remaining gap in technical accuracy, and additional analyses support generalization to held-out papers and robustness across independent judges.

View source

Similar papers

#natural language process... Preprint Aug 2026

GenRubric: Self-Evolving Rubric Generation for Scalable LLM Evaluation

GenRubric is introduced, a self-evolving framework that improves rubric generation from unlabeled queries without requiring additional human annotations during self-evolution, and experiments show that self-evolution improves the agreement between evaluations induced by generated rubrics and those induced by expert-wri...

Yifan Chen, Hai-Tao Li, Qing-Yao Ai et al. · 6 citations · ⚡4
#natural language process... Preprint Sep 2026

Generating Constructive Feedback on Stories via Reinforcement Learning

Constructive feedback is crucial for creative writers to refine their storytelling abilities. Since receiving feedback from human experts is often costly and time-intensive, large language models (LLMs) offer a scalable and efficient alternative as automatic writing assistants. Despite their potential, research indicat...

Maja Stahl, Timon Ziegenbein, Henning Wachsmuth · 0 citations
Review Aug 2026

Prompt-Level Supervisory Alignment for Anticipatory Manuscript Revision

Researchers increasingly use large language models (LLMs) to revise manuscripts in response to peer reviews, yet this adoption is largely unprincipled and risks the ironies of automation. Prompt-Level Supervisory Alignment (PLSA) applies Supervisory Control Theory as a structured prompting strategy for LLM-assisted man...

Wangfan Li, Sofia Abilene Campos Hernandez, Carlos Toxtli · 0 citations
#machine learning Review Sep 2026

When AI Reviews Train AI Reviewers: Scientific-Judgment Collapse and Mitigation

This study introduces TrustReviewer, an open-source LLM-based system for generating peer reviews of AI and machine learning papers and describes a concrete risk of recursive reviewer training and provides practical interventions for preserving judgment diversity and improving recommendation alignment in AI-assisted sci...

Sy-Tuyen Ho, Ming-Hui Liu, Fu-Rong Huang · 0 citations
Review Aug 2026

Metag: A dataset to build agentic meta-reviewing capabilities

Metag is a dataset to accelerate the development of meta-reviewing agents, specifically to identify changes made to scientific articles during the review-rebuttal process and will enable building methods to empower meta reviewers to quickly identify whether authors have addressed reviewer statements and where in the pa...

Anirudh S. Sundar, Min Chen, Divya Tadimeti et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Nov 17, 2026

Learning the language of machine learning

By studying the computational foundations of language learning, Associate Professor Jacob Andreas builds intelligent systems that can communicate effectively with humans.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.