Author

Afonso Baldo

h-index 1 View on Semantic Scholar

We have 2 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Oct 2026

Mitigating Reward Hacking in Preference Reward Models with Evolving Penalties

Reinforcement learning for language models has moved from preference reward models to verifiable rewards, which sustain much longer optimization. Preference models are prone to reward hacking: the policy raises their score without improving response quality, or even while degrading it. Yet for open-ended tasks, where q...

Afonso Baldo, António Farinhas, Marcos V. Treviso et al. · 0 citations

Preprint Aug 2026

Move by Move: Measuring and Steering How LLMs Conduct Psychotherapy

Users increasingly turn to large language models for emotional support, yet little is known about how these models actually conduct a psychotherapy interaction. We introduce an ontology of ten therapeutic moves: compact, function-based categories grounded in the MULTI-60 inventory, validated through an annotation campa...

Afonso Baldo, Hugo Pitorro, Areti Vassilopoulos et al. · 0 citations