Skip to content

Author

Orfeas Menis-Mastromichalakis

We have 5 of 35 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Sep 2026

Benchmarking Gender Bias in Machine Translation Evaluation Metrics across Occupations

Gender bias remains a persistent concern in machine translation (MT), affecting both generated translations and their automatic evaluation. When a source text leaves a person's gender unspecified, translations may realize that person using masculine or feminine forms, and both MT systems and evaluation metrics may exhi...

Orfeas Menis-Mastromichalakis, Giorgos Filandrianos, Wafaa Mohammed et al. · 0 citations

An Empirical Study of Counterfactual Self-Explanations in LLMs

This work evaluates ten instruction-tuned models from the LLaMA-3 and Qwen-2.5 families, measuring faithfulness, minimality, and alignment with human-annotated rationales and shows that model scale is the strongest determinant of explanation quality.

Giannis Kalyvas, Giorgos Filandrianos, Orfeas Menis-Mastromichalakis et al. · 0 citations
#artificial intelligence Preprint Sep 2026

AURA-Eval: Evaluation Framework for Acting Under Risk Awareness in LLM Agent Trajectories

AURA-Eval, a framework combining controlled augmentation with granular diagnosis of behavior in tool-use trajectories, is introduced, showing that LLM agents engage in unsafe behavior more often when no safe fulfillment path exists.

Ruoxi Shang, Christina-Maria Androna, Orfeas Menis-Mastromichalakis et al. · 0 citations
#artificial intelligence Review Sep 2026

Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluation

Harbor Adapters are developed that port more than 80 benchmarks to evaluate arbitrary agents, and validated through rigorous code review and parity experiments, and Harbor-Index is introduced, a curated set of 82 difficult, diverse, and high-quality tasks spanning 29 benchmarks to support more reliable and comprehensiv...

Lin Shi, Hao-Wei Lin, Zi-Xuan Zhu et al. · 1 citation

Last Translation Benchmark

The Last Translation Benchmark is introduced, a collection of human-authored and peer-reviewed examples that break leading machine translation models and a new evaluation approach: each example comes with handcrafted verification rules describing concrete failure cases on that example, therefore allowing reliable and a...

Vilém Zouhar, Niyati Bafna, Mukund Choudhary et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.