BenGER: Benchmarking LLM Systems on Subsumption-Based Legal Reasoning in German Law
BenGER (Benchmark for German Law), a benchmark and dataset for evaluating LLM systems on subsumption-based legal reasoning in German law, is introduced and 12 contemporary LLM systems are evaluated with a rubric-aligned LLM-as-a-Judge cross-validated against a multi-rater human-grading layer.
Sebastian Nagl, A. Mayrhofer, Martin Heidebach et al.
· arXiv.org · 0 citations