Skip to content
Review

Overview of CCL25-Eval Task 7: Chinese Literary Language Understanding Evaluation (ZhengMing)

· 0 citations · 24 references

TL;DR

The ZhengMing framework aims to evaluate the performance of large language models (LLMs) in the literary field at a fine-grained level and the dataset, task descriptions, competition results, and other relevant information for this evaluation task are presented.

View source

Similar papers

Open access Sep 2026

Implementation of Natural Language Processing for Text Summarization in a Thesis Using The Textrank and Lexrank Algorithms

Mercu Buana University is one of the higher education institutions in Indonesia, where, during their studies, students will face the final phase of their education, which is the thesis defense. In preparing their thesis, students require references from online repositories and university libraries, so the implementatio...

Christiadi Marcelino Mararu, Eka Agustina, Gandung Triyono · 0 citations
Aug 2026

STAR: instruction tuning for Arabic across tasks, datasets, and models

An in-depth evaluation of instruction tuning for Arabic NLP tasks using three prominent LLMs: LLaMA 3.1-8B, AceGPT-v2-8B, and Qwen3-8B shows that instruction tuning consistently improves performance across most tasks, with notable variations in effectiveness across different tasks and prompts.

Maged Saeed Al-shaibani, Zaid Alyafeai, Irfan Ahmad · 0 citations
Open access 2026

Challenging the Abilities of Large Language Models in Italian: a Community Initiative

CALAMITA is conceived as a rolling benchmark, enabling continuous integration of new tasks and models, and argues that this combination offers a blueprint for other languages and communities seeking inclusive and rigorous LLM evaluation practices.

Malvina Nissim, Danilo Croce, V. Patti et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.