This work constructed a dataset for Japanese claim decomposition and designed detailed guidelines for claim decomposition, ensuring that the extracted claims are in a form useful for fact-checking and that the decomposition rules mitigate annotator variability.
Miwa Masano, Ribeka Keyaki, Atsushi Keyaki et al.· International Conference on...· 0 citations
This paper considers multilingual pretraining as a cooperative game in which each language acts as a player that jointly contributes to pretraining, gaining the resulting reduction in test loss as the payoff and proposes a game-theoretic multilingual scaling law called ShapleyLaw.
The neurofeedback paradigm for LLMs is redesigned so that the control target satisfies the privileged access requirement, which is closer to neurofeedback experiments in human cognitive neuroscience and indicates that rigorous assessments of metacognition in LLMs require evaluation methods that demand privileged access...
Koshiro Aoki, Ryota Takatsuki, Gouki Minegishi et al.· 0 citations
Large language models (LLMs) increasingly evaluate human writing in high-stakes domains such as hiring and academic assessment, putting non-native speakers at particular risk. Drawing on the language attitudes framework, we compared human and LLM evaluations of parallel L1- and L2-written Japanese emails on three dimen...
Evaluation results demonstrate that the synthetic dataset constructed is the most effective approach for improving LVLM performance on reading vertically written Japanese text.
This work proposes a measure of training data influence that does not require selecting a downstream task or validation set as the attribution target, and defines an example's influence by how much its gradient update reduces the squared distance to the final parameters of a given pretraining run.
Yuto Nishida, Hirokazu Kiyomaru, Yusuke Oda et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.