Skip to content

NOWJ@COLIEE 2026: Adaptive Pipelines for Legal Retrieval and Reasoning

Jul 2026 · arXiv.org · Vol abs/2607.16603 · 0 citations · 13 references
Computer Science

TL;DR

This paper presents the methodologies and results of the NOWJ team's participation across all five tasks of the COLIEE 2026 competition and adopts a retrieval-augmented generation framework with dense retrieval, attention-based reranking, and few-shot-prompted LLM reasoning.

Abstract

This paper presents the methodologies and results of the NOWJ team's participation across all five tasks of the COLIEE 2026 competition. For Task 1 (Legal Case Retrieval), we propose a four-stage pipeline comprising candidate filtering, dense retrieval with complementary embedding models, cross-encoder reranking via fine-tuned generative rerankers and MLP-based pairwise classification, and adaptive per-query cutoff prediction. For Task 2 (Legal Case Entailment), we combine BM25 filtering, T5-based reranking, and LLM-based entailment verification with consensus ensemble. For Task 3 (Statute Law Retrieval and Entailment), we adopt a retrieval-augmented generation framework with dense retrieval, attention-based reranking, and few-shot-prompted LLM reasoning. For Task 4 (Legal Textual Entailment), we introduce a dynamic routing pipeline that classifies query difficulty and dispatches cases to either a balanced few-shot solver or a structured zero-shot chain-of-thought solver. For the Pilot Task (Legal Judgment Prediction), we combine hierarchical transformers with CRF layers, argument relation mining, and probabilistic argumentation graph reasoning.

View source

Similar papers

Jul 2026

TabRank: Chain-of-Thought Distillation for Table Re-Rankers

TabRank is presented, a framework for training reasoning rerankers for Tabular Retrieval that generalizes effectively to multi-table reasoning and significantly improves performance across a variety of table retrieval datasets.

Adarsh Singh, K. Bhandari, Jianxi Gao et al. · 0 citations
#artificial intelligence Preprint Aug 2026

pro-team at LLMs4OL 2026 Tasks Flagship and Reuse: Retrieval-Augmented Generation and Vocabulary-Constrained Filtering for Ontology Learning

Ontology learning from text remains challenging despite significant progress in Large Language Models (LLMs), which can hallucinate domain terms, produce inconsistent formats, and favor hierarchical over associative relations. In the LLMs4OL 2026 Challenge, we address both the End-to-End Flagship Task (Task A) and Ontology Extension Reuse Task (Task B) using an offline retrieval-augmented few-shot prompting pipeline. Our system employs Qwen2.5-14B-Instruct with all-MiniLM-L6-v2 for demonstration retrieval, selecting the top-5 examples for Task A and top-2 for Task B. A left-truncated context-windowing strategy preserves task instructions within long prompts. For Task B, generated triples undergo deterministic vocabulary-constrained filtering, retaining triples when at least one endpoint belongs to the sample's closed term/type vocabulary and removing duplicates of the initial ontology. The approach achieves Semantic Graph Similarity of 0.8692, Term-Typing F1 of 0.9200, and Taxonomy Discovery F1 of 0.8540 on Task B, while Task A achieves 0.7416 Semantic Graph Similarity. However, no non-taxonomic relations are extracted, highlighting limitations of closed, taxonomy-oriented relation vocabularies.

Shivam Mishra, Dhannu Ram Meena, M. Ojha et al. · 0 citations
Preprint Aug 2026

CoAL-RAG: A Complexity-Aware Legal Retrieval-Augmented Generation Method

CoAL-RAG is proposed, a complexity-aware legal retrieval-augmented generation method, which constructs a multi-dimensional evaluation mechanism based on ``question essence'' and ``retrieval consistency'' to enable adaptive routing of retrieval strategies.

Jinyue Su, Zhuofeng Zhao, Huanhuan Wang et al. · 0 citations
Book Open access Jul 2026

Effectiveness of Sparse Retrieval for Automated Fact-Checking

These findings establish learned sparse retrieval as a highly impactful design choice in automated fact-checking, with retrieval quality serving as a critical determinant of end-to-end performance in the studied systems.

Ritvik Setty, Vinay Setty · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.