KoLEG: On-the-Fly Korean Legal Knowledge Editing with Continuous Retrieval (2025.findings-emnlp)
Copied to clipboard
Jaehyung Seo, Dahyun Jung, Jaewook Lee, Yongchan Chun, Dongjun Kim, Hwijung Ryu, Donghoon Shin, Heuiseok Lim
| Challenge: | a recent study shows that Korean legal knowledge is subject to frequent temporal updates driven by societal needs and government policies. |
| Approach: | They propose a Korean Legal knowledge editing framework enhanced with continuous retrieval . they employ an Editing-Aware Learning Strategy and a LawEdit Retriever . |
| Outcome: | a new framework outperforms existing methods for updating legal knowledge in Korean . it maintains robust performance in sequential editing and is qualitatively validated by legal experts. |
Similar Papers
Edit Once, Update Everywhere: A Simple Framework for Cross-Lingual Knowledge Synchronization in LLMs (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to update large language models focus on single-language editing or basic multilingual editing, failing to achieve true cross-linguistic knowledge synchronization. |
| Approach: | They propose a cross-linguistic knowledge democracy edit technique to improve cross-lingual performance. |
| Outcome: | The proposed method improves cross-lingual performance while maintaining high accuracy in monolingual settings. |
UniLR: Unleashing the Power of LLMs on Multiple Legal Tasks with a Unified Legal Retriever (2025.acl-long)
Copied to clipboard
Ang Li, Yiquan Wu, Yifei Liu, Ming Cai, Lizhi Qing, Shihang Wang, Yangyang Kang, Chengyuan Liu, Fei Wu, Kun Kuang
| Challenge: | Existing retrieval methods are designed for general domains, struggling with legal knowledge, or tailored for specific legal tasks, unable to handle diverse legal knowledge types. |
| Approach: | They propose a novel retrieval method that integrates specialized knowledge into LLMs. |
| Outcome: | The proposed method can perform multiple legal retrieval tasks for LLMs. |
LexTempus: Enhancing Temporal Generalizability of Legal Language Models Through Dynamic Mixture of Experts (2025.acl-long)
Copied to clipboard
| Challenge: | a rapid evolution of legal concepts requires that legal language models adapt swiftly accounting for the temporal dynamics. |
| Approach: | They propose a dynamic mixture of experts model that explicitly models the temporal evolution of legal language in an online learning framework. |
| Outcome: | The proposed model can model the temporal evolution of legal language without forgetting past knowledge. |
Automating Legal Interpretation with LLMs: Retrieval, Generation, and Evaluation (2025.acl-long)
Copied to clipboard
| Challenge: | a novel framework for automated legal interpretation is proposed to alleviate the burden on legal experts. |
| Approach: | They propose a framework for automated legal interpretation that uses large language models to extract concept-related information and interpret legal concepts. |
| Outcome: | The proposed framework eliminates the need for legal experts to interpret legal concepts . it uses large language models to extract concept-related information and interpret legal concept interpretations . |
KoBLEX: Open Legal Question Answering with Multi-hop Reasoning (2025.emnlp-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have demonstrated remarkable performances in general domains and are now extending into the expert domain of law. |
| Approach: | They propose a Korean Benchmark for Legal EXplainable QA (KoBLEX) that evaluates provision-grounded, multi-hop legal reasoning. |
| Outcome: | The proposed method outperforms baselines and shows a high correlation with human judgments. |
Knowledge Decoupling via Orthogonal Projection for Lifelong Editing of Large Language Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods for enhancing large language models (LLMs) have achieved some success, but their knowledge understanding and memory capacity significantly degrades after extensive editing. |
| Approach: | They propose a method that stores the basis vectors of the representation space of past edits in a knowledge cache and projects the gradient of the current edit onto a space orthogonal to previous knowledge for updating. |
| Outcome: | The proposed method improves question-answering ability and hallucination mitigation by 14% and 61% for large language models after 3,000 edits. |
Korean Canonical Legal Benchmark: Toward Knowledge-Independent Evaluation of LLMs’ Legal Reasoning Capabilities (2026.eacl-short)
Copied to clipboard
| Challenge: | Large reasoning models trained to reason explicitly in the verbal space have shown superior performance over general large language models (Guo et al., 2025). |
| Approach: | They propose to use Korean Canonical Legal Benchmark to assess language models' legal reasoning capabilities independently of domain-specific knowledge. |
| Outcome: | The proposed benchmark outperforms general-purpose models in a systematic evaluation of 30+ models. |
Developing a Pragmatic Benchmark for Assessing Korean Legal Language Understanding in Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated remarkable performance in the legal domain, with GPT-4 even passing the Uniform Bar Exam in the U.S. However their efficacy remains limited for non-standardized tasks and tasks in languages other than English. |
| Approach: | They propose a benchmark for assessing the Korean legal language understanding of LLMs consisting of 7 legal knowledge tasks and 4 legal reasoning tasks. |
| Outcome: | The proposed model passes the Uniform Bar Exam in the U.S. but its performance is limited for non-standardized tasks and tasks in languages other than English. |
CLaw: Benchmarking Chinese Legal Knowledge in Large Language Models - A Fine-grained Corpus and Reasoning Analysis (2025.findings-emnlp)
Copied to clipboard
| Challenge: | a new benchmark is designed to evaluate LLMs on Chinese legal knowledge and its application in reasoning . general pre-training that ingests legal texts without specialized focus compromises reliability of LLM responses . achieving trustworthy legal reasoning in LLM requires a robust synergy of accurate knowledge retrieval and strong general reasoning capabilities. |
| Approach: | They propose a benchmark specifically engineered to evaluate LLMs on Chinese legal knowledge and its application in reasoning. |
| Outcome: | The proposed benchmark evaluates LLMs on Chinese legal knowledge and its application in reasoning. |
LEMUR: A Corpus for Robust Fine-Tuning of Multilingual Law Embedding Models for Retrieval (2026.eacl-srw)
Copied to clipboard
| Challenge: | Existing large language models are not designed for semantic retrieval and PDF-based legislative sources introduce substantial noise due to imperfect text extraction. |
| Approach: | They propose a large-scale multilingual corpus of EU environmental legislation constructed from 24,953 official EUR-Lex PDF documents covering 25 languages. |
| Outcome: | The proposed model improves Top-k retrieval accuracy in monolingual and bilingual settings . it also improves accuracy in low- and high-resource languages . |