Challenge: Existing AI legal assistants lack Bengali-language support and jurisdiction-specific adaptation, limiting their effectiveness.
Approach: They developed a multilingual LLM-based legal assistant tailored for the Bangladeshi context that employs multilingual embeddings and a RAG-based chain-of-tools framework for retrieval, reasoning, translation, and document generation.
Outcome: Evaluated by law faculty from leading Bangladeshi universities across all stages of the 2022 and 2023 Bangladesh Bar Council examinations, Mina achieved scores of 75–80% in preliminary MCQs, written, and simulated viva voce components.

Similar Papers

Courtroom-LLM: A Legal-Inspired Multi-LLM Framework for Resolving Ambiguous Text Classifications (2025.coling-main)

Copied to clipboard

Challenge: Using a multi-LLM structure inspired by legal courtroom processes, we demonstrate that it can improve decision-making accuracy in ambiguous text classification scenarios.
Approach: They propose a legal-inspired multi-LLM structure that simulates a courtroom setting within LLMs and assigns roles similar to those of prosecutors, defense attorneys, and judges.
Outcome: The proposed model outperforms both single-LLM classifiers and simpler multi-LLMS setups in ambiguous text classification tasks.
Too Late to Train, Too Early To Use? A Study on Necessity and Viability of Low-Resource Bengali LLMs (2025.coling-main)

Copied to clipboard

Challenge: a new generation of English-oriented Large Language Models significantly outperforms older LLMs on low-resource languages.
Approach: They compare Bengali-oriented LLMs with open-weight and closed-source LLM models . they conclude that there is a need for a Bengali model, but lacks high-quality pretraining data .
Outcome: The proposed model outperforms existing models on Bengali on low-resource languages . the results highlight biases in machine-translated datasets used for Bengali NLP tasks .
NYAYAANUMANA and INLEGALLLAMA: The Largest Indian Legal Judgment Prediction Dataset and Specialized Language Model for Enhanced Decision Analysis (2025.coling-main)

Copied to clipboard

Challenge: In India, a significant backlog of cases burdens the legal system.
Approach: They present a corpus of 7,02,945 preprocessed Indian legal cases compiled for LJP . they use a domain-specific generative large language model tailored to the intricacies of the legal system .
Outcome: The proposed dataset surpasses existing datasets like PredEx and ILDC, and improves prediction accuracy and comprehensible explanations.
Ready Jurist One: Benchmarking Language Agents for Legal Intelligence in Dynamic Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks for legal intelligence are limited to static evaluation paradigms or simplified scenarios.
Approach: They introduce J1-ENVS, the first interactive and dynamic legal environment tailored for LLM-based agents.
Outcome: The proposed framework assesses task performance and procedural compliance across legal proficiency levels.
AgentsCourt: Building Judicial Decision-Making Agents with Court Debate Simulation and Legal Knowledge Augmentation (2024.findings-emnlp)

Copied to clipboard

Challenge: Recent advances in deep learning have significantly impacted the legal domain.
Approach: They propose a multi-agent framework for judicial decision-making that simulates the court trial process . they propose 420 Chinese judgment documents to support their framework and build a large-scale legal knowledge base .
Outcome: The proposed framework outperforms existing methods in various aspects, especially in generating legal articles.
Enabling Discriminative Reasoning in LLMs for Legal Judgment Prediction (2024.findings-emnlp)

Copied to clipboard

Challenge: Existing large language models (LLMs) underperform in legal judgment prediction due to challenges in understanding case facts and distinguishing between similar charges.
Approach: They propose a framework that allows LLMs to discriminate among charges and a judicial reasoning framework to improve their models for effective legal judgment prediction.
Outcome: The proposed framework improves accuracy and efficiency when dealing with complex and confusing charges.
LLM Agents in Law: Taxonomy, Applications, and Challenges (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have improved the legal domain, but deployment of standalone models faces significant limitations regarding hallucination, outdated information, and verifiability.
Approach: They present a survey of LLM agents for legal tasks and analyze their architectures . they analyze the transition from standard legal LLMs to legal agents .
Outcome: The proposed architectures bridge the gap between technical capabilities and domain-specific needs.
Law in Silico: Simulating Legal Society with LLM-Based Agents (2026.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) are powerful tools for legal simulation, but their application remains underexplored.
Approach: They propose a unified LLM-based agent framework for simulating legal scenarios . they calibrate agent behaviors against real-world crime data .
Outcome: The proposed framework calibrates agent behaviors against real-world crime data.
Elevating Legal LLM Responses: Harnessing Trainable Logical Structures and Semantic Knowledge with Legal Reasoning (2025.naacl-long)

Copied to clipboard

Challenge: Existing approaches to large language models focus on semantic similarity, neglecting the intricate logical structures and reasoning essential for addressing complex legal issues.
Approach: They propose a Logical-Semantic Integration Model (LSIM) that bridges semantic and logical coherence and a supervised framework that integrates semantic features with in-context learning.
Outcome: The proposed framework significantly improves accuracy and reliability on a real-world legal QA dataset.
BenNumEval: A Benchmark to Assess LLMs’ Numerical Reasoning Capabilities in Bengali (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel in general-purpose tasks but struggle with numerical reasoning, especially in low-resource languages like Bengali.
Approach: They propose a benchmark to assess LLMs on numerical reasoning tasks in Bengali.
Outcome: The proposed benchmark assesses LLMs on numerical reasoning tasks in Bengali.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations