Challenge: Recent studies have shown that Large Language Models’ performance as correctors on Chinese Grammatical Error Correction (CGEC) remains unsatisfactory due to the challenging nature of the task.
Approach: They propose a training framework EXAM that uses LLMs as explainers to enhance CGEC small models and a novel evaluation method SEE that utilizes LLM as evaluators to bring more reasonable evaluations.
Outcome: The proposed methods improve the performance of LLMs on Chinese Grammatical Error Correction (CGEC) task.

Similar Papers

GEE! Grammar Error Explanation with Large Language Models (2024.findings-naacl)

Copied to clipboard

Challenge: Existing grammatical error correction tools do not provide natural language explanations of errors . a system needs to provide one-sentence explanations for each grammamatical errors in a pair of erroneous and corrected sentences.
Approach: They propose a grammar error explanation task that uses one-sentence explanations for each grammatical error in a pair of erroneous and corrected sentences.
Outcome: The proposed pipeline identifies grammar errors in German, Chinese, and English . human evaluation reveals that 93.9% of German errors, 96.4% of Chinese errors, and 92.20% of English errors are correctly detected and explained.
How Do Large Language Models Capture the Ever-changing World Knowledge? A Review of Recent Advances (2023.emnlp-main)

Copied to clipboard

Challenge: Large language models (LLMs) are impressive in solving tasks, but they can quickly be outdated after deployment.
Approach: They provide a review of recent advances in aligning deployed large language models with the ever-changing world knowledge.
Outcome: The proposed models can be used to perform various tasks directly through in-context learning or for further fine-tuning for domain-specific uses.
Large Language Models are Good Annotators for Type-aware Data Augmentation in Grammatical Error Correction (2025.coling-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated outstanding performance in many downstream tasks due to their emergent and in-context learning abilities.
Approach: They propose a method that considers LLMs as annotators for type-aware data augmentation in GEC tasks.
Outcome: The proposed method can generate consistent and typeaware data, which could improve the performance of large language models.
Evaluating Mathematical Reasoning of Large Language Models: A Focus on Error Identification and Correction (2024.findings-acl)

Copied to clipboard

Challenge: Existing evaluations focus on problem-solving from examiner perspective, overlooking a dual perspective of examiner regarding error identification and correction.
Approach: They propose to use an annotated dataset to evaluate large language models from the examiner perspective and to use diverse prompts to evaluate eleven representative LLMs.
Outcome: The proposed model outperforms all models while LLaMA-2-7B has comparable abilities to closed-source models GPT-3.5 and Gemini Pro.
A Systematic Survey and Critical Review on Evaluating Large Language Models: Challenges, Limitations, and Recommendations (2024.emnlp-main)

Copied to clipboard

Challenge: Large Language Models (LLMs) have gained significant attention due to their capabilities in performing diverse tasks across domains.
Approach: They review the primary challenges and limitations causing inconsistencies in evaluations . early models could generate coherent text but limited to simple tasks .
Outcome: The proposed evaluations are reproducible, reliable, and robust.
Harnessing Large Language Models as Post-hoc Correctors (2024.findings-acl)

Copied to clipboard

Challenge: Recent advances in Large Language Models (LLMs) have demonstrated their effectiveness in a wide range of tasks, including machine translation and commonsense reasoning.
Approach: They propose a training-free framework that can work as a post-hoc corrector to propose corrections for ML models.
Outcome: The proposed framework improves the performance of a number of models by up to 39% on text analysis and the challenging molecular predictions.
Challenging Large Language Models with New Tasks: A Study on their Adaptability and Robustness (2024.findings-acl)

Copied to clipboard

Challenge: Existing evaluation approaches for large language models (LLMs) rely on existing tasks and benchmarks, raising concerns about test set contamination and the genuine comprehension abilities of LLMs.
Approach: They propose to evaluate LLMs by designing new tasks, automatically generating evaluation datasets for the tasks, and conducting detailed error analyses to scrutinize LLM's adaptability to new tasks.
Outcome: The proposed method examines LLMs’ adaptability to new tasks, their sensitivity to prompt variations, and their error tendencies.
Self-Correction Makes LLMs Better Parsers (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) have achieved remarkable success across various natural language processing tasks, but they still face challenges in performing fundamental NLP tasks, such as syntactic parsing.
Approach: They propose a method that leverages grammar rules from existing treebanks to guide LLMs in correcting previous errors.
Outcome: The proposed method significantly improves performance on in-domain and cross-domain datasets.
Adaptation of Large Language Models (2025.naacl-tutorial)

Copied to clipboard

Challenge: a tutorial on adaptation of large language models addresses the growing demand for models that go beyond static capabilities.
Approach: This tutorial will provide an overview of dynamic, domain-specific, and task-adaptive LLM adaptation techniques.
Outcome: This tutorial will outline dynamic, domain-specific, and task-adaptive LLM adaptation techniques.
Editing Large Language Models: Problems, Methods, and Opportunities (2023.emnlp-main)

Copied to clipboard

Challenge: Recent advances in model editing for LLMs have created challenges and opportunities for the community.
Approach: They propose to alter the behavior of LLMs efficiently within a specific domain without negatively impacting performance across other inputs.
Outcome: The proposed method alters behavior of LLMs efficiently within a specific domain without negatively impacting performance across other inputs.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations