Papers by Fei Jia

9 papers
DevEval: A Manually-Annotated Code Generation Benchmark Aligned with Real-World Code Repositories (2024.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks are poorly aligned with real-world code repositories and are insufficient to evaluate the coding abilities of Large Language Models (LLMs).
Approach: They propose a repository-level benchmark named DevEval to evaluate LLMs' coding abilities in real-world code repositories.
Outcome: The proposed benchmarks show that the LLMs perform better in real-world code repositories than existing benchmarks.
SWAN: An Efficient and Scalable Approach for Long-Context Language Modeling (2025.emnlp-main)

Copied to clipboard

Challenge: Existing decoder-only models struggle with context lengths beyond their training distribution.
Approach: They propose a causal Transformer architecture that generalizes robustly to sequence lengths longer than seen during training.
Outcome: The proposed decoder-only architecture can generalize robustly to longer contexts . it is more computationally efficient than the standard Transformer architecture, the authors say .
Rethinking Depression Prediction from a Fine-Grained Subscore Modeling Perspective via Multi-Task Learning (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for depression assessment rely on standardized ratings, but they are time-consuming and subject to inter-rater variability.
Approach: They propose a fine-grained model for subscore prediction via multi-task learning that can be used to predict depression severity using multiple tasks.
Outcome: The proposed model outperforms baselines and Qwen3-14B direct scoring on the public E-DAIC dataset and to a large-scale private clinical dataset.
Modularized Interaction Network for Named Entity Recognition (2021.acl-long)

Copied to clipboard

Challenge: Named Entity Recognition (NER) models focus on word-level information, while segment-based models focus only on word level information.
Approach: They propose a Modularized Interaction Network (MIN) model which utilizes both word-level information and segment-level dependencies.
Outcome: The proposed model outperforms the current state-of-the-art models on three NER benchmark datasets.
HierGR: Hierarchical Semantic Representation Enhancement for Generative Retrieval in Food Delivery Search (2025.acl-industry)

Copied to clipboard

Challenge: Generative retrieval (GR) is an emerging search paradigm for food delivery search.
Approach: They propose a method that harnesses the advanced query understanding capabilities of large language models to enhance the retrieval of results for complex and long-tail queries in food delivery search scenarios.
Outcome: The proposed method increases the number of online orders by 0.68% for complex search intents.
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor (2021.acl-long)

Copied to clipboard

Challenge: Knowledge distillation is a technique to transfer knowledge between models, typically from a large model (the teacher) to a more fine-grained one (the student).
Approach: They propose a factorized form of the knowledge distillation objective for structured prediction which is tractable for many typical choices of the teacher and student models.
Outcome: The proposed model is able to transfer knowledge between teacher and student models without loss of accuracy under four different scenarios.
Task-aware Contrastive Mixture of Experts for Quadruple Extraction in Conversations with Code-like Replies and Non-opinion Detection (2025.emnlp-main)

Copied to clipboard

Challenge: Applying Large Language Models (LLMs) for this specific task presents two primary challenges: the accurate extraction of multiple elements and the understanding of complex dialogue reply structure.
Approach: They propose a novel LLM-based multi-task approach to extract sentiment quadruples from conversations by integrating expert-level contrastive loss within task-oriented mixture of experts layer.
Outcome: The proposed method outperforms existing fine-tuning techniques in terms of accuracy and computational efficiency.
DialogueMMT: Dialogue Scenes Understanding Enhanced Multi-modal Multi-task Tuning for Emotion Recognition in Conversations (2025.coling-main)

Copied to clipboard

Challenge: Existing ERC methods fail to handle emotional cues from both visual sources and discourse structures due to the complexity of visual scenes and contextual dependencies in conversations.
Approach: They propose a framework for Emotion Recognition in conversations that utilizes multi-task instruction tuning to enhance the model's understanding of multi-modal dialogue scenes.
Outcome: The proposed framework outperforms existing state-of-the-art models on three benchmark ERC datasets and is based on a video-language connector and a chain-of thought strategy.
SimpleDeepSearcher: Deep Information Seeking via Web-Powered Reasoning Trajectory Synthesis (2025.findings-emnlp)

Copied to clipboard

Challenge: Existing approaches to deep search training lack high-quality training trajectories, prohibitive computational costs and lack of high-fidelity training data.
Approach: They propose a framework that synthesizes high-quality training data by simulating real user interactions in live web search environments.
Outcome: The proposed framework synthesizes high-quality training data by simulating user interactions in live web search environments.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations