Papers by Bin Lin

43 papers
MERaLiON-AudioLLM: Advancing Speech and Language Understanding for Singapore (2025.acl-demo)

Copied to clipboard

Challenge: MERaLiON-AudioLLM is the first general-purpose audio-based large language model for multitask learning.
Approach: They introduce MERaLiON-AudioLLM, a general-purpose audio-based large language model for multitask learning with a focus on Singlish understanding.
Outcome: The proposed model exhibits strong generalization across a diverse set of tasks . it is a leading solution for region-specific AI applications.
JointCL: A Joint Contrastive Learning Framework for Zero-Shot Stance Detection (2022.acl-long)

Copied to clipboard

Challenge: Existing methods achieve promising performance in in-target stance detection when trained and tested on the same datasets.
Approach: They propose a joint contrastive learning framework to generalize stance features for unseen targets.
Outcome: The proposed framework achieves state-of-the-art on three benchmark datasets.
Multi-modal Stance Detection: New Datasets and Model (2024.findings-acl)

Copied to clipboard

Challenge: Existing methods for stance detection for pure texts have limited results to multi-modal content.
Approach: They propose a multi-modal stance detection framework that leverages target information to learn multi-modal stance features from textual and visual modalities.
Outcome: The proposed framework achieves state-of-the-art in multi-modal stance detection on five datasets based on Twitter .
Aegis:An Advanced LLM-Based Multi-Agent for Intelligent Functional Safety Engineering (2024.emnlp-industry)

Copied to clipboard

Challenge: Aegis is an advanced LLM-based multi-agent for intelligent functional safety engineering that can perform all phases of a vehicle's lifecycle, including design, development, production, operation, and decommissioning.
Approach: They introduce Aegis: An Advanced LLM-Based Multi-Agent for Intelligent Functional Safety Engineering.
Outcome: The proposed solution can perform Hazard Analysis and Risk Assessment (HARA), document Functional Safety Requirements (FSR), and plan test cases for Automatic Emergency Braking (AEB) systems.
ChartVerse: Scaling Chart Reasoning via Reliable Programmatic Synthesis from Scratch (2026.acl-long)

Copied to clipboard

Challenge: Existing open-source vision language models lack high-quality training data for chart reasoning . current models are simplistic and repetitive, while associated QA pairs are prone to hallucinations .
Approach: They propose a framework to synthesize complex charts and reliable reasoning data from scratch.
Outcome: Experimental results show that ChartVerse-8B surpasses existing models in QA and difficulty . lack of high-quality training data hampers development of open-source models .
AudioBench: A Universal Benchmark for Audio Large Language Models (2025.naacl-long)

Copied to clipboard

Challenge: Existing evaluation regimes for audio large language models do not cover the breadth of their possible use cases.
Approach: They propose to use AudioBench to evaluate audio large language models . they found that no single model excels consistently across all tasks .
Outcome: The proposed evaluation targets speech understanding, audio scene understanding, and voice understanding (paralinguistic) . no single model excels consistently across all tasks, the paper found .
Beta Distribution Guided Aspect-aware Graph for Aspect Category Sentiment Analysis with Affective Knowledge (2021.emnlp-main)

Copied to clipboard

Challenge: Existing methods for aspect category sentiment analysis do not necessarily occur in a sentence.
Approach: They propose a Beta Distribution-guided aspect-aware graph construction based on external knowledge . they use aspect-related words as the pivots to derive aspect-relevant weights .
Outcome: The proposed approach outperforms the state-of-the-art methods on 6 benchmark datasets.
Few-shot Named Entity Recognition via Superposition Concept Discrimination (2024.lrec-main)

Copied to clipboard

Challenge: Few-shot named entity recognition (NER) aims to identify entities of target types with limited number of illustrative instances.
Approach: They propose a superposition concept discriminator which solves the intrinsic generalization problem by an active learning paradigm.
Outcome: The proposed model significantly improves few-shot named entity recognition (FS-NER) with minimal additional efforts.
PaperRegister: Boosting Flexible-grained Paper Search via Hierarchical Register Indexing (2026.acl-long)

Copied to clipboard

Challenge: Existing paper search systems lack detailed information to support finer-grained queries.
Approach: They propose a paper-based index that transforms abstract-based corpus index into hierarchical index tree and offline can support paper search queries.
Outcome: The proposed system achieves the SOTA performance and excels in fine-grained scenarios.
Resilience of Large Language Models for Noisy Instructions (2024.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) are powerful tools for interpreting human commands and generating text.
Approach: They examine the resilience of large language models against five common types of disruptions including ASR, OCR, grammatical errors, typographical errors and distractive content.
Outcome: The models show resistance to noise, but their performance suffers . authors evaluated the models against five common types of disruptions based on their results .
Pruning Large Language Models to Intra-module Low-rank Architecture with Transitional Activations (2024.findings-acl)

Copied to clipboard

Challenge: Structured pruning is a feasible solution for end-side LLM deployment . however, achieving a high compression ratio for scaled-up LLMs remains a challenge .
Approach: They propose a task-agnostic structured pruning approach coupled with a compact Transformer architecture to prune LLMs into an intra-module low-rank architecture.
Outcome: The proposed approach reduces transitional activations inside multi-head attention (MHA) and multi-layer perceptron (MLP) modules while preserving inter-module activations sensitive to perturbations.
Jointly Learning Aspect-Focused and Inter-Aspect Relations with Graph Convolutional Networks for Aspect Sentiment Analysis (2020.coling-main)

Copied to clipboard

Challenge: Existing methods for aspect sentiment analysis do not include explicit sentiment expressions.
Approach: They propose to construct a heterogeneous graph by leveraging aspect-focused and inter-aspect contextual dependencies for the specific aspect.
Outcome: The proposed model outperforms state-of-the-art methods on four benchmark datasets and significantly boosts performance in comparison with BERT.
A Novel Matching Paradigm: Unified Generative and Discriminative LLM with Prompt Compression for Relevance Learning (2026.acl-industry)

Copied to clipboard

Challenge: Existing approaches to matching use Large Language Models as feature extractors, underutilizing their full modeling capabilities.
Approach: They propose a matching paradigm that integrates two-tower, single-towing, and generative tasks within a unified LLM framework via attention-mask partitioning.
Outcome: The proposed model achieves superior performance and strong practical value in an industrial search engine.
ChatGPT Is a Knowledgeable but Inexperienced Solver: An Investigation of Commonsense Problem in Large Language Models (2024.lrec-main)

Copied to clipboard

Challenge: acquiring and representing commonsense in machines has posed a long-standing challenge (Li et al., 2021; Zhang e t al, 2022; Zhou e al. 2023) .
Approach: They use a commonsense-based LLM to evaluate ChatGPT's commonsensing abilities by analyzing 11 datasets and generating knowledge descriptions.
Outcome: The proposed model can achieve good QA accuracies while still struggling with certain domains of datasets.
Video-LLaVA: Learning United Visual Representation by Alignment Before Projection (2024.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to visual-language understanding lack unified tokenization for images and videos . lack of unified visual representations makes it difficult to learn multi-modal interactions from poor projection layers.
Approach: They propose to unify visual representation into the language feature space to advance the foundational LLM towards a unified LVLM.
Outcome: The proposed model outperforms Video-ChatGPT on image benchmarks and on 9 image benchmark benchmarks.
Retentive or Forgetful? Diving into the Knowledge Memorizing Mechanism of Language Models (2024.lrec-main)

Copied to clipboard

Challenge: Pre-trained language models have shown remarkable memory formation, but vanilla networks without pre-training suffer catastrophic forgetting problem.
Approach: They conduct experiments to investigate the retentive-forgetful contradiction between vanilla and pre-trained language models by controlling the target knowledge types, learning strategies and learning schedules.
Outcome: The results show that pre-trained language models are forgetful and pre-training leads to retentive models .
Joint Knowledge Base Completion and Question Answering by Combining Large Language Models and Small Language Models (2026.acl-long)

Copied to clipboard

Challenge: Existing studies rely on the small language model (SLM) to enhance them jointly, and the large language model’s strong reasoning ability is ignored.
Approach: They propose a framework which can make knowledge base completion and knowledge base question answering enhance each other in an iterative manner by combining the strengths of the small language model and the large language model.
Outcome: The proposed framework surpasses baselines for both KBC and KBQA tasks over two public benchmark data sets.
TailorKV: A Hybrid Framework for Long-Context Inference via Tailored KV Cache Optimization (2025.findings-acl)

Copied to clipboard

Challenge: Existing work mitigates memory overhead by offloading or compressing the Key-Value cache.
Approach: They propose a method that integrates quantization and offloading into a generative large language model by using a hybrid compression method.
Outcome: The proposed method outperforms the state-of-the-art in long-context evaluations.
COPR: Continual Human Preference Learning via Optimal Policy Regularization (2025.findings-acl)

Copied to clipboard

Challenge: Reinforcement Learning from Human Feedback (RLHF) is effective for aligning Large Language Models with human preferences, but its complex process limits its ability to continually learn human feedback.
Approach: They propose a non-RL offline method to convert historical optimal policies into optimization constraints when continually learning new preferences.
Outcome: The proposed method outperforms strong CL baselines in terms of reward-based evaluations and human assessment.
ETRQA: A Comprehensive Benchmark for Evaluating Event Temporal Reasoning Abilities of Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Event temporal reasoning (ETR) is a significant indicator that a large language model understands the physical world.
Approach: They propose a unified taxonomy for event temporal questions and construct a benchmark based on this taxonomies.
Outcome: The proposed taxonomy inherits and expands existing datasets and contains multiple categories of compound questions.
The Linguistic Connectivities Within Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Recent studies have discovered notable disparities in their performance across different languages.
Approach: They conduct a systematic investigation into the behaviors of large language models across 27 different languages on 3 different scenarios and reveals a Linguistic Map correlates with the richness of available resources and linguistic family relations.
Outcome: The proposed model demonstrates that there are significant disparities in performance across languages across 27 different languages on 3 different scenarios.
EduBench: A Comprehensive Benchmarking Dataset for Evaluating Large Language Models in Diverse Educational Scenarios (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks that focus on knowledge-intensive tasks do not reflect diverse educational scenarios.
Approach: They propose a benchmark that incorporates 9 major scenarios and 4,000 educational contexts.
Outcome: The proposed model performs comparable to state-of-the-art large models on the test set.
MorphoBench: A Benchmark with Difficulty Adaptive to Model Reasoning (2026.findings-acl)

Copied to clipboard

Challenge: Existing benchmarks designed to evaluate the reasoning capabilities of large models are limited in scope and lack flexibility to adapt difficulty according to evolving reasoning capacities of models.
Approach: They propose a benchmark that incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
Outcome: The proposed benchmark incorporates multidisciplinary questions to evaluate the reasoning capabilities of large models and can adjust and update question difficulty based on the reasoning abilities of advanced models.
READoc: A Unified Benchmark for Realistic Document Structured Extraction (2025.findings-acl)

Copied to clipboard

Challenge: Document Structured Extraction (DSE) is a field of document structure analysis that aims to extract structured content from raw documents.
Approach: They propose a benchmark to evaluate document structured extraction systems by converting unstructured PDFs into semantically rich Markdown.
Outcome: The proposed benchmark is based on 3,576 diverse and real-world documents from arXiv, GitHub, and Zenodo.
WordArt Designer: User-Driven Artistic Typography Synthesis using Large Language Models (2023.emnlp-industry)

Copied to clipboard

Challenge: Existing typography solutions lack adaptability, creativity, and computational efficiency.
Approach: They propose a user-driven framework for artistic typography synthesis based on the Large Language Model (LLM) the LLM Engine interprets user inputs and generates actionable prompts for the other modules, transforming abstract concepts into tangible designs.
Outcome: The proposed framework incorporates four key modules: the LLM Engine, SemTypo, StyTyPo, and TexTyPO.
PACE: Predictive Adaptive Context Extraction for Long-Horizon LLM Agents (2026.acl-long)

Copied to clipboard

Challenge: Large Language Model (LLM) agents struggle with ultra-long-horizon tasks requiring hundreds or thousands of interaction steps.
Approach: They propose a framework that reconceptualizes context management as a Next Step Prediction problem.
Outcome: The proposed framework improves task success rates and robust cross-lingual performance.
An Exploratory Study on Model Compression for Text-to-SQL (2023.findings-acl)

Copied to clipboard

Challenge: Text-to-SQL translates user queries into SQL statements that can retrieve relevant answers from relational databases.
Approach: They propose to apply model compression techniques to sketch-based and sequence-to-sequence Text-toSQL models.
Outcome: The proposed models have higher inference efficiency and respond better to model compression than sequence-to-sequence models.
Beyond Code Pairs: Dialogue-Based Data Generation for LLM Code Translation (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have shown remarkable capabilities in code translation, yet their performance deteriorates in low-resource programming domains such as Fortran and emerging frameworks like CUDA .
Approach: They propose a dual-LLM Questioner–Solver pipeline that integrates external knowledge from compilers and runtime feedback to generate verified translations and multi-turn dialogues.
Outcome: The proposed model outperforms proprietary models on key metrics like compilation success and accuracy.
V-VAE: A Variational Auto Encoding Framework Towards Fine-Grained Control over Human-Like Chat (2025.emnlp-main)

Copied to clipboard

Challenge: Existing role-play and persona-based chat approaches rely on static role descriptions, coarse-grained signal space, and low-quality synthetic data.
Approach: They propose a Verbal Variational Auto-Encoding framework which dynamically adapts dialogue behaviour based on latent variables across talking style, interaction patterns, and personal attributes.
Outcome: The proposed framework outperforms baselines on HumanChatBench and DialogBench to address the scarcity of high-quality data in the human-like domain.
CFBench: A Comprehensive Constraints-Following Benchmark for LLMs (2025.acl-long)

Copied to clipboard

Challenge: Existing evaluations of Large Language Models (LLMs) focus on fragmented constraints or narrow scenarios, but they overlook the comprehensiveness and authenticity of constraints from the user’s perspective.
Approach: They propose a Chinese Comprehensive Constraints Following Benchmark for LLMs that compiles constraints from real-world instructions and constructs a systematic framework for constraint types.
Outcome: The proposed framework integrates multi-dimensional assessment criteria with requirement prioritization, covering various perspectives of constraints, instructions, and requirement fulfillment.
SSMLoRA: Enhancing Low-Rank Adaptation with State Space Model (2025.naacl-long)

Copied to clipboard

Challenge: Fine-tuning requires substantial computational resources and is prone to overfitting when applied to small datasets.
Approach: They propose a parameter-efficient fine-tuning method that integrates a State Space Model (SSM) to interconnect low-rank matrices.
Outcome: The proposed method achieves comparable performance to LoRA on the general language understanding evaluation (GLUE) benchmark while using only half the parameters.
Enhanced Visual Instruction Tuning with Synthesized Image-Dialogue Data (2024.findings-acl)

Copied to clipboard

Challenge: OpenAI's GPT-4 has demonstrated remarkable multimodal capabilities, but specific mechanics of GPT4 remain unknown.
Approach: They propose a data collection methodology that synchronously synthesizes images and dialogues for visual instruction tuning.
Outcome: The proposed method improves on ten commonly assessed models and provides greater flexibility compared to existing methods.
Text Editing as Imitation Game (2022.findings-emnlp)

Copied to clipboard

Challenge: Text editing is an important domain of processing tasks to edit the text in a localized fashion, such as text simplification.
Approach: They propose a nonautoregressive decoder for state-to-action demonstrations that parallels the decoding while retaining the dependencies between tokens.
Outcome: The proposed model outperforms the autoregressive baselines on a suite of Arithmetic Equation benchmarks in terms of performance, efficiency, and robustness.
Flexibly Utilize Memory for Long-Term Conversation via a Fragment-then-Compose Framework (2025.emnlp-main)

Copied to clipboard

Challenge: Large language models extract useful information from conversation history to enhance the response in long-term conversations.
Approach: They propose a Fragment-then-Compose framework to optimize memory utilization for long-term open-domain conversation.
Outcome: The proposed framework can be used to extract useful information from conversation history . it can be adapted to different situations and improve response generation .
Modeling Intra- and Inter-Modal Relations: Hierarchical Graph Contrastive Learning for Multimodal Sentiment Analysis (2022.coling-1)

Copied to clipboard

Challenge: Existing studies in Multimodal Sentiment Analysis lack a mechanism to understand complex relations between different modalities.
Approach: They propose a hierarchical graph contrastive learning framework for multimodal sentiment analysis that explores the relationships between modality representations.
Outcome: The proposed framework outperforms the state-of-the-art in multimodal sentiment analysis on two benchmark datasets.
SymbolicThought: Integrating Language Models and Symbolic Reasoning for Consistent and Interpretable Human Relationship Understanding (2026.acl-demo)

Copied to clipboard

Challenge: Existing methods for constructing character relationships from plain text are time-consuming and low in coverage.
Approach: They propose a human-in-the-loop framework that combines LLM-based extraction with symbolic reasoning.
Outcome: The proposed framework improves annotation accuracy and consistency while significantly reducing time cost.
Gazetteer-Enhanced Attentive Neural Networks for Named Entity Recognition (D19-1)

Copied to clipboard

Challenge: Named entity recognition (NER) is a fundamental NLP task.
Approach: They propose a gazetteer-based attentive neural network which can enhance region-based NER . they first model the mention-context association and then an auxiliary gazetteers .
Outcome: The proposed approach can achieve state-of-the-art on ACE2005 named entity recognition benchmark.
Decoding at the Speed of Thought: Harnessing Parallel Decoding of Lexical Units for LLMs (2024.lrec-main)

Copied to clipboard

Challenge: Large language models have demonstrated exceptional capability in natural language understanding and generation, but their generation speed is limited by the inherently sequential nature of their decoding process.
Approach: They propose a method that accelerates decoding process without sacrificing quality . they propose lexical unit decoding, which can be integrated with other methods .
Outcome: The proposed method significantly reduces decoding time while maintaining quality while maintaining output quality.
A.S.E: A Repository-Level Benchmark for Evaluating Security in AI-Generated Code (2026.findings-acl)

Copied to clipboard

Challenge: Existing security evaluation benchmarks lack relevance to real-world AI programming tasks . current LLMs struggle with secure coding, research shows .
Approach: They propose a repository-level evaluation benchmark to assess security of AI-generated code.
Outcome: The proposed framework mirrors real-world AI programming tasks and offers valuable insights into the state of AI code generation.
Multi-Modal Sarcasm Detection via Cross-Modal Graph Convolutional Network (2022.acl-long)

Copied to clipboard

Challenge: Existing studies on multimodal sarcasm detection using textual and visual information have been limited to text-only approaches.
Approach: They propose to construct a cross-modal graph for each multi-modal instance to explicitly draw the ironic relations between textual and visual modalities.
Outcome: The proposed model achieves state-of-the-art in multi-modal sarcasm detection.
ReSURE: Regularizing Supervision Unreliability for Multi-turn Dialogue Fine-tuning (2025.emnlp-main)

Copied to clipboard

Challenge: Existing methods address data quality via static prefiltering, which decouples quality control from training and fails to mitigate turn-level error propagation.
Approach: They propose an adaptive learning method that dynamically down-weights unreliable supervision without explicit filtering.
Outcome: Experiments on single-source and mixed-quality datasets show improved stability and response quality.
Mitigating Biases of Large Language Models in Stance Detection with Counterfactual Augmented Calibration (2025.naacl-long)

Copied to clipboard

Challenge: Large language models generate biased stances due to spurious correlations and preference towards certain individuals and topics.
Approach: They propose a counterfactual Augmented Calibration Network to calibrate potential bias in stance detection of large language models.
Outcome: The proposed calibration network can mitigate biases of large language models, achieving state-of-the-art results.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations