Papers by Jiaqi Zhang

53 papers
Towards Storage-Efficient Visual Document Retrieval: An Empirical Study on Reducing Patch-Level Embeddings (2025.findings-acl)

Copied to clipboard

Challenge: Visualized Document Retrieval (VDR) uses large vision-language models to encode document pages into embeddings.
Approach: They evaluate methods to reduce patch embeddings per page while minimizing performance degradation.
Outcome: The proposed method maintains 98.2% of retrieval performance with only 11.8% of original memory usage and preserves 94.6% effectiveness at 2% memory footprint.
SecFormer: Fast and Accurate Privacy-Preserving Inference for Transformer Models via SMPC (2024.findings-acl)

Copied to clipboard

Challenge: a growing number of cloud-based inference services are relying on SMPC to protect data privacy.
Approach: They propose a framework for Privacy-Preserving Inference for Transformer models that eliminates exponential and maximum operations in PPI without sacrificing model performance.
Outcome: The proposed framework outperforms MPCFormer in terms of performance and efficiency . it is 3.57 and 3.58 times faster than PUMA for BERTBASE and BERTLARGE .
Unity in Diversity: Collaborative Pre-training Across Multimodal Medical Sources (2024.acl-long)

Copied to clipboard

Challenge: Current pre-training techniques rely on a limited scope of medical data, limiting the range of downstream tasks.
Approach: They propose a pre-training strategy that unifies patient data within individual sources and captures explicit and implicit correlations between patients across different sources.
Outcome: The proposed strategy bridges the gap between multimodal medical sources by aggregating patient data within individual sources and capturing explicit and implicit correlations between patients across sources.
AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments (2026.acl-long)

Copied to clipboard

Challenge: Existing benchmarks evaluate agents in simplified, idealized settings, relying on pre-packaged tool interfaces, overlooking critical steps, and assume inputs are clean and fully specified.
Approach: They propose a framework that evaluates language agents in simplified, idealized settings . they show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Outcome: Experiments on 15 proprietary and open-source models show that even SOTA systems like Gemini and GPT-5 struggle on AgentGym2 .
Chain-of-Scrutiny: Detecting Backdoor Attacks for Large Language Models (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated impressive capabilities across various domains, but are vulnerable to backdoor attacks.
Approach: They propose a chain-of-scrutiny approach which leverages LLMs’ unique reasoning abilities to mitigate backdoor attacks.
Outcome: The proposed model is well-suited for the popular API-only LLM deployments, enabling detection at minimal cost and with little data.
CR-UTP: Certified Robustness against Universal Text Perturbations on Large Language Models (2024.findings-acl)

Copied to clipboard

Challenge: Existing certified robustness methods for certifying input-specific text perturbations have shown promise in certifyling UTPs, but masking only adversarial words can eliminate the attack.
Approach: They propose a method to certify a language model’s robustness against UTPs by using random smoothing.
Outcome: The proposed method achieves high certified accuracy under extensive masking and achieves state-of-the-art results in multiple settings.
Data Interpreter: An LLM Agent for Data Science (2025.findings-acl)

Copied to clipboard

Challenge: Large Language Models (LLMs) excel in various domains but face challenges when applied to data science workflows due to their complex, multi-stage nature.
Approach: They propose a hierarchical graph-based agent that represents complexity and a progressive strategy for step-by-step verification, refinement, and consistent context management.
Outcome: The proposed agent surpasses state-of-the-art baselines on the MATH dataset and performs better on InfiAgent-DABench.
MIKE: A New Benchmark for Fine-grained Multimodal Entity Knowledge Editing (2024.findings-acl)

Copied to clipboard

Challenge: Current benchmarks focus on coarse-grained knowledge, leaving the intricacies of fine-grounded knowledge unexplored.
Approach: They propose a benchmark and dataset specifically designed for FG multimodal entity knowledge editing.
Outcome: The proposed benchmark underscoring the complexity of FG knowledge editing in MLLMs.
SGPVT: Self-Generated Proximal Visual Tokens for Mitigating Proximal Collateral Damage in MLLM Unlearning (2026.acl-long)

Copied to clipboard

Challenge: Existing approaches focus on general utility metrics, overlooking the preservation of semantically related concepts.
Approach: They propose a method that introduces self-generated proximal visual tokens to prevent forgetting vulnerability.
Outcome: The proposed framework outperforms existing methods in preserving semantically related concepts while achieving effective target unlearning.
SongComposer: A Large Language Model for Lyric and Melody Generation in Song Composition (2025.acl-long)

Copied to clipboard

Challenge: Creating lyrics and melodies in symbolic format requires expert knowledge of melody and an advanced understanding of lyrics.
Approach: They introduce SongComposer, a music-specialized large language model that can create symbolic lyrics and melodies following instructions.
Outcome: The proposed model outperforms existing models in symbolic song composition tasks.
Towards a Mechanistic Understanding of Large Reasoning Models: A Survey of Training, Inference, and Failures (2026.acl-long)

Copied to clipboard

Challenge: Recent research has shown that reinforcement learning can elicit intriguing emergent reasoning behaviors.
Approach: They propose a comprehensive survey of the mechanistic understanding of large reasoning models . they organize findings into three core dimensions: 1) training dynamics, 2) reasoning mechanisms, and 3) unintended behaviors.
Outcome: This paper synthesizes the mechanistic understanding of large reasoning models into three dimensions . authors outline a roadmap for future studies including improved interpretability and methodologies .
AudioVSR: Enhancing Video Speech Recognition with Audio Data (2024.emnlp-main)

Copied to clipboard

Challenge: Recent work has shown poor performance with non-Indo-European languages . previous work primarily utilizes video information to build VSR models .
Approach: They propose a generative model for data inflation that integrates synthetic data with authentic visual data to enhance the VSR model.
Outcome: The proposed model improves on the audio-visual alignment problem in audio-video tasks.
New Intent Discovery with Attracting and Dispersing Prototype (2024.lrec-main)

Copied to clipboard

Challenge: Existing methods for detecting new intents with labeled data are not cluster-friendly . a robust prototypical attracting learning (RPAL) method is designed to compel instances to gravitate toward their corresponding prototype .
Approach: They propose a robust and adaptive prototypical learning framework for globally distinct decision boundaries for both known and new intent categories.
Outcome: The proposed method improves on CLINC, BANKING, and StackOverflow benchmarks on three challenging benchmarks.
Reframe Your Life Story: Interactive Narrative Therapist and Innovative Moment Assessment with Large Language Models (2025.emnlp-main)

Copied to clipboard

Challenge: Existing approaches to mental health support lack realism and capture therapeutic progression over time.
Approach: They propose a framework that simulates expert narrative therapists by planning therapeutic stages, guiding reflection levels, and generating contextually appropriate responses through retrieval-augmentation.
Outcome: The proposed framework outperforms standard methods in quality and depth on 260 simulated clients and 230 human participants.
Generative Interfaces for Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models are increasingly seen as assistants, copilots, and consultants . however, their linear request-response format often makes interactions inefficient in multi-turn tasks .
Approach: They propose a paradigm in which large language models respond to user queries by generating user interfaces that enable more adaptive and interactive engagement.
Outcome: The proposed paradigm outperforms traditional chat-based interfaces in many tasks and interaction patterns.
LRQuant: Learnable and Robust Post-Training Quantization for Large Language Models (2024.acl-long)

Copied to clipboard

Challenge: Existing methods for post-training quantization (PTQ) are limited by the complexity of the quantization parameter and performance degradations when tested on unseen datasets.
Approach: They propose a learnable smooth-based PTQ framework that allows for rapid adaptation during testing.
Outcome: The proposed framework improves performance on unseen datasets and reduces memory constraints.
LASA: Language-Agnostic Semantic Alignment at the Semantic Bottleneck for LLM Safety (2026.acl-long)

Copied to clipboard

Challenge: Large language models (LLMs) have demonstrated better safety performance in high-resource languages than in low-resourced languages.
Approach: They propose language-agnostic semantic alignment (LASA) which anchors safety alignment directly in semantic bottlenecks.
Outcome: The proposed approach significantly improves safety across all languages: average attack success rate drops from 24.7% to 2.8% on LLaMA-3.1-8B-Instruct and remains within 3–4% across Qwen2.5 and Qwend3 Instruct models (7B–32B).
LongVideoAgent: Multi-Agent Reasoning with Long Videos (2026.acl-long)

Copied to clipboard

Challenge: a key emerging challenge is robust long video understanding, authors say . current methods compress content into lossy summaries or rely on limited toolsets .
Approach: They propose a multi-agent framework where a master LLM coordinates a grounding agent and a vision agent to extract targeted textual observations.
Outcome: The proposed model outperforms strong non-agent baselines on episode-level datasets . the proposed model significantly outperformed existing models on other datasets.
Unveiling the Generalization Power of Fine-Tuned Large Language Models (2024.naacl-long)

Copied to clipboard

Challenge: Large Language Models (LLMs) have demonstrated exceptional multitasking abilities, but the comprehensive effects of fine-tuning on the LLMs’ generalization ability are not fully understood.
Approach: They conduct extensive experiments across five distinct language tasks on different datasets to investigate whether fine-tuning affects the generalization ability intrinsic to LLMs.
Outcome: The proposed model can generalize to different domains and tasks by integrating the in-context learning strategy during fine-tuning on generation tasks.
VideoPro: Adaptive Program Reasoning for Long Video Understanding (2026.acl-long)

Copied to clipboard

Challenge: Existing methods for understanding long videos are limited due to the sparsity of visual evidence relevant to a given query.
Approach: They propose a framework that enables VideoLLMs to reason over long videos and refine their predictions through executable programs.
Outcome: The proposed framework outperforms existing methods across long-video understanding benchmarks.
Learning to Think on Hypergraph: HyperCoT for Structure-Guided N-ary Knowledge Graph Completion (2026.acl-long)

Copied to clipboard

Challenge: Existing methods to solve knowledge hypergraph link prediction problem are limited by their ability to generate chain-of-thought (CoT) representations.
Approach: They propose a structure-aware approach that models multi-hop structural reasoning as a depth-sensitive progressive evidence accumulation process.
Outcome: Experiments on three real-world datasets show that HyperCoT outperforms strong n-ary KGC baselines while yielding interpretable multi-hop reasoning traces.
InternLM-XComposer2.5-Reward: A Simple Yet Effective Multi-Modal Reward Model (2025.findings-acl)

Copied to clipboard

Challenge: Despite the promising performance of Large Vision Language Models, they sometimes generate incorrect outputs.
Approach: They propose a multi-modal reward model that aligns LVLMs with human preferences.
Outcome: The proposed model achieves excellent results on the latest multi-modal reward model benchmark and shows competitive performance on text-only reward model.
Forget the Token and Pixel: Rethinking Gradient Ascent for Concept Unlearning in Multimodal Generative Models (2025.findings-acl)

Copied to clipboard

Challenge: Gradient Ascent (GA) has emerged as a promising approach for concept unlearning in Multimodal Generative Models (MGMs).
Approach: They propose a novel approach that selectively applies GA to targeted Conceptual Knowledge while preserving Natural Knowledge through Gradient Descent (GD).
Outcome: The proposed approach removes Conceptual Knowledge and inadvertently diminishes Natural Knowledge, resulting in utility degradation.
BrainECHO: Semantic Brain Signal Decoding through Vector-Quantized Spectrogram Reconstruction for Whisper-Enhanced Text Generation (2025.findings-acl)

Copied to clipboard

Challenge: Current EEG/MEG-to-text decoding systems rely on teacher-forcing methods . pre-trained large language models are over-dominant in decoding text from brain activity .
Approach: They propose a framework that employs decoupled representation learning to achieve state-of-the-art performance on EEG and MEG datasets.
Outcome: The proposed framework achieves state-of-the-art performance on EEG and MEG datasets.
S2R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning (2025.acl-long)

Copied to clipboard

Challenge: Existing approaches to incentivize LLMs’ deep thinking abilities require large-scale data or significant training efforts.
Approach: They introduce an efficient framework that enhances LLM reasoning by teaching models to self-verify and self-correct during inference.
Outcome: The proposed framework outperforms models trained on long-CoT distilled data with 3.1k initialization samples and achieves an accuracy improvement of 51.0% to 81.6%.
SimpleOCR: Rendering Visual Questions to Teach MLLMs to Read (2026.findings-acl)

Copied to clipboard

Challenge: MLLMs lack visual grounding mechanism to read text embedded in images, or rely on parametric shortcuts . despite strong OCR capabilities, models suffer performance degradation of 12.7% in the VQ setting .
Approach: They propose a plug-and-play training strategy that invalidates shortcuts in text prompts . they propose 'vq' setting where text queries are rendered directly onto images .
Outcome: The proposed training strategy surpasses the base model by 5.4% and GRPO based on original images by 2.7% on four representative OOD benchmarks.
Open-World Attribute Mining for E-Commerce Products with Multimodal Self-Correction Instruction Tuning (2025.acl-long)

Copied to clipboard

Challenge: Current AM methods focus on extracting attributes from unimodal text, underutilizing multimodal data.
Approach: They propose a framework for multimodal self-correction instruction tuning to extract new attributes from images and text with Multimodal Large Language Models.
Outcome: The proposed framework outperforms state-of-the-art methods on two datasets.
Sentient Agent as a Judge: Evaluating Higher-Order Social Cognition in Large Language Models (2026.findings-acl)

Copied to clipboard

Challenge: Large language models (LLMs) have evolved from statistical sequence predictors to sophisticated autonomous agents capable of reasoning, planning, and sustaining multi-turn conversa-tions.
Approach: They propose a system that instantiates a "Sentient Agent" that simulates human-like emotional changes and inner thoughts to provide a more realistic evaluation of the model in multi-turn conversations.
Outcome: The proposed framework measures the agent's higher-order social cognition in multi-turn conversations.
PTQ1.61: Push the Real Limit of Extremely Low-Bit Post-Training Quantization Methods for Large Language Models (2025.acl-long)

Copied to clipboard

Challenge: Existing methods for sub 2-bit quantization introduce an extra 1-bit or more per weight.
Approach: They propose a sub 2-bit post-training quantization method that enables weight quantization to 1.61-bit for the first time.
Outcome: The proposed method reduces the upper bound of quantization error to 1.61-bit for the first time.
SparkRA: A Retrieval-Augmented Knowledge Service System Based on Spark Large Language Model (2024.emnlp-demo)

Copied to clipboard

Challenge: Large language models (LLMs) have shown remarkable achievements across various language tasks.
Approach: They propose a scientific literature LLM and a knowledge service system based on it . they collect scientific literature and then pre-train it using autoregressive training .
Outcome: The proposed system provides literature investigation, paper reading, and academic writing functions.
MedDialog: Large-scale Medical Dialogue Datasets (2020.emnlp-main)

Copied to clipboard

Challenge: telemedicine is a medical practice that provides patient care remotely using video conferencing tools.
Approach: They build large-scale medical dialogue datasets to facilitate research . they pretrain several models on the Chinese MedDialog dataset and compare their performance .
Outcome: The proposed datasets show that models trained on MedDialog can generate doctor-like medical dialogues.
Safe-SAIL: Towards a Fine-grained Safety Landscape of Large Language Models via Sparse Autoencoder Interpretation Framework (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies on how SAEs derive most fine-grained latent features for safety remain unexplored.
Approach: They propose a framework for interpreting SAE features in safety-critical domains . they train a suite of SAEs with human-readable explanations and systematic evaluations based on pornography, politics, violence, and terror .
Outcome: The proposed framework reduces interpretation cost by 55% and improves safety-critical features.
HiTab: A Hierarchical Table Dataset for Question Answering and Natural Language Generation (2022.acl-long)

Copied to clipboard

Challenge: Existing studies on table reasoning focus on flat tables and hierarchical tables . a new dataset, HiTab, aims to examine numerical reasoning over hierarchic tables based on hierarchically structured tables - a strong challenge for existing baselines and a valuable benchmark for future research.
Approach: They propose a hierarchical question answering and natural language generation dataset to study hierarchic tables.
Outcome: The proposed model shows that it is effective in QA and natural language generation over hierarchical tables.
BrainLoc: Brain Signal-Based Object Detection with Multi-modal Alignment (2025.findings-emnlp)

Copied to clipboard

Challenge: BrainLoc is a lightweight object detection model guided by fMRI signals.
Approach: They propose a brain-based object detection model guided by fMRI signals . they employ a multi-modal alignment strategy that enhances fmr feature extraction .
Outcome: The proposed model improves fMRI-based object detection accuracy and convenience.
Weakly Supervised Semantic Parsing by Learning from Mistakes (2021.findings-emnlp)

Copied to clipboard

Challenge: Weakly supervised semantic parsing requires searching consistent logical forms in a huge space and dealing with spurious logical form.
Approach: They propose a learning framework that trains parsers via utterance-denotation pairs . they use utterrance-logical form pairs created from mistakes to bootstrap parser .
Outcome: The proposed framework outperforms state-of-the-art methods on WikiSQL, TabFact and other datasets.
JurisBench: A Deep Benchmark for Assessing Large Language Models in Professional Legal Practice (2026.acl-long)

Copied to clipboard

Challenge: Existing legal benchmarks evaluate isolated tasks or exam-style questions, failing to capture the procedural interdependencies and adjudicative rigor inherent in professional practice.
Approach: They propose a vertical, depth-oriented, domain-specific benchmark to evaluate Large Language Models (LLMs) in Chinese civil litigation.
Outcome: The proposed benchmarks show that large language models exhibit an "illusion of competence" the results highlight a critical gap between fluent linguistic output and judicial reliability .
BitDistiller: Unleashing the Potential of Sub-4-Bit LLMs via Self-Distillation (2024.acl-long)

Copied to clipboard

Challenge: Weight quantization has emerged as a popular solution to reduce memory and computational demands.
Approach: They propose a framework that synergizes Quantization-Aware Training (QAT) with Knowledge Distillation (KD) to boost the performance of LLMs at sub-4-bit.
Outcome: The proposed framework outperforms existing QAT methods on language understanding and complex reasoning benchmarks on sub-4-bit models.
Optimizing Native Sparse Attention with Latent Attention and Local Global Alternating Strategies (2026.findings-acl)

Copied to clipboard

Challenge: Existing research has proposed a variety of training-free and post-training methods for selecting critical key-value pairs at each generation step.
Approach: They propose to use local (sliding-window) and global (compression/selective) attention across layers to enlarge long-context modeling.
Outcome: Experiments on models from 340M to 1.3B parameters show that the proposed method matches or exceeds full attention and native sparse attention in both common-sense reasoning and long-context understanding tasks.
Three Stream Based Multi-level Event Contrastive Learning for Text-Video Event Extraction (2023.emnlp-main)

Copied to clipboard

Challenge: Existing methods for event extraction ignore motion representations in videos and are misguided by background noise.
Approach: They propose a text-video based multimodal event extraction framework that integrates video appearance features and motion representations with video appearance.
Outcome: The proposed framework outperforms the state-of-the-art methods in the event extraction field.
WebSynthesis: World Model-Guided Monte Carlo Tree Search for Efficient WebAgent Trajectory Synthesis (2026.acl-long)

Copied to clipboard

Challenge: Recent advances in large language models have enabled increasingly capable web agents . however, training such agents at scale still relies on high-quality interaction trajectories that are difficult to obtain at scale.
Approach: They propose a framework for scalable trajectory synthesis that simulates state transitions without network dependencies and integrates Monte Carlo Tree Search to enable reversible exploration over the simulated state space.
Outcome: Experiments on WebArena, WebVoyager, and Mind2Web-Online show that agents trained exclusively on synthesized trajectories outperform those trained on real-world data.
SLiNT: Structure-aware Language Model with Injection and Contrastive Training for Knowledge Graph Completion (2025.findings-emnlp)

Copied to clipboard

Challenge: Large language models (LLMs) lack structural information and semantic context to infer missing entities . large language models often lack structural signals to infuse missing entities into knowledge graphs .
Approach: a modular framework integrates structural information and semantic context into a frozen LLM backbone for link prediction.
Outcome: a new framework integrates KG-derived structural information and semantic context to infer missing entities.
Towards Real-world Scenario: Imbalanced New Intent Discovery (2024.acl-long)

Copied to clipboard

Challenge: Existing studies focus on detecting known and previously undefined categories of user intent . skewed and long-tailed distributions often encountered in open-world scenarios .
Approach: They propose to use imbalanced new intent discovery task to identify familiar and novel intent categories within long-tailed distributions.
Outcome: The proposed model outperforms the existing benchmark on three datasets to simulate the real-world long-tail distributions.
From Inheritance to Saturation: Disentangling the Evolution of Visual Redundancy for Architecture-Aware MLLM Inference Acceleration (2026.acl-long)

Copied to clipboard

Challenge: Existing acceleration strategies suffer from severe "backbone dependency" Existing strategies such as token pruning or layer sparsity suffer from this .
Approach: They propose a framework that decouples visual redundancy into IVR and architecture-dependent secondary saturation redundancies.
Outcome: The proposed framework outperforms existing frameworks on Qwen25-VL and Qwa25-LL.
SemRegex: A Semantics-Based Approach for Generating Regular Expressions from Natural Language Specifications (D18-1)

Copied to clipboard

Challenge: Existing approaches to generate programs from natural language do not address program aliasing . semantically equivalent programs may have many syntactically different forms .
Approach: They propose a semantics-based approach to generate regular expressions from natural language.
Outcome: The proposed approach improves on three public datasets.
Chinese Court Simulation with LLM-Based Agents System (2026.findings-acl)

Copied to clipboard

Challenge: Existing studies have neglected the systematic design and procedure evaluation of court simulations, which are critical to the credibility and usage of court simulators in practice.
Approach: They propose a court simulation paradigm based on the real-world procedure structure of Chinese courts and a framework that focuses on both legal judgment prediction and court procedure analysis.
Outcome: The proposed model outperforms judges and lawyers from the real trials in many aspects.
Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing (2021.findings-acl)

Copied to clipboard

Challenge: Recent years pretrained language models (PLMs) have shown their power on modeling language . however, few efforts have been made to explore grounding capabilities of PLMs .
Approach: They propose to use pretrained language models to explore syntactic structures . they propose to combine their approach with an erasingthen-awakening approach . their results show that the approach can awaken latent grounding, which is understandable to humans .
Outcome: Empirical studies show that the proposed approach can awaken latent grounding . it shows great potential to benefit downstream semantic parsing models, it says .
LMDX: Language Model-based Document Information Extraction and Localization (2024.findings-acl)

Copied to clipboard

Challenge: Large Language Models have revolutionized Natural Language Processing but their application in extracting information from visually rich documents has not been successful.
Approach: They propose a language model-based document information extraction and localization methodology to reframe the document information extract task for a LLM.
Outcome: The proposed method enables extraction of singular, repeated, and hierarchical entities with and without training data.
ToolDNA: Autonomous Evolution of Tool Metadata for Robust Dialogue Agents (2026.findings-acl)

Copied to clipboard

Challenge: Task-oriented dialogue systems face labor-intensive manual metadata tuning and sparse reinforcement learning (RL) rewards that fail to diagnose invocation errors.
Approach: They propose a framework that enables auto-evolution of policy networks and tool metadata via RL . a tool metadata loop coordinates metadata through policy-generated candidates during rollouts .
Outcome: The proposed framework achieves +11% problem resolution and +54% accuracy over commercial LLMs with prompt engineering and +25%/+35% over supervised fine-tuning.
MAC-SQL: A Multi-Agent Collaborative Framework for Text-to-SQL (2025.coling-main)

Copied to clipboard

Challenge: Recent LLM-based Text-to-SQL methods suffer from performance degradation on “huge” databases and complex user questions that require multi-step reasoning.
Approach: They propose a framework that integrates a decomposer agent and auxiliary agents to generate SQL queries from natural language text.
Outcome: The proposed framework achieves comparable execution accuracy on SQL-Llama tasks compared to the baseline model.
OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preference (2025.acl-long)

Copied to clipboard

Challenge: Existing open-source multi-modal large language models (MLLMs) focus on enhancing foundational capabilities, leaving a significant gap in human preference alignment.
Approach: They propose a dataset of 200K high-quality training samples featuring diverse images, complex questions, and varied response formats to improve MLLMs’ alignment with human preferences.
Outcome: The proposed dataset of 200K high-quality training samples improves human preference alignment while maintaining or enhancing performance on standard VQA benchmarks.
Enhancing EEG-to-Text Decoding through Transferable Representations from Pre-trained Contrastive EEG-Text Masked Autoencoder (2024.acl-long)

Copied to clipboard

Challenge: EEG-based language decoding is still in its nascent stages, despite promising applications in brain-computer interfaces.
Approach: They propose a novel EEG-text Masked Autoencoder that orchestrates compound self-supervised learning across and within EEG and text through a dedicated multi-stream encoder.
Outcome: The proposed model outperforms baseline framework in ROUGE-1 F1 and BLEU-4 scores and an LLM (specifically BART) to improve downstream tasks involving EEG and text.
Towards Complex Text-to-SQL in Cross-Domain Database with Intermediate Representation (P19-1)

Copied to clipboard

Challenge: IRNet synthesizes SQL queries in an end-to-end manner, but it yields unsatisfactory performance on public benchmarks.
Approach: They propose a neural approach called IRNet for complex and cross-domain Text-to-SQL.
Outcome: IRNet achieves 46.7% accuracy on the Spider benchmark, a 19.5% improvement over state-of-the-art approaches.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations