Papers by Wenhu Chen
HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Data (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Existing question answering datasets focus on dealing with homogeneous information, but using homogenous information alone might lead to coverage problems. |
| Approach: | They propose a large-scale question-answering dataset that requires reasoning on heterogeneous information. |
| Outcome: | The proposed model can achieve an EM score of 40% while the existing model is far behind human performance. |
E2-LLM: Efficient and Extreme Length Extension of Large Language Models (2024.findings-acl)
Copied to clipboard
Jiaheng Liu, ZhiqiBai ZhiqiBai, Yuanxing Zhang, Chenchen Zhang, YuangZh YuangZh, Ge Zhang, JiakaiWang JiakaiWang, Haoran Que, Yukang Chen, Wenbo Su, Tiezheng Ge, Jie Fu, Wenhu Chen, Bo Zheng
| Challenge: | Existing techniques for extending context capabilities in LLMs require additional training procedures and access to datasets with long context (e.g., sequences of 32K tokens). |
| Approach: | They propose a solution to extend context capabilities in Large Language Models by training a single process over a sequence of 4K tokens. |
| Outcome: | The proposed solution significantly reduces the cost of continual-pretraining or fine-tuning over short sequences and improves robustness to diverse relative positions. |
EDIS: Entity-Driven Image Search over Multimodal Web Content (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing image retrieval methods require large datasets and a large candidate set. |
| Approach: | They propose a news-domain dataset for cross-modal image search with 1 million web images . they propose combining multimodal image-text pairs with a million candidates . |
| Outcome: | The proposed dataset challenges state-of-the-art methods with dense entities and the large-scale candidate set. |
UniRAG: Universal Retrieval Augmentation for Large Vision Language Models (2025.findings-naacl)
Copied to clipboard
| Challenge: | Large Vision Language Models (LVLMs) have unlocked many complex use cases that require Multi-Modal (MM) understanding and MM generation. |
| Approach: | They propose a plug-and-play technique that adds relevant retrieved information to prompts as few-shot examples during inference. |
| Outcome: | The proposed method significantly improves the output quality of large vision language models when input prompts are augmented with relevant information retrieved by Vision-Language retrievers like UniRAG. |
MuRAG: Multimodal Retrieval-Augmented Generator for Open Question Answering over Images and Text (2022.emnlp-main)
Copied to clipboard
| Challenge: | Pre-trained language models store a massive amount of world knowledge implicitly in their parameters, but large models often fail to encode information about rare entities and events. |
| Approach: | They propose a retrieval-augmented model which accesses an external non-parametric memory to augment language generation. |
| Outcome: | The proposed model outperforms existing models by 10-20% absolute on two datasets and under distractor and full-wiki settings. |
Augmenting Pre-trained Language Models with QA-Memory for Open-Domain Question Answering (2023.eacl-main)
Copied to clipboard
| Challenge: | Existing methods for open-domain question-answering use an open book approach . a recent alternative is to retrieve from a collection of previously-generated question-annwer pairs . |
| Approach: | They propose a new QA system that augments a text-to-text model with a large memory of question-answer pairs and a task for the latent step of question retrieval. |
| Outcome: | The proposed system outperforms closed-book QA and can answer multi-hop questions. |
TheoremQA: A Theorem-driven Question Answering Dataset (2023.emnlp-main)
Copied to clipboard
| Challenge: | Recent LLMs like GPT-4 and PaLM-2 have made tremendous progress in solving fundamental math problems like GSM8K by achieving over 90% accuracy. |
| Approach: | They propose to use theorem-driven question-answering dataset to evaluate AI models' ability to apply theoretic concepts to solving challenging science problems. |
| Outcome: | TheoremQA is curated by domain experts and contains 800 high-quality questions covering 350 theoremics from Math, Physics, EE&CS, and Finance. |
VISA: Retrieval Augmented Generation with Visual Source Attribution (2025.acl-long)
Copied to clipboard
| Challenge: | Existing approaches to retrieval-augmented generation primarily link generated content to document-level references, making it difficult for users to locate evidence among multiple content-rich retrieved documents. |
| Approach: | They propose a novel approach that combines answer generation with visual source attribution by leveraging large vision-language models to identify evidence and highlight exact regions that support the generated answers with bounding boxes in the retrieved document screenshots. |
| Outcome: | The proposed approach identifies evidence and highlights exact regions that support the generated answers with bounding boxes in the retrieved document screenshots. |
Unleashing the Reasoning Potential of LLMs by Critique Fine-Tuning on One Problem (2025.emnlp-main)
Copied to clipboard
| Challenge: | Critique Fine-Tuning (CFT) is a promising paradigm for unlocking the reasoning capabilities of large language models. |
| Approach: | They propose a method that leverages critique data generated from a single math problem to improve reasoning accuracy. |
| Outcome: | The proposed method surpasses one-shot RLVR while requiring 15 to 20 times less compute. |
Generative Bridging Network for Neural Sequence Prediction (N18-1)
Copied to clipboard
| Challenge: | Existing approaches to improve the likelihood of sequence prediction models are based on MLE and teacher forcing. |
| Approach: | They propose a Generative Bridging Network (GBN) that extends the point-wise ground truth to a bridge distribution conditioned on it and optimizes their KL-divergence. |
| Outcome: | The proposed bridge module can improve on two recognized sequence prediction tasks and minimize learning burden. |
KGPT: Knowledge-Grounded Pre-Training for Data-to-Text Generation (2020.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for data-to-text generation rely on labeled data, which is costly to acquire and limits their application to new tasks and domains. |
| Approach: | They propose to leverage pre-training and transfer learning to address this problem by leveraging a general knowledge-grounded generation model and a knowledge-based model. |
| Outcome: | The proposed model can generate knowledge-enriched text on a knowledge-grounded text corpus crawled from the web in three settings. |
Semantically Conditioned Dialog Response Generation via Hierarchical Disentangled Self-Attention (P19-1)
Copied to clipboard
| Challenge: | Existing models for limited-domain RNNs are difficult to scale due to the complexity of the inputs. |
| Approach: | They propose to use dialog acts to build a multi-layer hierarchical graph with a disentangled self-attention network. |
| Outcome: | The proposed model improves on the baselines on automatic and human evaluation metrics. |
Task-adaptive Pre-training and Self-training are Complementary for Natural Language Understanding (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Task-adaptive pre-training (TAPT) and Self-training can be complementary with simple TFS protocol. |
| Approach: | They propose to use task-adaptive pre-training and self-training to combine TAPT and ST with a simple TFS protocol to achieve strong combined gains across six datasets. |
| Outcome: | The proposed method can achieve strong combined gains across six datasets covering sentiment classification, paraphrase identification, natural language inference, named entity recognition and dialogue slot classification. |
DePlot: One-shot visual language reasoning by plot-to-table translation (2023.findings-acl)
Copied to clipboard
Fangyu Liu, Julian Eisenschlos, Francesco Piccinno, Syrine Krichene, Chenxi Pang, Kenton Lee, Mandar Joshi, Wenhu Chen, Nigel Collier, Yasemin Altun
| Challenge: | Existing models for visual language reasoning require tens of thousands of training examples and their reasoning capabilities are limited. |
| Approach: | They propose a one-shot solution to visual language reasoning by combining plot-to-text translation and reasoning over the translated text into a modality conversion module. |
| Outcome: | The proposed method improves on human-written queries on plots and charts compared with a fine-tuned SOTA model on human queries. |
Knowledge of Knowledge: Exploring Known-Unknowns Uncertainty with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Known-unknown questions are characterized by high uncertainty due to the absence of definitive answers. |
| Approach: | They introduce a dataset with known-unknown questions and establish a categorization framework to clarify the origins of uncertainty in such queries. |
| Outcome: | The proposed model improved in distinguishing between known and unknown queries within open-ended question-answering scenarios. |
MusiLingo: Bridging Music and Text with Pre-trained Language Models for Music Captioning and Query Response (2024.findings-naacl)
Copied to clipboard
Zihao Deng, Yinghao Ma, Yudong Liu, Rongchen Guo, Ge Zhang, Wenhu Chen, Wenhao Huang, Emmanouil Benetos
| Challenge: | Large Language Models have shown immense potential in multimodal applications, but convergence between textual and musical domains remains unexplored. |
| Approach: | They propose a system that aligns music representations with a frozen LLM . they train the system on an extensive music caption dataset and fine-tune it with instructional data . |
| Outcome: | The proposed system bridges the gap between music audio and textual contexts by combining music captions with a frozen model . it performs well in generating music caption and composing music-related Q&A pairs . the proposed system is available for free download at http://www.musilingo.com/ . |
Zero-shot Fact Verification by Claim Generation (2021.acl-short)
Copied to clipboard
| Challenge: | Existing methods for fact verification require large datasets, which can be expensive. |
| Approach: | They propose a framework for training a robust fact verification model by using automatically generated claims that can be supported, refuted, or unverifiable from evidence from Wikipedia. |
| Outcome: | The proposed framework reduces the demand for human-annotated training data and improves a model's F1 from 50% to 77%, equivalent in performance to 2K+ manually-curated examples. |
MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scale (2025.acl-long)
Copied to clipboard
Jiawei Guo, Tianyu Zheng, Yizhi Li, Yuelin Bai, Bo Li, Yubo Wang, King Zhu, Graham Neubig, Wenhu Chen, Xiang Yue
| Challenge: | Current instruction-tuning datasets focus on simplistic visual question answering tasks, and provide phrase-level answers without any intermediate rationales. |
| Approach: | They propose to use open-source multimodal large language models to train MLLMs on a dataset with 12M instruction-response pairs to elicit CoT reasoning. |
| Outcome: | The proposed model achieves state-of-the-art performance on benchmarks such as MathVerse, MMMU-Pro, and MuirBench, and gains improvements of up to 4% on non-reasoning-based benchmarks. |
On the Risk of Misinformation Pollution with Large Language Models (2023.findings-emnlp)
Copied to clipboard
| Challenge: | a recent study demonstrates that large language models can be misused for generating credible-sounding misinformation . however, the ability to produce credible text raises concerns regarding their potential misuse . |
| Approach: | They propose three defense strategies to mitigate misinformation generated by Large Language Models . they propose a threat model and simulate potential misuse scenarios . |
| Outcome: | The proposed defense strategies have shown promising results, albeit with costs. |
TheoremExplainAgent: Towards Video-based Multimodal Explanations for LLM Theorem Understanding (2025.acl-long)
Copied to clipboard
| Challenge: | Understanding domain-specific theorems requires more than text-based reasoning . current evaluations of theoretical models are based on textual cues . |
| Approach: | They propose an agentic approach for generating long-form theorem explanation videos using Manim animations. |
| Outcome: | The proposed agent generates long-form theorem explanation videos using Manim animations . the agent achieves a success rate of 93.8% and an overall score of 0.77 . |
ACECODER: Acing Coder RL via Automated Test-Case Synthesis (2025.acl-long)
Copied to clipboard
| Challenge: | Recent coder models have been driven by supervised fine-tuning, but the potential of reinforcement learning remains unexplored due to the lack of reliable reward data/model in the code domain. |
| Approach: | They propose a pipeline that generates extensive test-case pairs from existing code data and constructs preference pairs based on pass rates over sampled programs. |
| Outcome: | The proposed pipeline generates extensive (question, test-cases) pairs from existing code data and trains them with Bradley-Terry loss. |
VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation (2024.emnlp-main)
Copied to clipboard
Xuan He, Dongfu Jiang, Ge Zhang, Max Ku, Achint Soni, Sherman Siu, Haonan Chen, Abhranil Chandra, Ziyan Jiang, Aaran Arulraj, Kai Wang, Quy Do, Yuansheng Ni, Bohan Lyu, Yaswanth Narsupalli, Rongqi Fan, Zhiheng Lyu, Bill Yuchen Lin, Wenhu Chen
| Challenge: | Existing video metrics are lagging behind in providing reliable scores over generated videos due to lack of large-scale human-annotated dataset. |
| Approach: | They propose to use VideoFeedback to train a human-annotated multi-aspect score over 37.6K synthesized videos from 11 existing video generative models. |
| Outcome: | The proposed model outperforms the prior best metrics by 50 points in the test. |
Unsupervised Multi-hop Question Answering by Question Generation (2021.naacl-main)
Copied to clipboard
| Challenge: | Existing training data for multi-hop question answering (QA) is time-consuming and resource-intensive. |
| Approach: | They propose an unsupervised framework that generates human-like multi-hop training data from homogeneous and heterogeneously data sources. |
| Outcome: | The proposed framework achieves 61% and 83% of the supervised learning performance for the HybridQA and HotpotQA datasets. |
SWE-QA-Pro: A Representative Benchmark and Scalable Training Recipe for Repository-Level Code Understanding (2026.findings-acl)
Copied to clipboard
Songcheng Cai, Zhiheng Lyu, Yuansheng Ni, Xiangchao Chen, Baichuan Zhou, Shenzhe Zhu, Yi Lu, Haozhe Wang, Chi Ruan, Benjamin Schneider, Weixu Zhang, Xiang Li, Andy Zheng, Yuyu Zhang, Ping Nie, Wenhu Chen
| Challenge: | Existing benchmarks for agentic repository-level code understanding overlook long tail topics and rely on memorized knowledge. |
| Approach: | They propose a repository-level agentic code understanding benchmark that uses long-tail repositories with executable environments to enforce topical balance. |
| Outcome: | Empirically, a Qwen3-8B model trained with the proposed benchmark outperforms GPT-4o by 2.3 points. |
How Large a Vocabulary Does Text Classification Need? A Variational Approach to Vocabulary Selection (N19-1)
Copied to clipboard
| Challenge: | Using a pre-defined vocabulary is a common approach to selecting text inputs . however, using a large vocabulary is not economical, as it limits the model's applicability on computation-or memoryconstrained scenarios. |
| Approach: | They propose a more sophisticated variational vocabulary dropout to perform vocabulary selection . they propose two new metrics to measure area under accuracy-vocab curve and Vocab Size under X% accuracy drop . |
| Outcome: | The proposed framework outperforms the baselines on the vocabulary selection problem on multiple NLP classification tasks. |
ChatMusician: Understanding and Generating Music Intrinsically with LLM (2024.findings-acl)
Copied to clipboard
Ruibin Yuan, Hanfeng Lin, Yi Wang, Zeyue Tian, Shangda Wu, Tianhao Shen, Ge Zhang, Yuhang Wu, Cong Liu, Ziya Zhou, Liumeng Xue, Ziyang Ma, Qin Liu, Tianyu Zheng, Yizhi Li, Yinghao Ma, Yiming Liang, Xiaowei Chi, Ruibo Liu, Zili Wang, Chenghua Lin, Qifeng Liu, Tao Jiang, Wenhao Huang, Wenhu Chen, Jie Fu, Emmanouil Benetos, Gus Xia, Roger Dannenberg, Wei Xue, Shiyin Kang, Yike Guo
| Challenge: | Despite LLMs' impressive capabilities in musical knowledge, music reasoning remains an unsolved task. |
| Approach: | They propose an open-source large language model (LLM) that integrates intrinsic musical abilities into LLaMA2 and GPT-3.5. |
| Outcome: | The proposed model can understand and generate music with a pure text tokenizer without external multi-modal neural structures or tokenizers. |
MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark (2025.acl-long)
Copied to clipboard
Xiang Yue, Tianyu Zheng, Yuansheng Ni, Yubo Wang, Kai Zhang, Shengbang Tong, Yuxuan Sun, Botao Yu, Ge Zhang, Huan Sun, Yu Su, Wenhu Chen, Graham Neubig
| Challenge: | Recent advances in multimodal large language models have led to progress in tackling complex reasoning tasks that combine textual and visual information. |
| Approach: | They introduce a robust version of the Massive Multi-discipline Multimodal Understanding and Reasoning (MMMU) benchmark. |
| Outcome: | The proposed model performs lower on MMMU-Pro than on the previous benchmark, ranging from 16.8% to 26.9%. |
Global Textual Relation Embedding for Relational Understanding (P19-1)
Copied to clipboard
| Challenge: | Existing methods to learn textual relation embeddings are lacking in large open-domain corpora. |
| Approach: | They propose to learn a general-purpose embedding of textual relations using a large dataset from Freebase. |
| Outcome: | The proposed embedding can facilitate downstream tasks requiring relational understanding of the text. |
Unifying Multimodal Retrieval via Document Screenshot Embedding (2024.emnlp-main)
Copied to clipboard
| Challenge: | Existing document retrieval pipelines require document parsing and content extraction to prepare input for indexing. |
| Approach: | They propose a retrieval paradigm that regards document screenshots as a unified input format . they leverage a large vision-language model to directly encode document screenshot into dense representations . |
| Outcome: | The proposed method outperforms existing retrieval pipelines in a text-intensive context. |
HybriDialogue: An Information-Seeking Dialogue Dataset Grounded on Tabular and Textual Data (2022.findings-acl)
Copied to clipboard
| Challenge: | Existing datasets focused on multiturn dialogue systems focus on text or table information. |
| Approach: | They propose a dataset that consists of crowdsourced conversations grounded on Wikipedia text and tables. |
| Outcome: | The proposed dataset shows that there is still ample opportunity for improvement in the current state of dialogue systems. |
Controllable Dialogue Simulation with In-context Learning (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to generate annotated dialogues require crowdsourcing, which is expensive and time-consuming. |
| Approach: | They propose a dialogue simulation method based on large language model in-context learning that generates new dialogues and annotations in a controllable way. |
| Outcome: | The proposed method can expand a small set of dialogue data with minimum or zero human involvement and parameter update. |
Large Language Models are few(1)-shot Table Reasoners (2023.findings-eacl)
Copied to clipboard
| Challenge: | Recent literature has shown that large language models are excellent few-shot reasoners to solve text reasoning tasks. |
| Approach: | They evaluated LLMs on popular table QA and fact verification datasets like WikiTableQuestion, FetaQA, TabFact, and FEVEROUS and found they are competent at complex reasoning over table structures. |
| Outcome: | The proposed models are more competent at complex reasoning over table structures than tuned T5-large models. |
VisualWebInstruct: Scaling up Multimodal Instruction Data through Web Search (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing vision-language models struggle with reasoning-focused tasks due to the lack of high-quality training data. |
| Approach: | They propose a new approach that leverages search engines to create a multimodal multimodal dataset . they use a set of 30,000 seed images to extract HTML data from 700K unique URLs . |
| Outcome: | The proposed model achieves the best known performance on MMMU-Pro (40.7), MathVerse (42.6), and DynaMath (55.7). |
XL-NBT: A Cross-lingual Neural Belief Tracking Framework (D18-1)
Copied to clipboard
| Challenge: | a multi-lingual approach to training dialog systems is expensive and tedious, but it can be useful for cross-lingual support. |
| Approach: | They propose to annotate data for multiple languages and train a multi-lingual dialog system for each language. |
| Outcome: | The proposed framework bypasses the expensive human annotation and achieves promising results. |
VisCoder: Fine-Tuning LLMs for Executable Python Visualization Code Generation (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing instruction-tuning datasets lack execution-grounded supervision and offer limited support for iterative code correction. |
| Approach: | They propose a large-scale instruction tuning dataset for Python-based visualization and self-correction. |
| Outcome: | The proposed dataset outperforms strong open-source baselines and proprietary models like GPT-4o-mini. |
Augmenting Black-box LLMs with Medical Textbooks for Biomedical Question Answering (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large-scale language models (LLMs) like ChatGPT have demonstrated impressive abilities in generating responses based on human instructions. however, their use in the medical domain can be challenging due to their lack of specific, in-depth knowledge. |
| Approach: | They propose a system that integrates authoritative medical textbooks into LLMs’ framework using plug-and-play modules. |
| Outcome: | The proposed system outperforms the specialized Med-PaLM 2 model on three medical QA tasks by 11.6% to 16.6%. |
VIEScore: Towards Explainable Metrics for Conditional Image Synthesis Evaluation (2024.acl-long)
Copied to clipboard
| Challenge: | Existing metrics for conditional image generation are opaque and lack explainability . evaluators of these metrics have limited ability to evaluate image synthesis tasks . |
| Approach: | They propose a Visual Instruction-guided Explainable metric for evaluating conditional image models. |
| Outcome: | The proposed model achieves a high Spearman correlation with human evaluations, but is weaker than GPT-4o and GPT-v in evaluating synthetic images. |
Triangular Architecture for Rare Language Translation (P18-1)
Copied to clipboard
| Challenge: | Empirical results show that Neural Machine Translation (NMT) performs poor on low-resource pairs especially when Z is a rare language. |
| Approach: | They propose a triangular triangulation technique to leverage bilingual data to optimize the translation performance of low-resource pairs. |
| Outcome: | Empirical results show that the proposed architecture significantly improves translation quality of rare languages on MultiUN and IWSLT2012 datasets and even better when combining back-translation methods. |
A Systematic Investigation of KB-Text Embedding Alignment at Scale (2021.acl-long)
Copied to clipboard
| Challenge: | Knowledge bases (KBs) and text often contain complementary knowledge. |
| Approach: | They propose a framework for aligning KB and text embeddings for joint reasoning . they also evaluate alignment methods to infuse textual information into KB embeddables . |
| Outcome: | The proposed framework can be used to predict link prediction on emerging entities and events using textual information. |
BrowseComp-Plus: A Fair and Disentangled Evaluation Benchmark for Deep Search Agents (2026.acl-long)
Copied to clipboard
Zijian Chen, Xueguang Ma, Shengyao Zhuang, Ping Nie, Kai Zou, Sahel Sharifymoghaddam, Andrew Liu, Joshua Green, Kshama Patel, Ruoxi Meng, Mingyi Su, Yanxi Li, Haoran Hong, Xinyu Shi, Xuye Liu, Hosna Oyarhoseini, Nandan Thakur, Crystina Zhang, Luyu Gao, Wenhu Chen, Jimmy Lin
| Challenge: | Existing benchmarks for deep search agents rely on blackbox web search APIs . dynamic and opaque web APIs hinder reproducibility and fair comparisons - authors . |
| Approach: | They propose a benchmark that employs a fixed corpus for controlled retrieval for deep search agents. |
| Outcome: | The new benchmark shows that agents that combine large language models with retrieval tools excel at complex, reasoning-intensive queries. |
SciMMIR: Benchmarking Scientific Multi-modal Information Retrieval (2024.findings-acl)
Copied to clipboard
Siwei Wu, Yizhi Li, Kang Zhu, Ge Zhang, Yiming Liang, Kaijing Ma, Chenghao Xiao, Haoran Zhang, Bohao Yang, Wenhu Chen, Wenhao Huang, Noura Al Moubayed, Jie Fu, Chenghua Lin
| Challenge: | Multi-modal information retrieval (MMIR) is a rapidly evolving field . current benchmarks for image-text pairings overlook the scientific domain . |
| Approach: | They develop a scientific domain-specific MMIR benchmark to evaluate image-text pairings using open-access research paper corpora. |
| Outcome: | The proposed benchmarks are based on 530K image-text pairs extracted from scientific documents with detailed captions. |
Few-shot In-context Learning on Knowledge Base Question Answering (2023.acl-long)
Copied to clipboard
| Challenge: | KB-BINDER enables few-shot in-context learning over knowledge base questions . KBQA is a difficult problem due to the heterogeneity of knowledge bases . |
| Approach: | They propose a framework that enables few-shot in-context learning over KBQA tasks. |
| Outcome: | The proposed framework can outperform state-of-the-art models on GraphQA and MetaQA datasets. |
FinQA: A Dataset of Numerical Reasoning over Financial Data (2021.emnlp-main)
Copied to clipboard
Zhiyu Chen, Wenhu Chen, Charese Smiley, Sameena Shah, Iana Borova, Dylan Langdon, Reema Moussa, Matt Beane, Ting-Hao Huang, Bryan Routledge, William Yang Wang
| Challenge: | Popular, large, pre-trained models fall far short of expert humans in acquiring finance knowledge and in complex multi-step numerical reasoning on that knowledge. |
| Approach: | They propose a large-scale dataset with Question-Answering pairs over financial reports written by financial experts to facilitate analytical progress. |
| Outcome: | The proposed dataset is the first of its kind and is available on github. |
Logic2Text: High-Fidelity Natural Language Generation from Logical Forms (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent studies on Natural Language Generation (NLG) from structured data focus on surface descriptions of simple record sequences, for example, attribute-value pairs of fixed or very limited schema. |
| Approach: | They propose to use a large-scale dataset to generate NLG from logical forms to obtain controllable and faithful generations from structured data. |
| Outcome: | The proposed model can describe interesting facts from logical inferences across records, but it is difficult to produce such fidelity. |
No Metrics Are Perfect: Adversarial Reward Learning for Visual Storytelling (P18-1)
Copied to clipboard
| Challenge: | Visual captioning is aimed at depicting the concrete content of images, but its capability of performing human-like understanding is still restrictive. |
| Approach: | They propose an Adversarial REward Learning framework to learn an implicit reward function from human demonstrations and optimize policy search with the learned reward function. |
| Outcome: | The proposed framework improves performance over state-of-the-art (SOTA) methods in cloning expert behaviors, but human evaluation shows that it achieves significant improvement in generating more human-like stories than SOTA systems. |
Logical Natural Language Generation from Open-Domain Tables (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies on neural natural language generation focus on surface-level realizations with limited emphasis on logical inference. |
| Approach: | They propose a task where a model is tasked with generating natural language statements that can be logically entailed by facts in an open-domain semi-structured table. |
| Outcome: | The proposed task is based on the existing TabFact dataset with a wide range of logical/symbolic inferences. |
Variational Knowledge Graph Reasoning (N18-1)
Copied to clipboard
| Challenge: | Existing knowledge graphs have large amount of missing links, which limits their application . a recent study has proposed to design an automated inference model to complete the missing links in large knowledge graph. |
| Approach: | They propose to use variation inference to solve missing links in knowledge graphs . they use a posterior approximator, prior (path finder) and likelihood (path reasoner) |
| Outcome: | The proposed model achieves state-of-the-art on multiple datasets and is highly accurate. |
Few-Shot NLG with Pre-Trained Language Model (2020.acl-main)
Copied to clipboard
| Challenge: | Neural-based approaches to natural language generation are data-hungry and difficult to adopt in real-world applications. |
| Approach: | They propose a task of few-shot natural language generation from structured data or knowledge to generate coherent sentences from input data and language modeling to compose coherent sentences. |
| Outcome: | The proposed approach outperforms the strongest baseline approach by over 8.0 BLEU points improvement. |
OpenCodeInterpreter: Integrating Code Generation with Execution and Refinement (2024.findings-acl)
Copied to clipboard
| Challenge: | OpenCodeInterpreter-33B provides a high level of performance for code generation, executing, and iterative refinement. |
| Approach: | They propose a family of open-source code systems for generating, executing, and iteratively refining code. |
| Outcome: | The OpenCodeInterpreter-33B performs well on humanEval, MBPP, and EvalPlus benchmarks. |
TC-Bench: Benchmarking Temporal Compositionality in Conditional Video Generation (2025.findings-acl)
Copied to clipboard
| Challenge: | Existing video generation models struggle to interpret compositional changes and synthesize components across different time steps. |
| Approach: | They propose a temporal compositionality benchmark that uses text prompts and ground truth videos to evaluate compositional changes in video. |
| Outcome: | The proposed benchmark can be used for text-to-video and image-to video generation. |