Papers by Yang Bao
Copied to clipboard
| Challenge: | Existing benchmarks focus more on end-to-end performance, but neglect the underlying principles of knowledge acquisition and generalization. |
| Approach: | They propose a benchmark specifically designed to explore the problem-solving principles by decomposing 6.5K visual math problems into 10.9K step-level questions for evaluation. |
| Outcome: | The proposed benchmark covers 6.5K visual math problems and 10.9K step-level questions spanning 5 layers of knowledge granularity and 67 hierarchical knowledge concepts. |
Copied to clipboard
| Challenge: | Existing list-wise methods focus on optimizing list ranking consistency for LLMs to improve ranking abilities. |
| Approach: | They propose to extend the Plackett-Luce model to accommodate top-K ranking by extending the DPO’s Plact-Lucer model to dynamically determine appropriate K for different samples. |
| Outcome: | The proposed model can be extended to accommodate top-K ranking and improve training efficiency. |
Copied to clipboard
| Challenge: | Existing approaches to composable text operations often require plug-and-play . a single LM can perform arbitrary text operation composition in the latent space . |
| Approach: | They propose an efficient approach for composable text operations in the latent space of text . they connect pretrained LMs to the laten space and adapt them to the space . |
| Outcome: | The proposed approach improves on existing methods in the latent space of text. |
Copied to clipboard
| Challenge: | Reinforcement learning (RL) is the main dialogue policy learning method in recent years. |
| Approach: | They propose a Gaussian Process based Deep Dyna-Q approach to dialogue policy learning . they propose evaluating the quality of experiences generated by the world model using a discriminator . |
| Outcome: | The proposed approach improves the effectiveness and efficiency of dialogue policy learning by 20% with fewer human-machine interactions. |
Copied to clipboard
| Challenge: | Existing evaluation frameworks focus on isolated question-answering tasks that may not capture the essential aspects of strategic reasoning. |
| Approach: | They evaluate 13 large language models across over 800 games in chess . they use a chessian-based framework to test strategic reasoning and pattern recognition . |
| Outcome: | The proposed framework improves performance and basic understanding of large language models. |
Copied to clipboard
| Challenge: | Recent efforts to develop lightweight and practical sentiment analysis models are limited by manual instruction and large-scale user texts. |
| Approach: | They propose a framework for sentiment analysis that uses attribute-based instruction construction and difficulty-based data filtering to distill knowledge. |
| Outcome: | The proposed framework outperforms baseline methods in data efficiency and performance. |
Copied to clipboard
| Challenge: | RL-friendly models exhibit intra-class compactness and inter-class separation in probability assignments . under identical training, Qwen models achieve substantial gains, while others like Llama yield limited improvements. |
| Approach: | They propose a method to quantify distributional clarity in probability space . they show distributional clearness is a trainable property underlying RL-Friendliness . |
| Outcome: | The proposed model families achieve substantial gains under identical training, while others like Llama yield limited improvements. |
Copied to clipboard
| Challenge: | Large-language-model (LLM) agents are competent at straightforward web tasks, but struggle with complex tasks. |
| Approach: | They propose a general framework that decomposes web tasks into three subtasks . they show that WebDART lifts end-to-end success rates by 13.7 percentage points . |
| Outcome: | Evaluated on WebChoreArena, WebDART lifts success rates by 13.7 percentage points over previous state-of-the-art agents. |
Copied to clipboard
| Challenge: | Recent work on embodied AI agents that can perform tasks by following human language instructions is limited by reactive methods, which are insufficient for long-horizon complex tasks. |
| Approach: | They propose a neuro-symbolic deliberative agent that, while following language instructions, proactively applies reasoning and planning based on its neural and symbolic representations acquired from past experience. |
| Outcome: | The proposed agent achieves greater than 70% improvement over reactive baselines on the challenging TEACh benchmark. |
Copied to clipboard
| Challenge: | Existing approaches to adapt Large Language Models (LLMs) for recommendation encounter significant challenges such as amplification bias and homogeneity. |
| Approach: | They propose a new decoding approach called Debiasing-Diversifying Decoding (D3) that disables length normalization for ghost tokens to alleviate amplification bias and incorporates a text-free assistant model to encourage tokens less frequently generated by LLMs for counteracting recommendation homogeneity. |
| Outcome: | Extensive experiments on real-world datasets demonstrate the proposed approach’s effectiveness in enhancing accuracy and diversity. |
Copied to clipboard
| Challenge: | Despite the growing use of large language models for writing tasks, it remains unclear whether users can effectively reshape LLM-generated text to reflect their personal style. |
| Approach: | They conduct an online study in which participants post-edit LLM-generated drafts for writing tasks where personal style matters to them. |
| Outcome: | The results show that post-editing increases stylistic similarity to unassisted writing and reduces similarity with fully LLM-generated output. |
Copied to clipboard
| Challenge: | Existing offline preference optimization methods rely on preference labels to optimize large language models. |
| Approach: | They propose an offline method for enhancing large language models in reasoning tasks that utilizes value signals at individual reasoning steps. |
| Outcome: | The proposed framework outperforms offline preference optimization techniques by 4% to 6% on math reasoning, commonsense reasoning, and coding tasks. |
Copied to clipboard
| Challenge: | Existing methods for argument quality assessment do not consider multi-perspective evaluation due to subjective nature of arguments. |
| Approach: | They propose a multi-persona framework for argument quality assessment that simulates diverse evaluator perspectives through large language models. |
| Outcome: | The proposed framework outperforms baselines while providing comprehensive multi-perspective rationales on IBM-Rank-30k and IBM-ArgQ-5.3kArgs datasets. |
Copied to clipboard
| Challenge: | Large language models (LLMs) are increasingly applied to complex tasks requiring multi-step reasoning. |
| Approach: | They propose an offline method for enhancing multi-step reasoning by optimizing the soft Bellman Equation by combining a policy model and a value function. |
| Outcome: | The proposed method surpasses existing methods on multi-step reasoning benchmarks and can be extended to multi-iteration frameworks when additional resources are available. |
Copied to clipboard
| Challenge: | Argumentation mining (AM) aims to detect arguments and their inherent relations from textual compositions. |
| Approach: | They propose a method to model the inter-relationships among three subtasks within a generative framework. |
| Outcome: | The proposed method achieves state-of-the-art performance on two AM benchmarks. |
Copied to clipboard
| Challenge: | Argument Mining (AM) is hindered by the scarcity of structure-annotated datasets, which are expensive to create manually. |
| Approach: | They propose to use quality-oriented synthesis and diversity-oriented approach to generate argumentative texts with diverse topics and argument structures. |
| Outcome: | The proposed approach significantly improves existing models in full-data and low-resource settings. |
Copied to clipboard
| Challenge: | Experimental results show that unified model outperforms other models that treat encoding and matching separately. |
| Approach: | They evaluate a unified model with Transformer layers for machine reading comprehension . they find that the model learns different modeling strategies compared with previous models . |
| Outcome: | The unified model outperforms models with Transformer layers on the machine reading comprehension task. |
Copied to clipboard
| Challenge: | Existing 3D benchmarks lack fine-grained numerical reasoning task annotations, limiting MLLMs’ ability to perform precise spatial measurements and complex numerical reasoning. |
| Approach: | They propose a 3D-based benchmark to enhance indoor perceptual understanding by using multi-scale annotations and question-answer pairs. |
| Outcome: | The proposed benchmark improves indoor perceptual understanding by incorporating multi-scale annotations and question-answer pairs. |
Copied to clipboard
| Challenge: | Existing LLM-based agents lack inherent spatial awareness, relying on web search or text matching while hallucinating spatial relationships. |
| Approach: | They propose a spatial-based agent that can perform real-world geospatial computations . they use natural-language questions to parse into executable workflows based on geoFlow Graphs - directed acyclic graphs with nodes corresponding to spatial concepts and edges representing transformations. |
| Outcome: | The proposed agent outperforms existing baselines on MapEval-API and MapQA benchmarks while producing interpretable and executable geospatial workflows. |
Copied to clipboard
| Challenge: | Existing methods for interactive theorem proving in formal logic lack robustness and robustness. |
| Approach: | They propose a backward chaining framework guided by pseudo steps for proofstep generation that prioritizes pseudo steps. |
| Outcome: | The proposed framework improves on the miniF2F benchmark. |
Copied to clipboard
| Challenge: | Argument mining (AM) is a challenging task as it requires recognizing complex argumentation structures involving multiple subtasks. |
| Approach: | They propose a generative framework where expected outputs of AM are framed as a simple target sequence. |
| Outcome: | The proposed framework achieves state-of-the-art on two AM benchmarks. |
Copied to clipboard
| Challenge: | Existing studies on argumentation mining focus on monological argumentation and dialogical argumentation. |
| Approach: | They propose a mutual guidance framework that could guide arguments in one passage . they propose an inter-sentence relation graph to effectively model the inter-relations between two sentences . |
| Outcome: | The proposed method outperforms the current state-of-the-art model. |
Copied to clipboard
| Challenge: | Existing benchmarks for large language models focus on simple, flat table structures. |
| Approach: | They propose a benchmark to evaluate the performance of both Large Language Models and Multimodal LLMs across a variety of input formats for complex tabular data, including LaTeX, HTML, and PNG. |
| Outcome: | The proposed benchmark evaluates the performance of LLMs and Multimodal LLM models across a variety of input formats for complex tabular data, including LaTeX, HTML, and PNG. |
Copied to clipboard
| Challenge: | Empirical evidence shows that our proposed method improves performance across seven downstream tasks. |
| Approach: | They propose a logic-driven data augmentation approach that converts text into AMR graphs and converts them back into text to create augmented data. |
| Outcome: | The proposed method leads on the ReClor leaderboard and improves on seven downstream tasks. |
Copied to clipboard
| Challenge: | Argumentation Mining (AM) aims to extract argumentative structures from texts by identifying argumentation components (ACs) and their argumentative relations (ARs). |
| Approach: | They propose a First- Order Logic reasoning framework for AM to capture logical reasoning paths within argumentative texts. |
| Outcome: | The proposed framework outperforms strong baselines while significantly improving explainability. |
Copied to clipboard
| Challenge: | Existing research has focused on approximating model rankings, but such benchmarks fail to provide users and developers with a comprehensive and fine-grained understanding of a specific model’s capabilities. |
| Approach: | They propose a framework that enables detailed characterization of LLM capabilities through comprehensive and fine-grained evaluation. |
| Outcome: | The proposed framework enables detailed characterization of large language models through comprehensive and fine-grained evaluation. |
Copied to clipboard
| Challenge: | Argumentative Essay Generation (AEG) is a challenging task in computational argumentation, where detailed logical reasoning and effective rhetorical skills are essential. |
| Approach: | They propose an argumentative planning strategy for prompting large language models to generate high-quality essays by sketch planning and dialectical planning. |
| Outcome: | The proposed method generates more dialectical and persuasive essays with higher diversity compared to baselines. |
Copied to clipboard
| Challenge: | Neural text generation models are typically trained by maximizing log-likelihood with the sequence cross entropy (CE) loss. |
| Approach: | They propose an Edit-Invariant Sequence Loss method which computes the matching loss of a target sequence with all n-grams in the generated sequence. |
| Outcome: | The proposed method outperforms the common CE loss and strong baselines on a wide range of tasks. |
Copied to clipboard
| Challenge: | Light Latent-space Decoding (L2D) is an efficient and efficient latent- space decoding method. |
| Approach: | They propose to bypass language-space decoding by matching candidate items with LLM's internal thought representations in the latent space. |
| Outcome: | The proposed method is 10x faster than language-space decoding while maintaining or enhancing performance. |
Copied to clipboard
| Challenge: | Existing models focus on extracting useful semantic information from conference call transcripts but ignore subtle yet important information of dialogue structures. |
| Approach: | They propose a graph attention network called DialogueGAT for financial risk prediction by simultaneously modeling the speakers and their utterances in conference calls. |
| Outcome: | The proposed model outperforms baseline models on a dataset of S&P1500 companies. |
Copied to clipboard
| Challenge: | Existing synthetic training loops for large language models cause performance drops and induce emerging biases . a large amount of generated content is posted to coding platforms, social media platforms and other platforms on the internet . |
| Approach: | They propose a self-consuming retraining loop where models are trained on their own outputs . they use a control loop to isolate and analyze feedback-driven bias evolution . |
| Outcome: | The proposed model increases preference bias and decreases disparate bias. |
Copied to clipboard
| Challenge: | Large language models (LLMs) based Agents are increasingly pivotal in simulating complex human systems and interactions. |
| Approach: | They propose an AI-Agent School system that leverages agents for simulating educational dynamics. |
| Outcome: | The proposed system can simulate complex educational dynamics in simulated schools. |
Copied to clipboard
| Challenge: | Existing studies focus on limited control signals such as topic, stance, length, style, strategy, audience, and key aspects, failing to capture this complexity. |
| Approach: | They propose a benchmark that integrates multi-dimensional control into a single instruction to evaluate LLMs' ability to produce persuasive arguments. |
| Outcome: | The proposed benchmarks show that existing models fail to capture multifaceted argumentative control signals. |
Copied to clipboard
| Challenge: | Existing benchmarks for conversational machine reading comprehension are inconsistent with real scenarios. |
| Approach: | They propose to use a Chinese CMRC benchmark to evaluate model's generalization ability towards diverse domains by using zero-shot/few-shot settings. |
| Outcome: | The proposed benchmarks are based on 831 hot-topic driven conversations with 4,742 turns and cover 33 domains. |
Copied to clipboard
| Challenge: | Evaluating the safety robustness of LLMs is critical for their deployment. |
| Approach: | They propose to use latent representations to characterize hidden layer dynamics by analyzing the APT of latent models and introducing the JSS metric. |
| Outcome: | The proposed method exploits the APT (Angular-Probabilistic Trajectory) of latent representations and introduces the JSS (Jensen-Shannon Separability) metric. |
Copied to clipboard
| Challenge: | Existing studies on automatic summary evaluation metrics focus on lexical similarity and require a reference summary which is expensive to obtain. |
| Approach: | They propose to use a weakly supervised summary evaluation approach without the presence of reference summaries to transform existing summarization datasets into corrupted reference summarizers. |
| Outcome: | The proposed method outperforms baselines and shows that it improves linguistic quality over all metrics. |
Copied to clipboard
| Challenge: | Recent studies on review helpfulness prediction require labeled samples for each domain/category of interest. |
| Approach: | They propose a convolutional neural network based model which leverages word-level and character-based representations to transfer knowledge between domains. |
| Outcome: | The proposed model outperforms the state-of-the-art on the Amazon product review dataset. |
Copied to clipboard
| Challenge: | Recent advances in AM models overlook the integration of supplementary discourse structure information, resulting in suboptimal outcomes. |
| Approach: | They propose a framework which generates discourse structure-aware prefixes for each layer of the generation model. |
| Outcome: | The proposed framework achieves state-of-the-art performance on two AM benchmarks. |
Copied to clipboard
| Challenge: | Deciphering oracle bone scripts using AI technology is not an overnight task due to the evolution of written language over millennia. |
| Approach: | They propose a framework that utilizes Large Multi-modal Models (LMMs) for interpreting Oracle Bone Script (OBS). |
| Outcome: | The proposed framework provides quantitative analyses and superior deciphering capability. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have demonstrated strong machine translation capabilities for English-centric language pairs but underperform in direct non-English (x2x) translation. |
| Approach: | They propose a synthetic data generation framework that leverages models’ established English-to-x (en2x) capabilities by extending English parallel corpora into omnidirectional datasets and developing an English-referenced quality evaluation proxy. |
| Outcome: | The proposed framework achieves significant improvement across 72 x2x directions while generalizing to enhance en2x performance. |
Copied to clipboard
| Challenge: | Argumentation relation classification (ARC) is the most challenging subtask of argumentation mining. |
| Approach: | They propose a dual prior graph neural network to explore probing knowledge and syntactical information for comprehensively modeling the relationship between AC pairs. |
| Outcome: | The proposed model outperforms the state-of-the-art models on three public datasets. |
Copied to clipboard
| Challenge: | Existing methods for detecting factual inconsistencies in abstractive summarization are lacking in factual consistency detection. |
| Approach: | They propose to use real model-generated summaries with human annotations to detect factual inconsistencies. |
| Outcome: | The proposed model outperforms the SOTA on CoGenSumm, FactCC, Frank, and SummEval datasets. |
Copied to clipboard
| Challenge: | Using chain-of-thought to elicit reasoning capabilities is not always effective and accurate. |
| Approach: | They compare the reasoning process of LLMs with humans to understand the causal chain . they find that LLM deviates from the ideal causal chain, resulting in spurious correlations . |
| Outcome: | The proposed method does not improve performance or accurately represent reasoning processes in LLMs. |
Copied to clipboard
| Challenge: | Existing methods to adapt Large Language Models for Recommendation (LLMRec) do not represent collaborative information in a text-like format, which may not align optimally with LLMs. |
| Approach: | They propose a novel LLMRec method that integrates collaborative information through text-like encoding. |
| Outcome: | Extensive experiments show that BinLLM integrates collaborative information better with LLMs. |
Copied to clipboard
| Challenge: | Argument pair extraction (APE) aims to extract interactive argument pairs from two passages within a discussion. |
| Approach: | They propose a method to extract interactive argument pairs from two passages . they propose to decompose the probing graph into four sub-graphs based on inter- and intra-passage perspectives . |
| Outcome: | The proposed method improves on strong baselines on two benchmark datasets. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have reshaped machine translation, but multilingual MT still relies heavily on parallel data for supervised fine-tuning. |
| Approach: | They propose a framework that leverages only monolingual data and the intrinsic multilingual knowledge of Large Language Models (LLMs). |
| Outcome: | The proposed framework matches models trained on large-scale parallel data and excels in non-English translation directions. |
Copied to clipboard
| Challenge: | Existing reference-based metrics are limited by their reliance on human input. |
| Approach: | They propose to adapt some reference-based metrics to assess system summary against human-written references. |
| Outcome: | The proposed model outperforms reference-based metrics on two datasets and is comparable to reference-free metrics. |
Copied to clipboard
| Challenge: | Existing Large Language Model (LLM)-based recommender systems face challenges to adapt to dynamic user interests without any model-level updates. |
| Approach: | They propose a framework that establishes recommendation-oriented in-context learning by structuring recent user interactions and current inputs into ICL formats. |
| Outcome: | The proposed model adapts to dynamic user interests without model updates without any model updates and is available online at https://anonymous.4open.science/r/RecICL-8003. |
Copied to clipboard
| Challenge: | Existing scientific fact-checking datasets are limited due to expertise bottleneck . multi2Claim pipeline is a tool to convert multiple-choice questions into fact- checking data . |
| Approach: | They propose a pipeline for automatically converting multiple-choice questions into fact-checking data . they generate two large-scale datasets for scientific-fact-checker tasks . success at this task can help the reader understand scientific topics and promote science . |
| Outcome: | The proposed pipeline improves performance on two large-scale scientific fact-checking datasets. |
Copied to clipboard
| Challenge: | Existing methods for iterative retrieval-augmented generation (iRAG) suffer from greedy single-path expansion and granularity–demand mismatch . |
| Approach: | They propose a model that constructs candidate triples and history-conditionally integrates them to distill core triples to generate the next-hop query. |
| Outcome: | The proposed model mitigates the greedy single-path expansion and granularity–demand mismatch by preserving multiple plausible evidence chains. |
Copied to clipboard
| Challenge: | Existing methods for text summarization have been investigated, but there are still gaps between them and human professionals. |
| Approach: | They analyze 8 major sources of errors on 10 representative summarization models manually. |
| Outcome: | Aiming to gain more understanding of summarization systems with respect to their strengths and limitations on a fine-grained syntactic and semantic level, we use 8 major sources of errors on 10 representative summarizing models. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have emerged as the new recommendation engines, surpassing traditional methods in both capability and scope, particularly in code generation. |
| Approach: | They propose to use a dataset to investigate a new type of bias in Large Language Models for code generation, provider bias, to determine whether the model favors specific providers. |
| Outcome: | The proposed model favors services from Google and Amazon, but without explicit directives, and can modify input code to incorporate their preferred providers without user requests. |
Copied to clipboard
| Challenge: | Low-bit floating-point formats like MXFP and NVFP4 offer new opportunities for precision and efficiency. |
| Approach: | They evaluate HiFloat (HiF8 and HiF4), a family of floating-point formats tailored for Ascend NPUs. |
| Outcome: | The proposed formats excel with high-variance data and are compatible with state-of-the-art quantization frameworks. |