Papers by Chao Yang
Copied to clipboard
| Challenge: | Existing approaches to integrate local and global information into self-attention networks have been criticized for overlooking neighboring information. |
| Approach: | They propose a hybrid attention mechanism to leverage local and global information . they use a gating scalar to integrate both sources of information based on local contexts . |
| Outcome: | The proposed approach improves on translation tasks and shows that the two types of contexts are complementary. |
Copied to clipboard
| Challenge: | Existing models for multi-domain translation tasks only use monolingual data, whereas bilingual data is indispensable for improving the models. |
| Approach: | They propose a modular strategy that facilitates the cooperation of monolingual and bilingual knowledge in translation tasks by avoiding catastrophic forgetting. |
| Outcome: | The proposed model exhibits superior generalization and robustness over the conventional approach. |
Copied to clipboard
| Challenge: | Modern recommender systems aim to understand user-item relationships through past interactions, but their effectiveness is limited when handling sparse data or zero-shot scenarios. |
| Approach: | They propose a model-agnostic recommendation instruction-tuning paradigm that integrates large language models with collaborative filtering. |
| Outcome: | The proposed model-agnostic recommendation instruction-tuning paradigm improves performance across various settings and plug-and-play compatibility with state-of-the-art recommender systems. |
Copied to clipboard
| Challenge: | Multi-modal keyphrase prediction (MMKP) aims to produce concise, informative phrases that capture the essence of cross-modal inputs. |
| Approach: | They propose to use vision-language models to generate conclusive phrases using multiple modalities of input information. |
| Outcome: | The proposed methods outperform existing methods on absence and unseen scenarios and overestimate model capability due to overlap in training tests. |
Copied to clipboard
| Challenge: | Word embedding is central to neural machine translation, but indirectly interfaces with other layers, making them comparatively isolated. |
| Approach: | They propose a shared-private bilingual word embedding which gives a closer relationship between the source and target embedders and reduces the number of model parameters. |
| Outcome: | The proposed model improves on 5 language pairs belonging to 6 different language families and written in 5 different alphabets and significantly reduces model parameters. |
Copied to clipboard
| Challenge: | Empathetic response generation attempts to empower dialogue systems to perceive speakers’ emotions and generate empathetic responses accordingly. |
| Approach: | They propose to combine trait and state emotions for Empathetic Response Model to enable dialogue systems to perceive speakers' emotions and generate empathetic responses accordingly. |
| Outcome: | The proposed model outperforms state-of-the-art models and generates more empathetic responses. |
Copied to clipboard
| Challenge: | Existing benchmarks primarily evaluate planning and execution success, overlooking the self-reflective dimension of tool use. |
| Approach: | They propose a benchmark to assess LLMs’ self-reflective reasoning in tool-augmented multi-turn dialogues. |
| Outcome: | The proposed benchmark covers 10 domains with 88 distinct APIs and 968 annotated dialogues, systematically injecting diverse error types arising from both user and assistant behavior. |
Copied to clipboard
| Challenge: | supervised fine-tuning (SFT) has been a straightforward approach for tailoring the output of foundation large language models (LLMs) to specific preferences. |
| Approach: | They propose a training-free alignment method that uses minimal prior tokens to bridge the foundation LLM and the SFT LLM. |
| Outcome: | The proposed method achieves comparable performance without training on machine translation and part-of-speech tagging across seven languages. |
Copied to clipboard
| Challenge: | Online advertisement text generation models have achieved remarkable success in generating high-quality text ads, but some challenges remain, such as low-resource scenarios and training efficiency for multiple ad tasks. |
| Approach: | They propose a unified text ad generation framework with multi-task prompt learning to tackle low-resource ade generation problem and a multi-step prompt learning mechanism to efficiently solve multiple aed generation tasks. |
| Outcome: | The proposed framework outperforms the state-of-the-art on offline and online metrics. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have been used for general-purpose interfaces across multiple tasks and languages. |
| Approach: | They propose to use large language models as a general-purpose interface across multiple tasks and languages. |
| Outcome: | The proposed model performs better on 200K hours of 6-language data for voice generation applications. |
Copied to clipboard
| Challenge: | Developing effective biomedical retrieval models is important for excelling at knowledge-intensive biomedically tasks but still challenging due to the lack of sufficient publicly annotated biomedic data and computational resources. |
| Approach: | They propose a series of dense retrievers for enhancing biomedical retrieval via unsupervised pre-training on large biomedically corpora, followed by instruction fine-tuning on a combination of labeled datasets and synthetic pairs. |
| Outcome: | Experiments on 5 biomedical tasks across 11 datasets confirm the performance of the retrieval model on various biomedically demanding tasks. |
Copied to clipboard
| Challenge: | Existing LLMs often rely on complex prompting or extensive fine-tuning to introduce new capabilities while preserving strong generalizability. |
| Approach: | They propose a large-scale pre-training corpus to enhance LLM agents' capabilities . they use 103B agent-specific data encompassing 76,537 APIs . |
| Outcome: | The proposed training corpus outperforms open-source LLMs and commercial LLM agents on three agent benchmarks. |
Copied to clipboard
| Challenge: | Existing approaches to model locality for self-attention networks have shown great value for capturing global dependencies. |
| Approach: | They propose to model localness for self-attention networks to capture local context . they cast localness modeling as a learnable Gaussian bias, which indicates the central and scope of the local region to be paid more attention. |
| Outcome: | The proposed model improves the ability to capture local context and improves accuracy. |
Copied to clipboard
| Challenge: | Despite the success of low-resource neural machine translation, there is a data scarcity problem in many languages . large-scale, high-quality, and widecoverage bilingual corpora do not exist for most language pairs . |
| Approach: | They propose to quantify confidence of NMT models based on model uncertainty . they propose to use uncertainty-based confidence measures to improve back-translation . |
| Outcome: | The proposed model outperforms conventional statistical machine translation (SMT) on Chinese-English and English-German translation tasks. |
Copied to clipboard
| Challenge: | Large language models (LLMs) can adapt to new tasks easily and efficiently in a training-free manner. |
| Approach: | They propose to use eBayesian in-context example selection method to extend the inference probability conditioned on in-constitut examples based on Bayes’ theorem to select in-strategy examples . Experimental results show the efficacy and robustness of their method on various models, tasks and modalities. |
| Outcome: | The proposed method is based on the eBayesian in-context example selection approach. |
Copied to clipboard
| Challenge: | Empirical results show that attention mechanism can be improved from the energy consumption aspects. |
| Approach: | They propose to replace multiplications with either selective operations or additions to reduce energy consumption. |
| Outcome: | The proposed model achieves competitable accuracy while saving 99% and 66% energy during alignment calculation and the whole attention procedure. |
Copied to clipboard
| Challenge: | Existing RAG methods suffer from a two-part problem: semantic drift and concatenation fallacy . et al.: rapid development of Large Language Models has led to a paradigm shift in artificial intelligence . |
| Approach: | They propose a multi-agent retrieval augmentation framework guided by medical domain knowledge to address these challenges. |
| Outcome: | The proposed framework outperforms existing general RAG baselines on five widely used medical benchmarks. |
Copied to clipboard
| Challenge: | Recent training-free prompt optimizers treat performance as maximizing a single scalar score and ignore a second signal that the desired style is task dependent. |
| Approach: | They propose a semantic-entropy-based method that uses task uncertainty to guide prompt optimization by selecting high-entropicy candidates for creative tasks and low-energetic candidates for conservative ones. |
| Outcome: | The proposed method outperforms baselines on MT-Bench subsets and integrates easily into existing prompt optimizers. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have shown promise in formal theorem proving, but their token-level processing often fails to capture the inherent hierarchical nature of mathematical proofs. |
| Approach: | They propose a regularization method that aligns LLMs’ attention mechanisms with mathematical reasoning structures and establishes a five-level hierarchy from foundational elements to high-level concepts. |
| Outcome: | The proposed method improves proof success rates by 2.05% on miniF2F and 1.69% on ProofNet while reducing proof complexity by 23.81% and 16.50% respectively. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) can process extremely long contexts, requiring efficient inference over extended inputs. |
| Approach: | They propose a model that uses a constant-sized key-value cache to train long-context models. |
| Outcome: | Experimental results show that LongSpec achieves 3.26x speedup over strong Flash Attention baselines and 2.34x wall clock time on four math reasoning tasks. |
Copied to clipboard
| Challenge: | In-battle commentary is an important component of live streaming of e-sports competitions and is applicable to a wide range of scenarios like combat information analysis and live streaming. |
| Approach: | They propose a generative system for in-battle real-time commentary in mobile MOBA games and propose 'transform' method to convert match statistics and utterances into consistent encoding space. |
| Outcome: | The proposed system is based on real-time match statistics and events and can be used for live streaming, e-sports commentary and combat information analysis. |
Copied to clipboard
| Challenge: | Neural language models are vulnerable to word-level adversarial text attacks . previous word-based search methods assume important words influence prediction . |
| Approach: | They propose a method for similarizing the influence of words with contrast learning that encourages model to learn sentence representations in which words of varying importance have a more uniform influence on prediction. |
| Outcome: | The proposed method is compatible with various training methods and improves model robustness against various adversarial attacks. |
Copied to clipboard
| Challenge: | Existing studies have attributed SAN to being weak at learning positional information for sequence modeling due to lack of recurrence structure. |
| Approach: | They propose a word reordering detection task to quantify how well word order information is learned by SAN and RNN. |
| Outcome: | The proposed task quantifies how well word order information learned by SAN and RNN is learned. |
Copied to clipboard
| Challenge: | Existing approaches to dynamic sparse attention require preprocessing, lack global evaluation, violate query independence, or incur high computational overhead. |
| Approach: | They propose a dynamic sparse attention method that achieves all desirable properties through a head **r**ound-**r**obin (RR) sampling strategy. |
| Outcome: | Experiments on natural language understanding and multimodal video comprehension show that the proposed method achieves 2.4 speedup at 128K context length outperforming existing methods. |
Copied to clipboard
| Challenge: | Existing approaches to RPAs focus on static role profiles, overlooking dynamic perceptual abilities inherent to humans. |
| Approach: | They propose a framework that combines adaptive temporal sampling with dynamic and static role profiles. |
| Outcome: | The proposed framework combines adaptive temporal sampling with dynamic and static role profiles. |
Copied to clipboard
| Challenge: | Existing benchmarks lack comprehensive evaluations, particularly in multi-level reasoning, making it difficult to identify model limitations. |
| Approach: | They propose to use Agri-CM3 to assess multi-level reasoning in agricultural management by integrating multiple data modalities. |
| Outcome: | The Agri-CM3 benchmark includes 3,939 images and 15,901 multi-level multiple-choice questions with detailed explanations. |
Copied to clipboard
| Challenge: | Large language models are fine-tuned to align with human preferences, but tuning large models is computationally intensive and complex. |
| Approach: | They propose a method that uses implicit and explicit value functions to guide language model decoding at token and chunk-level respectively. |
| Outcome: | The proposed method outperforms traditional methods and circumvents the complexities of fine-tuning. |
Copied to clipboard
| Challenge: | Rapid urbanization and surging vehicle ownership intensify congestion . rapid urbanization drives crash rates, slow emergency response, and burden transit-poor communities . |
| Approach: | They introduce a 3B-parameter foundation model with human-like reasoning for Traffic signal control (TSC) they use reinforcement learning and network communication to convert LLM into a traffic-control model that operates like a human traffic agent. |
| Outcome: | The proposed model outperforms baselines and training-intensive RL controllers on a simulated traffic environment and reduces queue lengths by more than 5%. |
Copied to clipboard
| Challenge: | Existing approaches to training LLMs at ultra-low precisions suffer from convergence instability and substantial training costs. |
| Approach: | They propose a progressive QAT framework with outlier channel splitting to address these issues . they use nested structure of integer quantization grids to enable a "train once, deploy any precision" paradigm . |
| Outcome: | The proposed framework outperforms baselines on both Llama2/3 and W2A16, with an 11 speedup over BF16. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs)-based Multi-Agent Systems (MAS) exhibit remarkable problem-solving and task planning capabilities across diverse domains . |
| Approach: | They propose a security research framework for LLM-based multi-agent systems . they propose corresponding defense strategies to address MAS security risks . |
| Outcome: | The proposed framework amplifies the severity of security risks under MAS attacks . it offers an automated construction process for different MAS setups and an interaction paradigm . |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have driven the rise of agentic workflows . yet, how can we attribute performance gains to individual upgrades and their interactions? |
| Approach: | They propose a game-theoretic framework that models component upgrades as players and evaluates component coalitions to compute Shapley values. |
| Outcome: | The proposed framework provides interaction-aware attribution and recommendation for model allocation under a fixed workflow structure. |
Copied to clipboard
| Challenge: | Existing topic seed words are difficult to incorporate into topic models due to the semantic diversity of natural language. |
| Approach: | They propose a neural topic model enhanced with supervisions from seed words on word and document levels. |
| Outcome: | The proposed model outperforms the state-of-the-art seeded topic models in terms of topic quality and classification accuracy. |
Copied to clipboard
| Challenge: | Emoticons are widely used in digital communication to convey affective intent, yet their safety implications for Large Language Models (LLMs) remain largely unexplored. |
| Approach: | They propose to use ASCII-based emoticons to perform unintended actions in large language models (LLMs) This vulnerability is pervasive, with an average confusion ratio exceeding 38%, and 90% of confused responses yield 'silent failures' authors call on the community to recognize this emerging vulnerability and develop effective mitigation methods to uphold the safety and reliability of human-LLM interactions. |
| Outcome: | The proposed framework exploits emoticon semantic confusion in six LLMs and demonstrates that existing prompt-based mitigations are ineffective. |
Copied to clipboard
| Challenge: | Existing methods for detecting LLM-generated text require no training data. |
| Approach: | They propose a black-box zero-shot detection approach that calculates the Grammar Error Correction Score for a given text to differentiate between human-written and LLM-generated texts. |
| Outcome: | The proposed method outperforms current state-of-the-art zero-shot and supervised methods, achieving an average AUROC of 98.62% across XSum and Writing Prompts datasets. |
Copied to clipboard
| Challenge: | Text simplification systems are based on the quality and quantity of complex-simple sentence pairs extracted by aligning sentences between parallel articles. |
| Approach: | They propose a neural CRF alignment model which leverages the sequential nature of sentences in parallel documents and utilizes a sentence pair model to capture semantic similarity. |
| Outcome: | The proposed model outperforms previous work on monolingual sentence alignment task by more than 5 points in F1. |
Copied to clipboard
| Challenge: | Existing benchmarks for large language models focus on simple, flat table structures. |
| Approach: | They propose a benchmark to evaluate the performance of both Large Language Models and Multimodal LLMs across a variety of input formats for complex tabular data, including LaTeX, HTML, and PNG. |
| Outcome: | The proposed benchmark evaluates the performance of LLMs and Multimodal LLM models across a variety of input formats for complex tabular data, including LaTeX, HTML, and PNG. |
Copied to clipboard
| Challenge: | Large language models (LLMs) have remarkable evaluation and critique capabilities, providing insightful feedback and identifying flaws in various tasks. |
| Approach: | They propose a framework to train critic models using refinement signals to generate feedback loops where critiques guide the model in refining its responses. |
| Outcome: | The proposed framework outperforms traditional methods and open-source models in terms of critique quality and refinement outcomes. |
Copied to clipboard
| Challenge: | Existing speech-text pre-training methods are limited to one or two specific tasks, despite their success in speech-language processing tasks. |
| Approach: | They propose a temporal position prediction task to capture the speech-text alignment . they use a textual dialog pre-training task to generalize a response selection task . |
| Outcome: | The proposed model is superior in learning speech-text alignment and multi-turn dialog context. |
Copied to clipboard
| Challenge: | Experiments show that enhancing implicit reasoning capabilities can significantly improve complex instruction following in large language models. |
| Approach: | They propose a method to enhance LLMs’ understanding of implicit reasoning instructions by formalizing such instructions as verifiable reasoning graphs and fine-tuning with graph reasoning. |
| Outcome: | The proposed method outperforms existing models on five complex instruction following benchmarks and will be open-sourced in the near future. |
Copied to clipboard
| Challenge: | Recent studies have shown that by curating high quality and diverse instruction tuning datasets, we can significantly improve instruction-following capabilities. |
| Approach: | They propose an algorithm to control diversity and quality of instruction tuning datasets and validate it. |
| Outcome: | The proposed algorithm significantly improves worst and average case performance on large scale instruction tuning datasets. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are now commonplace in conversation applications, but their misuse for generating harmful responses has raised serious societal concerns. |
| Approach: | They provide a comprehensive overview of recent studies covering attacks, defenses, and evaluations of Large Language Models (LLMs) . |
| Outcome: | The proposed review summarizes three aspects of LLM conversation safety: attacks, defenses, and evaluations. |
Copied to clipboard
| Challenge: | Existing Large Multi-modal Models lack a robust visual processing capability that is often masked by evaluation metrics that prioritize final-answer accuracy. |
| Approach: | They propose a three-layer evaluation framework that scrutinizes the generation of valid visual aids and the soundness of subsequent reasoning steps. |
| Outcome: | The proposed framework examines the generation of valid visual aids and the soundness of subsequent reasoning steps on state-of-the-art models. |
Copied to clipboard
| Challenge: | Existing evaluation methods suffer from cognitive dimensional simplification and methodological unreliability due to the ”LLM-as-a-Judge” approach. |
| Approach: | They propose a six-tiered benchmark that evaluates ASG systems by prioritizing deterministic algorithms and introducing a GRADE approach for abstract abilities. |
| Outcome: | The proposed method provides the ASG field with a systematic, reproducible, and theoretically grounded benchmark to guide future research. |
Copied to clipboard
| Challenge: | Recent approaches to language model alignment assume homogeneous human preferences, but actual human preferences vary widely and are hard to satisfy with a single language model. |
| Approach: | They propose an RL-free extension of Direct Preference Optimization (DPO) that folds language modeling directly into reward modeling and trains language models as collective reward models that combine all objectives with specific weights. |
| Outcome: | The proposed method matches or outperforms existing methods in safety alignment and long-form question answering. |
Copied to clipboard
| Challenge: | With the development of medical digitization, the extraction and structuring of electronic medical records (EMRs) have become challenging but fundamental tasks. |
| Approach: | They propose a speaker-aware dialogue encoder with multi-task learning which takes the speaker's identity into account and a co-attention fusion network to aggregate the utterance information. |
| Outcome: | The proposed framework outperforms the state-of-the-art methods on the public medical dialogue extraction datasets to demonstrate its superiority. |
Copied to clipboard
| Challenge: | Recent advances in large language models have revolutionized text generation with their remarkable capabilities. |
| Approach: | They propose to combine a single-attribute model with a discriminative model to achieve a combination strategy that incorporates positive correlation and attribute enhancement. |
| Outcome: | The proposed method is adapted for single-attribute control scenario and achieves surpassing results. |
Copied to clipboard
| Challenge: | Existing models that assume users to be static, rational agents with fixed preferences fail to capture rich behavioral heterogeneity in real-world debt collection scenarios. |
| Approach: | They propose a public persona-enriched debt collection benchmark that highlights behavioral heterogeneity in negotiation. |
| Outcome: | The proposed benchmark outperforms existing models in realistic scenarios using 16 state-of-the-art LLMs. |
Copied to clipboard
| Challenge: | Autoregressive (AR) models excel at generating temporally coherent audio by producing tokens sequentially, yet they often falter in faithfully following complex textual prompts. |
| Approach: | They propose a lightweight auxiliary model trained with a GAE-inspired objective to predict final instruction-following quality from partial generations. |
| Outcome: | The proposed model achieves 10 points improvement in CLAP score over baseline AR models while maintaining computational parity with best-of-N decoding. |
Copied to clipboard
| Challenge: | Existing multi-agent reinforcement learning methods depend on large critic networks to evaluate joint actions, leading to instability and high memory costs. |
| Approach: | They propose a method to optimize large language models for agent-specific roles . they propose combining agent-based frameworks with retrieval-augmented generation . |
| Outcome: | Experiments show that multi-agent group policy optimization outperforms baselines in task performance and computational efficiency. |
Copied to clipboard
| Challenge: | Existing studies have shown that the training of neural machine translation (NMT) rely on the quality of artificial schedule drawn up with the handcrafted features, e.g. sentence length or word rarity. |
| Approach: | They propose to train NMT model using a self-paced learning approach that allows it to quantify the learning confidence over training examples and flexibly govern its learning via regulating the loss in each iteration step. |
| Outcome: | The proposed model outperforms baseline models and those trained with human-designed curricula on translation quality and convergence speed. |
Copied to clipboard
| Challenge: | Existing prompt-based methods for debiasing are often superficial and lack a thorough understanding of complex bias concepts. |
| Approach: | They analyze a BBQ and stereoSet benchmarks to examine the assumption that large language models understand biases. |
| Outcome: | The proposed model misclassified 90% of unbiased content as biased despite high accuracy on BBQ dataset . the proposed model may have been flawed in previous attempts to debiase . |
Copied to clipboard
| Challenge: | Tool-integrated reasoning (TIR) enables LLM agents to solve tasks through planning, tool use, and iterative revision, but outcome-only reinforcement learning suffers from sparse, delayed rewards and weak step-level credit assignment. |
| Approach: | They propose a tool-integrated reasoning approach that localizes the first irrecoverable step and leverages it for fine-grained credit assignment. |
| Outcome: | The proposed algorithm outperforms strong Agentic RL benchmarks in math, science QA, and code execution with additional gains in Pass@K and Major@K scaling, rollout ranking quality, and tool-call efficiency. |
Copied to clipboard
| Challenge: | Modern language models rely on Reinforcement Learning from Human Feedback (RLHF) to encourage safe behaviors, but they remain vulnerable to adversarial attacks due to three key limitations: (1) the inefficiency and high cost of human annotation; (2) the vast diversity of potential adversarials; and (3) the risk of feedback bias and reward hacking. |
| Approach: | They propose an iterative adversarial training method that incorporates three key innovations to address these challenges. |
| Outcome: | Experiments on Mistral-7B-Instruct-v0.3 show that the proposed method significantly enhances robustness and reduces harmful outputs from 5.88% to 0.43%. |
Copied to clipboard
| Challenge: | Recent methods for evaluation of translation quality are focused on one task, ignoring commonalities . |
| Approach: | They propose a unified framework engaged with abilities to handle all three evaluation tasks. |
| Outcome: | The proposed framework can universally surpass state-of-the-art or winner methods across tasks. |
Copied to clipboard
| Challenge: | Recent advances in multimodal large language models (MLLMs) focus on visual abilities, but audio is essential for video understanding. |
| Approach: | They propose an audio-centric video understanding benchmark to evaluate video comprehension capabilities of multimodal LLMs with a particular focus on auditory information. |
| Outcome: | The proposed video understanding benchmarks evaluate video comprehension capabilities of multimodal models with a particular focus on auditory information. |
Copied to clipboard
| Challenge: | Large language models (LLMs) often produce factual errors due to limited internal knowledge. |
| Approach: | They propose a retrieval-augmented generation framework that generates plan tokens to guide subsequent generation. |
| Outcome: | The proposed framework improves the accuracy of large language models with external knowledge sources. |
Copied to clipboard
| Challenge: | Existing benchmarks focused on simplified or isolated aspects of coding, ignoring the full spectrum of programming challenges. |
| Approach: | They propose a case study that examines the performance of large language models across the entire software development lifecycle with four programming languages, multiple domains, and carefully designed and verified metrics for each task. |
| Outcome: | The proposed model performs across the entire software development lifecycle, including design, environment setup, implementation, acceptance testing, and unit testing. |
Copied to clipboard
| Challenge: | Current Text-to-SQL reasoning models lack integrated execution feedback during generation. |
| Approach: | They propose a text-to-SQL framework that interacts with the SQL execution engine during decoding and dynamically adjusts reasoning based on execution feedback. |
| Outcome: | The proposed framework achieves 89.1% accuracy on Spider and 65.3% on BIRD at the 7B scale. |
Copied to clipboard
| Challenge: | Large Reasoning Models (LRMs) have emerged as a powerful advancement in multi-step reasoning tasks, but they introduce safety and reliability risks, such as CoT-hijacking and prompt-induced inefficiencies. |
| Approach: | They propose a unified benchmark to assess the trustworthiness of Large Reasoning Models. |
| Outcome: | The proposed benchmark evaluates truthfulness, safety and efficiency on 26 models. |
Copied to clipboard
| Challenge: | Real-world data combines structured and unstructured formats, capturing explicit relationships and implicit semantic interdependencies. |
| Approach: | They propose GraphAgent, an automated agent pipeline addressing both explicit and implicit graph-enhanced semantic dependencies for predictive and generative tasks. |
| Outcome: | Extensive experiments on diverse datasets validate GraphAgent’s effectiveness in graph-related predictive and text generative tasks. |
Copied to clipboard
| Challenge: | Existing methods for learning complex sentences with multiple aspects are ill-equipped to learn complex sentences . |
| Approach: | They propose a mutual enhanced transformation network for the ABSA task . it improves representation learning of the aspect with contextual semantic features . |
| Outcome: | The proposed model improves representation learning of the aspect with contextual semantic features, giving the aspect more abundant information. |
Copied to clipboard
| Challenge: | Existing methods focus on single-step reasoning, ignoring logical dependencies between steps. |
| Approach: | They propose a method that maximizes a structure-based return to facilitate structured reasoning and explanation. |
| Outcome: | The proposed method outperforms state-of-the-art methods on EntailmentBank and STREET benchmarks. |
Copied to clipboard
| Challenge: | Image-caption pairs and translation pairs provide the means to learn deep representations of and connections between languages. |
| Approach: | They propose a dual encoder that integrates image-text matching and translation pairs to solve two tasks by learning from billions of pairs. |
| Outcome: | The proposed encoder outperforms ALIGN's cross-modal retrieval performance on well-resourced languages and significantly improves on under-resource languages. |
Copied to clipboard
| Challenge: | Neural networks are vulnerable to adversarial examples, i.e., under a black-box scenario. |
| Approach: | They propose a word-level search algorithm that searches for subareas under dynamic search space following the subarea importance. |
| Outcome: | The proposed algorithm can achieve comparable success rates to complex search methods while saving numerous queries and time. |
Copied to clipboard
| Challenge: | Existing persona-based dialogue models generate personalized responses using predefined persona information, but they lack personality. |
| Approach: | They propose a persona-based dual Alternating Learning Network that generates personalized responses using predefined persona information. |
| Outcome: | The proposed method produces more personalized responses than baseline methods. |
Copied to clipboard
| Challenge: | Existing methods for evaluating expressive speech focus on word accuracy, naturalness, signal quality, or emotional intensity at the utterance level. |
| Approach: | They propose a framework for Evaluating Expressive Appropriateness in speech that assesses whether a speech sample aligns with the underlying communicative intent implied by its discourse-level narrative context. |
| Outcome: | The proposed framework outperforms existing speech evaluation and analysis systems on a human-annotated test set. |
Copied to clipboard
| Challenge: | Existing studies show that small language models (SLMs) overfit in low resource situations . however, the gap between pre-training and fine-tuning leads to performance decay . |
| Approach: | They propose to combine large language models and LLM for relation identification by co-evolution . they propose to use a masked language model prompt to generate a relation identification task . |
| Outcome: | The proposed model can handle low resource relation identification tasks with minimal overfitting . the proposed model provides essential background knowledge to assist training process . |
Copied to clipboard
| Challenge: | Existing ESC data entangles psychological strategies and response content, making it difficult to construct high-quality preference pairs. |
| Approach: | They propose a Decoupled ESC framework that decomposes the ESC task into two sequential subtasks: strategy planning and empathic response generation. |
| Outcome: | The proposed framework outperforms baselines, reducing preference bias and improving response quality. |
Copied to clipboard
| Challenge: | Existing methods for empathetic response generation ignore the associated words between dialogue utterances. |
| Approach: | They propose an iterative associative memory model to capture associated words between dialogue utterances and situations, dialogue history, and a memory module for storing associated words. |
| Outcome: | The proposed model captures key words between dialogue utterances and situations, dialogue history, and a memory module, thereby accurately and nuancedly comprehending the utterables. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) are capable of generating human-like text, but the potential for freely customisable characters remains underexplored. |
| Approach: | They propose a framework which employs Large Language Models to create freely customisable characters through personalised characteristic feature injection. |
| Outcome: | The proposed framework provides valuable insights for developing more accurate and customisable human simulacra. |
Copied to clipboard
| Challenge: | Semantic phrases (SP) are lexical combinations whose meanings or usages may not be fully derived from their individual components. |
| Approach: | They propose to consolidate existing multiword expression resources into a unified testbed to assess language models in semantic phrase processing tasks. |
| Outcome: | The evaluation suite covers idiomatic expressions, noun compounds, and verbal constructions. |
Copied to clipboard
| Challenge: | Neural machine translation (NMT) has proven to be facilitated by curriculum learning which presents examples in an easy-to-hard order at different training stages. |
| Approach: | They propose to use an uncertainty-aware curriculum learning approach to assess data difficulty and model competence to provide examples in an easy-to-hard order at different training stages. |
| Outcome: | The proposed approach outperforms baseline and related methods on translation quality and convergence speed. |
Copied to clipboard
| Challenge: | Existing methods to recognize named entities have been criticized for their performance on flat NER but fail to handle nested entities. |
| Approach: | They propose to use a span-based constituency parser to tackle nested NER . they use lexicalized constituency trees to model nesting entities . |
| Outcome: | The proposed method achieves state-of-the-art performance on ACE2004, ACE2005 and NNE, and competitive performance on the GENIA platform. |
Copied to clipboard
| Challenge: | Existing models of self-attention networks lack the ability to capture dependencies regardless of distance and can be enhanced with multi-head attention. |
| Approach: | They propose a convolutional self-attention network which can be enhanced by multi-head attention by allowing the model to attend to information from different representation subspaces. |
| Outcome: | The proposed model outperforms existing models on improving locality of SANs on different language pairs and model settings. |
Copied to clipboard
| Challenge: | Large language models have made significant strides in text-to-SQL tasks, but small language models struggle to accurately interpret natural language questions due to resource limitations. |
| Approach: | They propose a SQL parser that extracts constraints from SQL to generate sub-SQLs . they use a rule-based and LLM-based method to generate step-by-step SQL explanations based on the results . |
| Outcome: | The proposed framework outperforms models with the same model size on BIRD and Spider benchmarks. |
Copied to clipboard
| Challenge: | Multimodal large language models (MLLMs) have enabled LLM-based agents to directly interact with application user interfaces (UIs), enhancing agents’ performance in complex tasks. |
| Approach: | They propose a novel agent framework that prioritizes actions through application programming interfaces over UI actions and facilitates the creation and expansion of APIs through automated exploration of applications. |
| Outcome: | The proposed framework reduces task completion time by 65%-70% and cognitive workload by 38%-53% while maintaining accuracy of 97%-98% compared to humans. |
Copied to clipboard
| Challenge: | Existing tasks to generate question-answer pairs from visual images are under-explored. |
| Approach: | They propose a task that targets question-answer pair generation from visual images. |
| Outcome: | The proposed model can generate diverse or consistent QAPs on two benchmarks. |
Copied to clipboard
| Challenge: | Existing approaches to improve cross-lingual transfer performance are based on word alignment, but no empirical studies have evaluated their effectiveness or limitations. |
| Approach: | They propose a mark-then-translate method that integrates translation and projection by inserting special markers around the labeled spans in the original sentence. |
| Outcome: | The proposed method outperforms word alignment-based methods in 57 languages and three tasks. |
Copied to clipboard
| Challenge: | Neural language models have demonstrated impressive performance but remain vulnerable to word-level adversarial attacks. |
| Approach: | They propose two standardized search spaces to address the problem of word-level adversarial attacks. |
| Outcome: | The proposed search spaces improve performance and trade-offs in different scenarios. |
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have emerged as the new recommendation engines, surpassing traditional methods in both capability and scope, particularly in code generation. |
| Approach: | They propose to use a dataset to investigate a new type of bias in Large Language Models for code generation, provider bias, to determine whether the model favors specific providers. |
| Outcome: | The proposed model favors services from Google and Amazon, but without explicit directives, and can modify input code to incorporate their preferred providers without user requests. |
Copied to clipboard
| Challenge: | Using a multimodal model, GUI agents can ground from language instructions to target elements . relying on HTML or AXTree inputs is a challenge for GUI agents . |
| Approach: | They propose a large multimodal model specifically designed for GUI grounding that adopts a pure vision approach instead of auxiliary inputs. |
| Outcome: | The proposed model outperforms vision-only and AXTree-reliant models on offline and online agents. |