Papers by Yan Tang
Copied to clipboard
| Challenge: | Efficient access to mentions of clinical entities is very important for using clinical text. |
| Approach: | They developed a pipeline system based on deep learning methods for this shared task . it achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average LSTM score of 0.8391 on track 2 . |
| Outcome: | The proposed system achieves a micro-average F1-score of 0.9105 on track 1 and a mini-average score of 0.8391 on track 2. |
Copied to clipboard
| Challenge: | Existing methods for integrating knowledge graphs rely on entity and relation embeddings . Fig. 1 shows how to decode knowledge graph in under 6 seconds . |
| Approach: | They propose a framework that only utilizes entity embeddings to decode knowledge graphs. |
| Outcome: | The proposed framework reconstructs KG representation by maximizing smoothness of entity embeddings. |
Copied to clipboard
| Challenge: | GUI agents have demonstrated remarkable progress in automating complex user interface interactions . training such agents for long-horizon tasks remains challenging due to limited rewards and prohibitive costs. |
| Approach: | They propose a method that leverages expert trajectories as environment experiences for on-policy multi-turn training. |
| Outcome: | The proposed method achieves significant gains over the base model with 1K public trajectories as RL experiences . it achieves competitive performance against strong baselines such as UI-TARS-7B and GPT-4o . |
Copied to clipboard
| Challenge: | Existing benchmarks focus on common instructions that align well with what the model learned during training, but proficiency in responding to these instructions does not necessarily imply strong ability in instruction following. |
| Approach: | They propose a new instruction-following evaluation protocol called verbalizer manipulation that instructs the model to verbalize the task label with words aligning with model priors to different extents. |
| Outcome: | The proposed protocol can be integrated with any classification benchmark to examine the model’s reliance on priors and its ability to override them to accurately follow the instructions. |
Copied to clipboard
| Challenge: | Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge. |
| Approach: | They propose a recurrent inductive bias that aligns with the recursive nature of programming logic. |
| Outcome: | The proposed model achieves comparable performance to standard dense models with more parameters. |
Copied to clipboard
| Challenge: | Large language models struggle with context awareness, leading to inaccuracies in tasks requiring faithful adherence to provided information. |
| Approach: | They propose a method to enhance LLMs' context awareness by updating only the last Feed-Forward Network module to maximize the likelihood of the prompt before inference . |
| Outcome: | The proposed method improves the accuracy of Llama 3-8B-Inst on the NQ-SWAP dataset from 59.1% to 71.6% and reduces the output structure failure rate of Qwen 1.5-4B-Chat from 34.9% to 25.5%. |
Copied to clipboard
| Challenge: | Large language models (LLMs) demonstrate impressive multilingual capability, but their performance varies substantially across different languages. |
| Approach: | They propose a generic template prompt that stimulates cross-lingual and logical reasoning skills to enhance task performance across languages. |
| Outcome: | The proposed method improves multilingual capability across languages and covers high-resource and low-resourced languages. |
Copied to clipboard
| Challenge: | Existing PEFT methods suffer from limited parameter efficiency and coarse-grained adaptation due to proliferation of LoRA experts and instance-level routing. |
| Approach: | They propose a new MoE-LoRA framework that incorporates expert diversity, parameter efficiency, and fine-grained adaptation. |
| Outcome: | The proposed framework outperforms existing methods on multiple tasks while maintaining parameter efficiency. |
Copied to clipboard
| Challenge: | Lipid nanoparticles (LNPs) can deliver cargos to tumor and immune cells . traditional approaches rely on experimental screening and expert judgment . |
| Approach: | They propose a method to generate lipid molecules efficiently and actively using deep learning. |
| Outcome: | The proposed method outperforms baseline methods on multiple cell lines and achieves a 30% improvement over the current methods. |
Copied to clipboard
| Challenge: | Lack of human preference labels remains a significant bottleneck when applying RLHF to a downstream domain. |
| Approach: | They propose a method that leverages human priors encoded in Knowledge Graphs (KGs) to derive RL rewards in the absence of manual annotations. |
| Outcome: | Experiments on three public and one private medical dialogue datasets show that the proposed method outperforms the competitive RLAIF in improving LLM diagnostic accuracy. |
Copied to clipboard
| Challenge: | Existing methods for multimodal sarcasm detection do not fully utilize cross-modal features, limiting their performance on in-domain datasets. |
| Approach: | They propose a multimodal sarcasm detection model with a designed instruction template and a demonstration retrieval module. |
| Outcome: | The proposed model outperforms existing methods on in-domain datasets and achieves state-of-the-art performance. |
Copied to clipboard
| Challenge: | Existing methods for medical vision-language models overlook modality misalignment . HSCR generates high-quality preference data with higher sampling probability . |
| Approach: | They propose a hierarchical self-contrastive reward approach that addresses two challenges in alignment . they leverage the inherent capability of Med-VLMs to generate dispreferred responses . |
| Outcome: | The proposed approach improves accuracy and trustworthiness of medical vision-label models with 2,000 training entries. |
Copied to clipboard
| Challenge: | Instruction-tuned Large Language Models (LLMs) can modulate responses based on human instructions, but they can be maliciously steered to impact society in subtle but persistent ways. |
| Approach: | They propose a backdoor attack setting that allows an attacker to inject a virtual prompt into an LLM to steer it without any explicit injection at its input. |
| Outcome: | The proposed method is able to poison the model's instruction tuning data and show that it is highly effective in steering the model. |
Copied to clipboard
| Challenge: | Chain-of-Thought (CoT) reasoning has improved the performance of large language models (LLMs) however, the detailed reasoning process in CoT often incurs long generation times and high computational costs due to the inclusion of unnecessary steps. |
| Approach: | They propose a method to identify critical reasoning steps using perplexity as a measure of their importance. |
| Outcome: | The proposed method achieves a better balance between reasoning accuracy and efficiency of CoT. |
Copied to clipboard
| Challenge: | ESPnet-ST-v2 is a revamp of the open-source spoken language translation toolkit . it supports offline speech-to-text translation (ST), simultaneous speech- to-text (SST), and offline speech to-speech (S2ST) |
| Approach: | They propose to revamp the open-source ESPnet-ST toolkit to support offline speech-to-text translation, simultaneous speech- to-text and offline speech to-speech translation. |
| Outcome: | The updated version of ESPnet-ST supports offline speech-to-text translation (ST), simultaneous speech- to-text (SST), and offline speech to-speech translation (S2ST). |
Copied to clipboard
| Challenge: | Existing methods for parameter-efficient fine-tuning (PEFT) are limited by computational costs and performance degradation. |
| Approach: | They propose a method that integrates Low-Rank Adaptation and Mixture-of-Experts (MoE) they propose combining expert load imbalance and representation collapse to improve LLM performance . |
| Outcome: | The proposed method outperforms homogeneous MoE-LoRA architectures in performance and parameter efficiency. |
Copied to clipboard
| Challenge: | Large visionlanguage models (LVLMs) are a powerful visual-language reasoning tool. |
| Approach: | They propose to integrate attention analysis with LLaVA-CAM to determine interactions between visual representations. |
| Outcome: | The proposed approach can be used to determine interactions between visual representations. |
Copied to clipboard
| Challenge: | Existing approaches to natural language transformation (NLT) tasks face significant challenges, such as the computational costs of leveraging large pre-trained models and the limited generalization ability of fine-tuned smaller models. |
| Approach: | They propose a framework that combines prompting with fine-tuning to enhance smaller models by integrating In-Context Examples from retrieval. |
| Outcome: | The proposed framework outperforms existing methods across MT and TST tasks. |
Copied to clipboard
| Challenge: | Mixture-of-Experts (MoE) based large language models are popular for multitasking . however, whether each expert can specialize to a task remains unclear . |
| Approach: | They propose to use a dictionary learning approach to analyze expert collaboration mechanisms in MoE LLMs. |
| Outcome: | The proposed model outperforms existing methods by 2.5% while enabling 50% expert reduction. |
Copied to clipboard
| Challenge: | Existing methods of text detoxification fail to achieve a decent balance between effectiveness and generation quality. |
| Approach: | They propose a text detoxification framework that pays attention to both context and detoxification process. |
| Outcome: | Experiments on various LLMs show that the proposed framework can yield the best performance compared to baselines. |
Copied to clipboard
| Challenge: | Using advanced Large Language Models, instructors can improve training of smaller models by analyzing their own model's errors. |
| Approach: | They propose a framework that leverages advanced Large Language Models to enhance training of smaller target models. |
| Outcome: | The proposed framework outperforms ChatGPT on multiple benchmarks and shows that it improves on both in-domain and out-of-domain benchmarks. |
Copied to clipboard
| Challenge: | Existing approaches to multi-hop question answering focus on generating simple questions and neglecting the integration of essential knowledge, such as relevant sentences within documents. |
| Approach: | They propose a framework to expand the diversity of generated multi-hop questions by sampling varied knowledge compositions within a given context. |
| Outcome: | The proposed framework improves the overall accuracy of knowledge composition selection by 3.9% on hotpotQA and 2WikiMultihopQA datasets. |
Copied to clipboard
| Challenge: | Existing methods for related search have limited semantic redundancy and wasted retrieval quota . generative retrieval approaches lack explicit reasoning, relying on superficial click-through rate rewards . |
| Approach: | They propose a framework that transforms related search into a reasoning-enhanced listwise generation task. |
| Outcome: | Experimental results show that ReList outperforms state-of-the-art methods in query diversity and user engagement. |
Copied to clipboard
| Challenge: | Existing methods to generate concise summarizations rely on coarse-grained textual and visual information, but they are underutilized. |
| Approach: | They propose a Visual Enhanced Entity-Level Interaction Network to address underutilization of multimodal inputs at a fine-grained level. |
| Outcome: | The proposed model outperforms existing models on two MMS datasets and proposes new metrics to measure factual consistency of entities in the output. |
Copied to clipboard
| Challenge: | Existing RL-based agentic search models fail to recognize reasoning boundaries and rarely admit "I DON'T KNOW" lack of reliability leads to plausible but unreliable answers, introducing significant risks . |
| Approach: | They propose a framework to cultivate reliable boundary awareness without compromising accuracy. |
| Outcome: | Experiments show that the proposed framework improves the reliability of agentic search models. |
Copied to clipboard
| Challenge: | Chain-of-Thought reasoning introduces significant inference latency due to its verbosity. |
| Approach: | They propose a framework that leverages token elasticity phenomenon to progressively compress CoTs via multiround refinement. |
| Outcome: | The proposed method achieves an average accuracy improvement of 5.6% over state-of-the-art baselines while reducing CoT length by an average of 47 tokens and significantly lowering latency. |
Copied to clipboard
| Challenge: | Existing work on rationale quality underestimates the importance of CoT distillation, focusing primarily on data quantity, which may result in transferring noisy or incorrect information to the student model. |
| Approach: | They propose a method which can discern and select high quality rationales for distillation and a Rationale Difficulty metric to measure the ability of the student model to generate the correct answer under a given rationale. |
| Outcome: | The proposed method achieves 4.6% accuracy improvement over baseline data on seven datasets over three tasks, controlling accuracy, diversity, and difficulty. |
Copied to clipboard
| Challenge: | Existing approaches to overcome object hallucination are limited . Existing mitigations include costly retraining and a training-free inference framework . |
| Approach: | They propose a training-free inference framework that simulates a metacognitive self-correction process. |
| Outcome: | The proposed framework reduces object hallucination rates by 12.67% on MMHal-Bench and improves accuracy by 5.8% on POPE. |
Copied to clipboard
| Challenge: | Large language models are valuable intellectual property due to the computational cost of training. |
| Approach: | They propose a dual-level fingerprinting framework that extracts trigger patterns and knowledge-level signatures to verify black-box ownership. |
| Outcome: | The proposed framework verifies the copyright of protected LLMs on their variants, achieving an IP-ROC greater than 0.99. |
Copied to clipboard
| Challenge: | Effidit is a digital writing assistant that provides three modules to help users write faster and more efficiently. |
| Approach: | They present Effidit, a digital writing assistant that provides three modules to help users write higher-quality text more efficiently. |
| Outcome: | Effidit expands the capabilities of a typical writing assistant by providing three modules . Effit can help users create their own text faster and more efficiently . |
Copied to clipboard
| Challenge: | Extractive text summarisation aims to select salient sentences from a document to form a short yet informative summary. |
| Approach: | They propose to formulate extractive text summarisation as an Optimal Transport (OT) problem and use it to obtain an optimal summary that minimises the transportation cost to a given document. |
| Outcome: | The proposed method outperforms state-of-the-art methods and learning-based methods on multiNews, PubMed, BillSum, and CNN/DM datasets. |
Copied to clipboard
| Challenge: | Chart question answering (ChartQA) tasks are a critical part of visualization charts. |
| Approach: | They propose a chart question answering task that uses MLLMs to analyze charts . they propose 'Chain-of-Charts' textual prompt strategy that directs attention to visual elements . |
| Outcome: | The proposed model improves performance by 14.41% and 80% in low-level ChartQA tasks. |
Copied to clipboard
| Challenge: | Existing methods fail to reconcile click-through rate (CTR) optimization with topic expansion. |
| Approach: | They propose a query generation framework that aligns click-through rate and topic expansion goals through an online DPO paradigm. |
| Outcome: | The proposed approach achieves significant CTR gains (+2.3%) and higher human-rated query quality compared to state-of-the-art methods. |
Copied to clipboard
| Challenge: | Named Entity Recognition (NER) models are constrained by a pre-defined label set and require extensive human annotations, which limits their flexibility and adaptability to unseen tasks. |
| Approach: | They propose a Generative NER system that shows improved zero-shot performance across unseen entity domains by introducing contextual information and delineating label boundaries. |
| Outcome: | The proposed model outperforms state-of-the-art methods in zero-shot evaluation. |
Copied to clipboard
| Challenge: | figurative language is a challenge for human translators, who often choose a context-aware translation . a set of commonly used idioms condenses its figurativ meaning into a few characters . |
| Approach: | They evaluate whether GPT-4 can generate high-quality translations using Pareto-optimal prompting strategies that outperform translation engines from Google and DeepL. |
| Outcome: | The proposed translations outperform translation engines from Google and DeepL at low cost. |
Copied to clipboard
| Challenge: | Existing methods for addressing item-level user interests are lacking in cross-domain generalization . RecBase model is domain-agnostic and can be used to enhance recommender systems' effectiveness . |
| Approach: | They propose a domain-agnostic foundational model pretrained with a recommendation-oriented objective that leverages a large-scale, heterogeneous, cross-domain corpus with unified textual representations and feature mappings to enhance cross- domain generalization. |
| Outcome: | The proposed model matches or surpasses baselines in zero-shot and cross-domain recommendation tasks on eight real-world datasets. |
Copied to clipboard
| Challenge: | Technical language and templated nature of professional reports hinder patient comprehension and allow models to artificially boost lexical metrics such as BLEU by reproducing common report patterns. |
| Approach: | They propose a layman's RRG framework that leverages layperson-friendly language to enhance patient accessibility and promote robust evaluation and report generation by encouraging models to focus on semantic accuracy over rigid templates. |
| Outcome: | The proposed framework improves model performance with more layman-style data, compared to templated professional language and inflated lexical scores. |
Copied to clipboard
| Challenge: | Question answering (QA) and question generation (QG) are closely related tasks. |
| Approach: | They propose a training algorithm that generalizes both Generative Adversarial Network and Generating Domain-Adaptive Nets under the question answering scenario. |
| Outcome: | The proposed training algorithm generalizes both Generative Adversarial Network (GAN) and Generating Domain-Adaptive Nets (GDAN) under the question answering scenario. |
Copied to clipboard
| Challenge: | Existing fine-tuning approaches that focus on English-centric training corpora often introduce implicit cross-lingual alignment, overlooking the potential for more profound, latent-level cross-linguistic interactions. |
| Approach: | They propose a multilingual fine-tuning paradigm that explicitly establishes a cross-lingual connection mechanism at the latent level. |
| Outcome: | The proposed model outperforms vanilla SFT and offers a strong latent-level alternative to data-level augmentation methods. |
Copied to clipboard
| Challenge: | Existing urban itinerary planning studies focus on traditional tourism, but they lack the precision and accuracy needed to create a personalized itinerary. |
| Approach: | They propose an open-domain urban itinerary planning system that integrates spatial optimization with large language models to provide customized urban itineraries based on user needs. |
| Outcome: | The proposed system can generate personalized urban itineraries based on user needs and scale with existing methods. |
Copied to clipboard
| Challenge: | a new benchmark for biomedical language understanding is being developed in Chinese . most benchmarks are limited to English, which makes it difficult to replicate success in other languages. |
| Approach: | They propose to use Chinese biomedical language understanding evaluation benchmarks to evaluate Chinese models. |
| Outcome: | The proposed benchmarks show that the current models perform worse than the human ceiling. |
Copied to clipboard
| Challenge: | Existing methods for generating and curating high-quality instruction-tuning data rely heavily on the quality of seed data or strong assumptions about the structure and content of web documents. |
| Approach: | They propose a fully automated framework for synthesizing high-quality instruction-tuning (IT) data directly from raw web documents with minimal assumptions. |
| Outcome: | The proposed framework outperforms state-of-the-art baselines by 16.65% across four instruction-following benchmarks. |
Copied to clipboard
| Challenge: | Large foundation models have become huge, but they consume computational resources in pretraining. |
| Approach: | They propose to replace full-size layers with compute-efficient auto-encoders that enforce low-rank activations throughout training. |
| Outcome: | The proposed method reduces the computing cost by 2pmbtimes and improves training throughput by 1.86pmtime. |
Copied to clipboard
| Challenge: | Large language models pre-trained on massive corpora have shown impressive few-shot learning ability on many NLP tasks. |
| Approach: | They propose to recast structured output in the form of code instead of natural language and use generative LLMs of code to perform IE tasks. |
| Outcome: | The proposed method outperforms fine-tuning moderate-size pre-trained models and prompting NL-LLMs under few-shot settings. |
Copied to clipboard
| Challenge: | Existing routing attacks depend on white-box access or heuristic prompts, rendering them ineffective in real-world black-box scenarios. |
| Approach: | They propose a cost-aware routing strategy that routes queries to the least-cost model . they propose heuristic prompts that are ineffective in real-world black-box scenarios . |
| Outcome: | The proposed approach significantly increases the routing rate to expensive models on queries of different distributions. |
Copied to clipboard
| Challenge: | Existing approaches to building dynamic reasoning trees rely on manual decomposition patterns and subproblems. |
| Approach: | They propose a hierarchical reasoning framework based on MFR theory that supports adaptive reasoning trees and reliable error correction within a single LLM. |
| Outcome: | The proposed framework significantly reduces logical errors and improves reasoning accuracy compared to the Chain-of-Thought, Decompose–Analyze–Rethink and Tree-of–Though. |