Papers by Hao Tang
Voice Builder: A Tool for Building Text-To-Speech Voices (L18-1)
Copied to clipboard
| Challenge: | a text-to-speech voice building tool is available for low-resourced languages . the tool allows researchers to run voice training experiments and listen to the resulting voice . |
| Approach: | They propose an opensource text-to-speech (TTS) voice building tool that focuses on simplicity, flexibility, and collaboration. |
| Outcome: | The proposed tool can help improve TTS research especially for low-resourced languages . it can be used to run voice training experiments and listen to the resulting synthesized voice . |
Enhancing Self-Attention with Knowledge-Assisted Attention Maps (2022.naacl-main)
Copied to clipboard
Jiangang Bai, Yujing Wang, Hong Sun, Ruonan Wu, Tianmeng Yang, Pengfei Tang, Defu Cao, Mingliang Zhang1, Yunhai Tong, Yaming Yang, Jing Bai, Ruofei Zhang, Hao Sun, Wei Shen
| Challenge: | Existing works of knowledge infusion depend on multi-task learning frameworks, which are inefficient and require large-scale retraining when new knowledge is considered. |
| Approach: | They propose a method which integrates knowledge-generated attention maps into the self-attention mechanism and integrates it into the model. |
| Outcome: | The proposed model outperforms existing methods on academic datasets and industry-scale ad relevance applications. |
An Effective Span-based Multimodal Named Entity Recognition with Consistent Cross-Modal Alignment (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing approaches to name entity recognition rely on word-based sequence labeling and align image and text at inconsistent semantic levels. |
| Approach: | They propose a span-based method which achieves a more consistent multimodal alignment from the perspectives of information-theoretic and cross-modal interaction. |
| Outcome: | Experiments on two datasets show that SMNER outperforms the state-of-the-art methods. |
OpenWebAgent: An Open Toolkit to Enable Web Agents on Large Language Models (2024.acl-demos)
Copied to clipboard
Iat Long Iong, Xiao Liu, Yuxuan Chen, Hanyu Lai, Shuntian Yao, Pengbo Shen, Hao Yu, Yuxiao Dong, Jie Tang
| Challenge: | OpenWebAgent integrates large language models and large multimodal models to improve web automation. |
| Approach: | They propose to integrate large language models and large multimodal models into an open toolkit to optimize web automation. |
| Outcome: | The open toolkit integrates both large language models (LLMs) and large multimodal models (LMMs) it enables the development of powerful, task-oriented web agents, significantly enhancing user experience and operational efficiency on the web. |
LoopCoder: Scaling Code Intelligence via Looped Language Models (2026.findings-acl)
Copied to clipboard
Jian Yang, Wei Zhang, Shuyue Guo, Yizhi LI, Linzheng Chai, Zhengmao Ye, Shukai Liu, Yuyang Song, Jiajun Wu, Che Liu, Tianyu Zheng, Siwei Wu, Leo L, Xudong Ma, Chuan Hao, Ran Tao, Yan Xing, Jianzhou Wang, Mingjie Tang, Aishan Liu, Zhoujun Li, Xianglong Liu, Weifeng Lv, Bryan Dai
| Challenge: | Large language models have mastered syntax-level code generation, but complex algorithmic reasoning remains a challenge. |
| Approach: | They propose a recurrent inductive bias that aligns with the recursive nature of programming logic. |
| Outcome: | The proposed model achieves comparable performance to standard dense models with more parameters. |
Align2LLaVA: Cascaded Human and Large Language Model Preference Alignment for Multi-modal Instruction Curation (2025.findings-acl)
Copied to clipboard
Hongzhe Huang, Jiang Liu, Zhewen Yu, Li Cai, Dian Jiao, Wenqiao Zhang, Siliang Tang, Juncheng Li, Hao Jiang, Haoyuan Li, Yueting Zhuang
| Challenge: | Recent advances in Multi-modal Large Language Models (MLLMs) introduce significant variability in data quality. |
| Approach: | They propose to use human and LLM preference alignment to compress large corpus of machine-generated multimodal instructions into a compact and high-quality form. |
| Outcome: | The proposed algorithm outperforms LLaVA-series models in MLLM benchmarks by 90% . it uses human and LLM preference alignment to compress a large dataset . |
TeamLoRA: Boosting Low-Rank Adaptation with Expert Collaboration and Competition (2025.acl-long)
Copied to clipboard
Tianwei Lin, Jiang Liu, Wenqiao Zhang, Yang Dai, Haoyuan Li, Zhelun Yu, Wanggui He, Juncheng Li, Jiannan Guo, Hao Jiang, Siliang Tang, Yueting Zhuang
| Challenge: | Existing methods for fine-tuning are resource-efficient, but performance often falls short . a new approach, TeamLoRA, integrates collaborative and competitive modules to improve performance. |
| Approach: | They propose to introduce task-specific LoRA as domain experts to improve learning efficiency . teamLoRA integrates collaborative and competition modules to improve model learning . |
| Outcome: | Experiments show that TeamLoRA improves performance in multi-task learning . teamLorea integrates collaborative and competitive modules to improve performance . |
Blockwise Self-Attention for Long Document Understanding (2020.findings-emnlp)
Copied to clipboard
| Challenge: | Recent advances in pre-training and fine-tuning methods have drastically reshaped the landscape of natural language processing research. |
| Approach: | They propose a lightweight BERT model that introduces sparse block structures into the attention matrix to reduce memory consumption and training/inference time. |
| Outcome: | The proposed model uses 18.7-36.1% less memory and 12.0-25.1% more time to learn compared to an advanced BERT-based model, RoBERTa. |
MTVQA: Benchmarking Multilingual Text-Centric Visual Question Answering (2025.findings-acl)
Copied to clipboard
Jingqun Tang, Qi Liu, Yongjie Ye, Jinghui Lu, Shu Wei, An-Lan Wang, Chunhui Lin, Hao Feng, Zhen Zhao, Yanjie Wang, Yuliang Liu, Hao Liu, Xiang Bai, Can Huang
| Challenge: | Text-Centric Visual Question Answering (TEC-VQA) is a text-centric visual task understanding tool. |
| Approach: | They introduce a benchmark that features human expert annotations across 9 languages . they prioritize the text in question-answer pairs while disregarding visual text in images . |
| Outcome: | The proposed benchmarks prioritize the text in question-answer pairs while disregarding visual text in images. |
RMTBench: Benchmarking LLMs Through Multi-Turn User-Centric Role-Playing (2025.findings-emnlp)
Copied to clipboard
Hao Xiang, Tianyi Tang, Yang Su, Bowen Yu, An Yang, Fei Huang, Yichang Zhang, Yaojie Lu, Hongyu Lin, Xianpei Han, Jingren Zhou, Junyang Lin, Le Sun
| Challenge: | Existing benchmarks focus on character-centric approach and fail to reflect real-world applications. |
| Approach: | RMTBench is a user-centric bilingual role-playing benchmark featuring 80 diverse characters and over 8,000 dialogue rounds. |
| Outcome: | RMTBench features 80 diverse characters and over 8,000 dialogue rounds. |
LongBench v2: Towards Deeper Understanding and Reasoning on Realistic Long-context Multitasks (2025.acl-long)
Copied to clipboard
Yushi Bai, Shangqing Tu, Jiajie Zhang, Hao Peng, Xiaozhi Wang, Xin Lv, Shulin Cao, Jiazheng Xu, Lei Hou, Yuxiao Dong, Jie Tang, Juanzi Li
| Challenge: | Existing benchmarks on longcontext large language models fail to reflect their deep understanding capabilities across diverse tasks. |
| Approach: | They propose a benchmark to assess the ability of long-context large language models to handle long-text problems. |
| Outcome: | The proposed model achieves 50.1% accuracy when directly answering the questions . human experts achieve only 53.7% accuracy under a 15-minute time constraint . |
CoIR: A Comprehensive Benchmark for Code Information Retrieval Models (2025.acl-long)
Copied to clipboard
| Challenge: | Existing methods and benchmarks for information retrieval are inadequately representing the diversity of code in various domains and tasks. |
| Approach: | They propose a benchmark specifically designed to assess code retrieval capabilities. |
| Outcome: | The proposed benchmark aims to invigorate research in the code retrieval domain . it shares the same data schema as other popular benchmarks like MTEB and BEIR . |
From Redundancy to Relevance: Information Flow in LVLMs Across Reasoning Tasks (2025.naacl-long)
Copied to clipboard
Xiaofeng Zhang, Yihao Quan, Chen Shen, Xiaosong Yuan, Shaotian Yan, Liang Xie, Wenxiao Wang, Chaochen Gu, Hao Tang, Jieping Ye
| Challenge: | Large visionlanguage models (LVLMs) are a powerful visual-language reasoning tool. |
| Approach: | They propose to integrate attention analysis with LLaVA-CAM to determine interactions between visual representations. |
| Outcome: | The proposed approach can be used to determine interactions between visual representations. |
A Bounding Box is Worth One Token - Interleaving Layout and Text in a Large Language Model for Document Understanding (2025.findings-acl)
Copied to clipboard
Jinghui Lu, Haiyang Yu, Yanjie Wang, Yongjie Ye, Jingqun Tang, Ziwei Yang, Binghong Wu, Qi Liu, Hao Feng, Han Wang, Hao Liu, Can Huang
| Challenge: | Existing methods for integrating spatial layouts with text have limitations . existing methods produce overly long text sequences or lack autoregressive traits of LLMs . |
| Approach: | They introduce Interleaving Layout and Text in a Large Language Model (LayTextLLM) they use OCR-derived text and spatial layouts to integrate with LLMs for document understanding . |
| Outcome: | The proposed model shows an increase in performance in KIE and VQA tasks. |
Fine-Grained Data Ordering Improves Fine-Tuning for Large Language Models (2026.findings-acl)
Copied to clipboard
Xiaomeng Hu, Yixuan Tang, Haoze Li, Hao Chen, Qi Zhang, Zhanming Shen, Yiming Zhang, Haobo Wang, Junbo Zhao
| Challenge: | Prior work focused on data preprocessing, focusing on filtering and cleaning data . a study aimed to improve fine-grained scheduling of data order in epochs . |
| Approach: | They propose a fine-grained scheduling method of data order in epochs to fill this gap . they define data difficulty based on relevance between data and model . |
| Outcome: | The proposed method improves on pre-training and small-scale fine-tuning experiments 2.4% over baselines. |
WildDoc: How Far Are We from Achieving Comprehensive and Robust Document Understanding in the Wild? (2025.emnlp-main)
Copied to clipboard
An-Lan Wang, Jingqun Tang, Lei Liao, Hao Feng, Qi Liu, Xiang Fei, Jinghui Lu, Han Wang, Hao Liu, Yuliang Liu, Xiang Bai, Can Huang
| Challenge: | Existing benchmarks for document understanding in the wild are based on scanned or digital documents . however, these benchmarks fail to capture the challenges posed by documents in the real world . |
| Approach: | They propose a new benchmark that incorporates a diverse set of manually captured document images reflecting real-world conditions. |
| Outcome: | The proposed model is based on a set of manually captured document images reflecting real-world conditions and is compared with digital or scanned documents. |
Mixture of Multimodal Adapters for Sentiment Analysis (2025.naacl-long)
Copied to clipboard
| Challenge: | Pre-trained language models (PLMs) have been used for text sentiment analysis but sentiment is hidden in other modalities. |
| Approach: | They propose to fuse emotions from different data to analyze sentiments . they use compression parameter for each expert to reduce training burden . |
| Outcome: | The proposed method achieves state-of-the-art with a tiny trainable parameter count compared to current methods . emotions hidden in body movements or vocal timbres eclipse traditional methods compared with text sentiment analysis . |
LLMRouterBench: A Massive Benchmark and Unified Framework for LLM Routing (2026.findings-acl)
Copied to clipboard
Hao Li, Yiqun Zhang, Zhaoyan Guo, Chenxu Wang, Shengji Tang, Qiaosheng Zhang, Yang Chen, Biqing Qi, Peng Ye, Lei Bai, Zhen Wang, Shuyue Hu
| Challenge: | Large language model (LLM) routing assigns each query to the best suitable model from an ensemble. |
| Approach: | They introduce a large-scale benchmark and unified framework for LLM routing . they find that many routing methods exhibit similar performance under unified evaluation . |
| Outcome: | The proposed benchmark provides comprehensive metrics for both performance-oriented and performance-cost trade-off routing. |
DoCIA: An Online Document-Level Context Incorporation Agent for Speech Translation (2025.findings-acl)
Copied to clipboard
Xinglin Lyu, Wei Tang, Yuang Li, Xiaofeng Zhao, Ming Zhu, Junhui Li, Yunfei Lu, Min Zhang, Daimeng Wei, Hao Yang, Min Zhang
| Challenge: | Document-level context is crucial for speech translation due to noise from ASR . incorporating document-level contextual information into ST remains a challenge . |
| Approach: | They develop an online framework that integrates document-level context into machine translation . they use document-based modules to integrate document- level context into ST . |
| Outcome: | The proposed framework outperforms baselines in sentence and discourse metrics . it can correct ASR transcription errors and improve translation performance . |
AndroidLab: Training and Systematic Benchmarking of Android Autonomous Agents (2025.acl-long)
Copied to clipboard
Yifan Xu, Xiao Liu, Xueqiao Sun, Siyi Cheng, Hao Yu, Hanyu Lai, Shudan Zhang, Dan Zhang, Jie Tang, Yuxiao Dong
| Challenge: | Existing studies on Android agents lack systematic research on open-source and closed-source models. |
| Approach: | They propose a framework for Android agents that includes an operation environment and a reproducible benchmark. |
| Outcome: | The proposed framework lifts the success rate of open-source LLMs and LMMs from 4.59% to 21.50% for LLM and 1.93% to 13.28% for LMM. |
FinRipple: Aligning Large Language Models with Financial Market for Event Ripple Effect Awareness (2025.findings-acl)
Copied to clipboard
| Challenge: | Financial markets exhibit complex dynamics where localized events trigger ripple effects across entities. |
| Approach: | They propose a framework that empowers large language models to analyze ripple effects . they use financial theory-guided large-scale reinforcement learning to align LLMs with the market . |
| Outcome: | The proposed framework allows LLMs to analyze ripple effects through financial theory-guided large-scale reinforcement learning. |
LPO: Towards Accurate GUI Agent Interaction via Location Preference Optimization (2026.findings-acl)
Copied to clipboard
Jiaqi Tang, Yu Xia, Yi-Feng Wu, Yuwei Hu, Chen Yuhui, Qing-Guo Chen, Xiaogang Xu, Xiangyu Wu, Hao LU, Yanqing Ma, Shiyin Lu, Qifeng Chen
| Challenge: | Existing strategies for spatial localization are limited due to their limited capacity to perceive positional data. |
| Approach: | They propose a location-based approach that leverages locational data to optimize interaction preferences. |
| Outcome: | The proposed approach achieves SOTA results across offline benchmarks and real-world evaluations. |
Towards Human-Like Machine Comprehension: Few-Shot Relational Learning in Visually-Rich Documents (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing document AI approaches fail to consider key-value relations in visually-rich documents . a few-shot approach is proposed to extract key- value relation triplets in VRDs . |
| Approach: | They propose a few-shot relational learning approach targeting the extraction of key-value relation triplets in Visually-Rich Documents. |
| Outcome: | The proposed method outperforms existing methods in visually-rich documents. |
Self-Critique Guided Iterative Reasoning for Multi-hop Question Answering (2025.findings-acl)
Copied to clipboard
Zheng Chu, Huiming Fan, Jingchang Chen, Qianyu Wang, Mingda Yang, Jiafeng Liang, Zhongjie Wang, Hao Li, Guo Tang, Ming Liu, Bing Qin
| Challenge: | Large language models (LLMs) have demonstrated remarkable reasoning capabilities, but they still face challenges in knowledge-intensive multi-hop reasoning. |
| Approach: | They propose a method that uses self-critique feedback to guide iterative reasoning by enabling iteration and self-evaluation of its intermediate reasoning steps. |
| Outcome: | The proposed method surpasses the previous SOTA by 8.6% on three multi-hop reasoning datasets. |
BertNet: Harvesting Knowledge Graphs with Arbitrary Relations from Pretrained Language Models (2023.findings-acl)
Copied to clipboard
| Challenge: | Existing methods to construct knowledge graphs are limited to a small set of relations due to manual cost or restrictions in text corpus. |
| Approach: | They propose to automatically construct knowledge graphs (KGs) of diverse new relations from pretrained language models that accept knowledge queries with prompts. |
| Outcome: | The proposed framework extracts knowledge of over 400 new relations from pretrained language models, including RoBERTaNet, with minimal input of a relation definition and a few shot of example entity pairs. |
Middleware for LLMs: Tools Are Instrumental for Language Agents in Complex Environments (2024.emnlp-main)
Copied to clipboard
| Challenge: | Large language models (LLMs) are generalist agents capable of operating within complex environments. |
| Approach: | They propose a class of tools that can serve as a middleware layer shielding LLMs from environmental complexity. |
| Outcome: | The proposed tool can shield the LLM from environmental complexity in two representative complex environments. |
Adaptive Tool Use in Large Language Models with Meta-Cognition Trigger (2025.acl-long)
Copied to clipboard
Wenjun Li, Dexun Li, Kuicai Dong, Cong Zhang, Hao Zhang, Weiwen Liu, Yasheng Wang, Ruiming Tang, Yong Liu
| Challenge: | Existing research expands the tool arrays of large language models (LLMs), but the necessity of using these tools is often overlooked, leading to indiscriminate tool invocation. |
| Approach: | They propose a meta-cognition proxy proxy for LLMs self-assessment of their capabilities, reflecting the model’s awareness of its own limitations. |
| Outcome: | The proposed strategy is fine-tuned-free and costs minimal. |
MCLE-Mol: Empowering LLM with Molecular Comprehension and Low-Cost Continual Evolution for Interpretable Property Prediction (2026.findings-acl)
Copied to clipboard
Zhili Pu, Lantian Zhang, Hao Duan, Zhixing Zhang, Keyun Zhu, Yongqi Fan, Ruihui Hou, Tong Ruan, Yun Tang
| Challenge: | Large language models (LLMs) offer a new paradigm for molecular property prediction (MPP), yet a semantic gap between natural language and molecul representations limits their ability to capture structure–activity relationships (SAR). |
| Approach: | They propose an ML–LLM–Rule collaborative framework for MPP that injects ML-derived substructure attribution values into LLMs and calibrates them under specific chemical contexts. |
| Outcome: | The proposed framework outperforms baseline models on multiple benchmark datasets and is highly interpretable. |
Hierarchical Sketch Induction for Paraphrase Generation (2022.acl-long)
Copied to clipboard
| Challenge: | Existing models of paraphrase generation are based on a syntactic sketch, but prior work has included inductive bias. |
| Approach: | They propose a method for learning decompositions of dense encodings as a sequence of discrete latent variables that make iterative refinements of increasing granularity. |
| Outcome: | The proposed model improves on human paraphrase generation by predicting syntactic sketches at test time. |
STGN: an Implicit Regularization Method for Learning with Noisy Labels in Natural Language Processing (2022.emnlp-main)
Copied to clipboard
| Challenge: | Existing work to mitigate the effect of noisy labels is limited to specific tasks or training procedures, making it hard to be widely used. |
| Approach: | They propose a stochastic tailor-made gradient noise to mitigate the effect of noisy labels by introducing benign noise into stochistic gradient descent. |
| Outcome: | The proposed method can be used to discriminate correct samples from incorrect ones and boost existing training methods. |
Advancing Sequential Numerical Prediction in Autoregressive Models (2025.acl-short)
Copied to clipboard
| Challenge: | Autoregressive models are the de facto choice for sequence generation tasks, but standard approaches treat digits as independent tokens and apply cross-entropy loss, overlooking the coherent structure of numerical sequences. |
| Approach: | They propose a novel approach to entropy loss by extending the Earth Mover’s Distance to preserve ordinal relationships between numerical values and sequence-level to penalize the overall discrepancy between predicted and actual sequences. |
| Outcome: | Extensive experiments show that NTIL improves numerical prediction and integrates effectively with LLMs/MLLMs. |
AMR Parsing with Latent Structural Information (2020.acl-main)
Copied to clipboard
| Challenge: | Abstract Meaning Representations (AMRs) capture sentence-level semantics structural representations to broad-coverage natural sentences. |
| Approach: | They investigate parsing AMR with explicit dependency structures and interpretable latent structures. |
| Outcome: | The proposed model achieves best results on both AMR 2.0 and AMR 1.0 . the proposed model has been adopted in downstream NLP tasks, including text summarization and question answering. |
NoisywikiHow: A Benchmark for Learning with Real-world Noisy Labels in Natural Language Processing (2023.findings-acl)
Copied to clipboard
| Challenge: | Large-scale datasets in the real world often contain label noise, which can cause model overfitting and degrade generalization. |
| Approach: | They propose to use label noise to imitate human errors in annotations . they use a noisy label noise benchmark to evaluate their methods . |
| Outcome: | The proposed benchmarks are different from data with heterogeneous label noises in the real world. |
Content Fuzzing for Escaping Information Cocoons on Digital Social Media (2026.findings-acl)
Copied to clipboard
| Challenge: | Information cocoons restrict users’ exposure to posts with diverse viewpoints . social media platforms restrict the range of viewpoints that users encounter . |
| Approach: | They propose a confidence-guided fuzzing framework that rewrites posts while preserving their human-interpreted intent and induces different machine-inferred stance labels. |
| Outcome: | The proposed framework rewrites posts while preserving human-interpreted intent and induces different machine-inferred stance labels while maintaining semantic integrity with respect to the original content. |
Relating Simple Sentence Representations in Deep Neural Networks and the Brain (P19-1)
Copied to clipboard
| Challenge: | Existing deep learning models for natural language processing are not fully studied. |
| Approach: | They investigate whether deep recurrent models learn sentences against those encoded by the brain and whether there is any correspondence between hidden layers of these models and brain regions when processing sentences. |
| Outcome: | The proposed models can be used to synthesize brain data and improve subsequent stimuli decoding accuracy. |
Large Language Models Might Not Care What You Are Saying: Prompt Format Beats Descriptions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | In-context learning has improved performance of large language models, but descriptive instructions are still under-explored. |
| Approach: | They propose an ensemble prompt framework to describe selection criteria of multiple in-context examples. preliminary experiments on machine translation confirm that this framework boosts ICL performance. |
| Outcome: | The proposed framework improves on commonsense, math, logical reasoning and hallucination tasks with three LLMs. |
Attributable and Scalable Opinion Summarization (2023.acl-long)
Copied to clipboard
| Challenge: | Existing methods for opinion summarization encode sentences from customer reviews into a hierarchical discrete latent space. |
| Approach: | They propose a method that encodes customer reviews into a hierarchical discrete latent space and then identifies common opinions based on their frequency. |
| Outcome: | The proposed method generates summaries that are more informative than previous work and more grounded in the input reviews. |
NavA3: Understanding Any Instruction, Navigating Anywhere, Finding Anything (2026.acl-long)
Copied to clipboard
Lingfeng Zhang, Xiaoshuai Hao, Yingbo Tang, Haoxiang Fu, Xinyu Zheng, Pengwei Wang, Zhongyuan Wang, Wenbo Ding, Shanghang Zhang
| Challenge: | Existing embodied navigation methods struggle with such tasks due to their limitations in comprehending high-level human instructions and localizing objects with an open vocabulary. |
| Approach: | They propose a hierarchical framework for long-horizon navigation that integrates human instructions with 3D scene views. |
| Outcome: | The proposed model achieves SOTA results and can complete long-horizon navigation tasks across different robot embodiments in real-world environments. |
Dolphin: Document Image Parsing via Heterogeneous Anchor Prompting (2025.findings-acl)
Copied to clipboard
Hao Feng, Shu Wei, Xiang Fei, Wei Shi, Yingdong Han, Lei Liao, Jinghui Lu, Binghong Wu, Qi Liu, Chunhui Lin, Jingqun Tang, Hao Liu, Can Huang
| Challenge: | Current document image parsing solutions rely on specialized models or generate content autoregressively. |
| Approach: | They propose a multimodal document image parsing model that integrates specialized models with autogeneous content generation. |
| Outcome: | The proposed model achieves state-of-the-art performance across diverse page-level and element-level settings while ensuring superior efficiency. |
Dependency Graph Enhanced Dual-transformer Structure for Aspect-based Sentiment Classification (2020.acl-main)
Copied to clipboard
| Challenge: | Aspect-based sentiment classification is a popular task aimed at identifying the corresponding emotion of a given aspect. |
| Approach: | They propose a dependency graph enhanced dual-transformer network to support mutual reinforcement between the flat representation learning and graph-based representation learning. |
| Outcome: | The proposed model outperforms state-of-the-art methods on five datasets with a large margin. |
CYCLE-INSTRUCT: Fully Seed-Free Instruction Tuning via Dual Self-Training and Cycle Consistency (2025.emnlp-main)
Copied to clipboard
Zhanming Shen, Hao Chen, Yulei Tang, Shaolin Zhu, Wentao Ye, Xiaomeng Hu, Haobo Wang, Gang Chen, Junbo Zhao
| Challenge: | Existing methods for instruction tuning rely on expensive human-annotated seed data or powerful external teacher models. |
| Approach: | They propose a framework that achieves fully seed-free instruction tuning by employing a dual self-training loop where two models are bootstrapped solely from raw, unlabeled text. |
| Outcome: | The proposed framework outperforms seed-driven back-translation baselines and achieves comparable performance to strongly supervised methods. |