| Challenge: | Existing studies do not consider inter-personal variations due to the lack of user annotated training data. |
| Approach: | They propose to use user preferences to identify ambiguous texts in multilingual applications without user annotated training data to build a preference-aware LID model. |
| Outcome: | The proposed model significantly outperforms existing LID systems on handling ambiguous texts. |
Similar Papers
An Open Dataset and Model for Language Identification (2023.acl-short)
Copied to clipboard
| Challenge: | Existing LID systems perform poorly on low-resource languages, causing 'representation washing', where the community is given a false view of the actual progress of low-source NLP. |
| Approach: | They propose a model which achieves a macro-average F1 score of 0.93 and a false positive rate of 0.033% across 201 languages, outperforming previous work. |
| Outcome: | The proposed model outperforms existing models and datasets on 201 languages and a false positive rate of 0.033%. |
Preference Consistency Matters: Enhancing Preference Learning in Language Models with Automated Self-Curation of Training Corpora (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to address inconsistencies in preference learning datasets rely on heuristics to achieve alignment. |
| Approach: | They propose a method that preprocesses annotated datasets by leveraging proxy models trained directly on them to detect and select consistent annotations. |
| Outcome: | The proposed method shows performance improvements of up to 33% across learning algorithms and proxy capabilities. |
RLHF Can Speak Many Languages: Unlocking Multilingual Preference Optimization for LLMs (2024.emnlp-main)
Copied to clipboard
| Challenge: | Preference optimization is a widely adopted post-training technique to align large language models with human preferences. |
| Approach: | They propose a method for generating multilingual feedback data to balance data coverage. |
| Outcome: | The proposed method achieves 54.4% win-rate against current state-of-the-art multilingual LLM in its parameter class and 69.5% win- rate or higher against widely used models like Gemma, Mistral and Llama 3. |
A Simple Approach to Learning Unsupervised Multilingual Embeddings (2020.emnlp-main)
Copied to clipboard
| Challenge: | Recent work on unsupervised cross-lingual embeddings in the bilingual setting has given the impetus to learning a shared embeddable space for several languages. |
| Approach: | They propose to solve two sub-problems together to learn a shared embedding space for several languages. |
| Outcome: | The proposed approach outperforms existing methods in bilingual lexicon induction, cross-lingual word similarity, multilingual document classification, and multilingual dependency parsing tasks. |
Learning Preference Model for LLMs via Automatic Preference Data Generation (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing training methods for large language models rely on human-annotated data. |
| Approach: | They propose to learn the preference model for LLMs via automatic preference data generation (AutoPM) using HHH-guided preference data, they show reliability and potential . |
| Outcome: | The proposed approach enables LLMs to learn human preferences and align with human values. |
We’re Afraid Language Models Aren’t Modeling Ambiguity (2023.emnlp-main)
Copied to clipboard
Alisa Liu, Zhaofeng Wu, Julian Michael, Alane Suhr, Peter West, Alexander Koller, Swabha Swayamdipta, Noah Smith, Yejin Choi
| Challenge: | Ambiguity is an intrinsic feature of natural language, allowing us to anticipate misunderstandings and revise our interpretations as listeners. |
| Approach: | They use AmbiEnt to capture ambiguity in a sentence and analyze it to evaluate pretrained LMs. |
| Outcome: | The proposed model can flag political claims in the wild that are misleading due to ambiguity. |
A Call for More Rigor in Unsupervised Cross-lingual Learning (2020.acl-main)
Copied to clipboard
| Challenge: | Existing research on unsupervised cross-lingual learning has focused on purely unsupervised learning without any parallel data for most of the world's languages. |
| Approach: | They propose to define "multilingual learning" as learning a common model for two or more languages from raw text, without any downstream task labels. |
| Outcome: | The proposed model is based on a model with no parallel data and abundant monolingual data. |
A Comparative Analysis of Unsupervised Language Adaptation Methods (D19-61)
Copied to clipboard
| Challenge: | Recent proposed approaches to perform unsupervised language adaptation lack annotated resources in less-resourced languages. |
| Approach: | They propose to use Adversarial Training, Sentence Encoder Alignment and Shared-Private Architecture to perform unsupervised language adaptation without using aligned sentences. |
| Outcome: | The proposed approaches are more suitable when the source and target language datasets contain other variations in content besides the language shift. |
Asymmetric Mutual Learning for Multi-source Unsupervised Sentiment Adaptation with Dynamic Feature Network (2022.coling-1)
Copied to clipboard
| Challenge: | Recent work on pre-trained language models (PrLMs) on labeled sentiment datasets has shown significant improvements on widerange of NLP tasks, including sentiment classification. |
| Approach: | They propose a multi-source unsupervised sentiment adaptation problem with pre-trained features to exploit the extracted pre-train features for efficient domain adaptation. |
| Outcome: | The proposed model outperforms the state-of-the-art methods on multiple sentiment benchmarks and extensive ablation studies to verify the effectiveness of each module. |
Disentangling Preference Representation and Text Generation for Efficient Individual Preference Alignment (2025.coling-main)
Copied to clipboard
| Challenge: | Human values are inherently diverse, making it insufficient to align LLMs solely with general preferences. |
| Approach: | They propose a flexible paradigm for individual preference alignment that disentangles preference representation from text generation in LLMs. |
| Outcome: | The proposed method produces aligned quality and better than PEFT-based methods while reducing training time for each new individual preference by 80% to 90%. |