Papers by TaiMing Lu
Learn and Unlearn: Addressing Misinformation in Multilingual LLMs (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods to unlearning large language models (LLMs) focus on English data, but they ignore multilingual contexts and can produce misleading, offensive, or otherwise fake content. |
| Approach: | They investigate the propagation of information in multilingual large language models and evaluate unlearning methods to address harmful content in multi-lingual contexts. |
| Outcome: | The proposed methods can effectively eliminate harmful content for all languages by addressing both English and the original language of the harmful data. |
Insights into LLM Long-Context Failures: When Transformers Know but Don’t Tell (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) exhibit positional bias, struggling to utilize information from the middle or end of long contexts. |
| Approach: | They propose to examine LLMs' long-context generalizations by probing their hidden representations. |
| Outcome: | The proposed models excel at processing extended contexts while preserving their positional bias. |