Papers by Juan Liu
Neuron-Level Differentiation of Memorization and Generalization in Large Language Models (2025.emnlp-main)
Copied to clipboard
Ko-Wei Huang, Yi-Fu Fu, Ching-Yu Tsai, Yu-Chieh Tu, Tzu-ling Cheng, Cheng-Yu Lin, Yi-Ting Yang, Heng-Yi Liu, Keng-Te Liao, Da-Cheng Juan, Shou-De Lin
| Challenge: | Existing models exhibit memorization and generalization behaviors in ways that are not easily interpretable or controllable. |
| Approach: | They propose to use a GPT-2 and LLaMA-3.2 model to identify distinct neuron subsets responsible for each behavior to steer the model toward memorization or generalization. |
| Outcome: | The proposed models show that inference-time interventions on these neurons can steer the model’s behavior toward memorization or generalization. |
RTQA : Recursive Thinking for Complex Temporal Knowledge Graph Question Answering with Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current temporal knowledge graph question answering methods focus on implicit temporal constraints and lack the capability to handle complex temporal queries. |
| Approach: | They propose a temporal knowledge graph question answering framework that recursively decomposes questions into sub-problems and employs multi-path answer aggregation to improve fault tolerance. |
| Outcome: | The proposed framework outperforms existing methods on multiTQ and TimelineKGQA benchmarks. |
Rethinking Personality Assessment from Human-Agent Dialogues: Fewer Rounds May Be Better Than More (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing personality assessment datasets based on natural language do not consider interactivity. |
| Approach: | They propose to use a Chinese dataset to study the effects of different interaction rounds and agent personalities on personality assessment. |
| Outcome: | The proposed dataset contains 1260 interaction rounds between humans and agents with different personalities. |
False Friends in the Shell: Unveiling the Emoticon Semantic Confusion in Large Language Models (2026.acl-long)
Copied to clipboard
| Challenge: | Emoticons are widely used in digital communication to convey affective intent, yet their safety implications for Large Language Models (LLMs) remain largely unexplored. |
| Approach: | They propose to use ASCII-based emoticons to perform unintended actions in large language models (LLMs) This vulnerability is pervasive, with an average confusion ratio exceeding 38%, and 90% of confused responses yield 'silent failures' authors call on the community to recognize this emerging vulnerability and develop effective mitigation methods to uphold the safety and reliability of human-LLM interactions. |
| Outcome: | The proposed framework exploits emoticon semantic confusion in six LLMs and demonstrates that existing prompt-based mitigations are ineffective. |
LLM-empowered Dynamic Prompt Routing for Vision-Language Models Tuning under Long-Tailed Distributions (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Pre-trained vision-language models (VLMs) often suffer from bias in class-imbalanced scenes. |
| Approach: | They propose a multi-dimensional dynamic prompt routing framework that integrates a knowledge base for classes spanning multiple visual-semantic dimensions. |
| Outcome: | The proposed framework achieves comparable results with current SOTA methods on long-tailed benchmarks, including CIFAR-LT, ImageNet-LT and Places-LT. |
Geo-BERT Pre-training Model for Query Rewriting in POI Search (2021.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods to solve the word mismatch between queries and documents are often inadequate to integrate geographic information into the pre-training model. |
| Approach: | They propose to train a pre-training model to integrate semantics and geographic information in the pre-trained representations of POIs. |
| Outcome: | The proposed model achieves excellent accuracy on a wide range of real-world datasets of map services. |
Forewarned is Forearmed: Pre-Synthesizing Jailbreak-like Instructions to Enhance LLM Safety Guardrail to Potential Attacks (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Despite advances in improving large language model (LLM) to refuse to answer malicious instructions, LLMs remain vulnerable to jailbreak attacks where attackers generate instructions with distributions differing from safety alignment corpora. |
| Approach: | They propose a framework that leverages embedding space distribution analysis to generate jailbreak-like instructions. |
| Outcome: | The proposed framework shows significant decreases in attack success rate on Qwen2.5, Llama3.1, and Llma3.2 without compromising their utility. |
Predicting Machine Translation Performance on Low-Resource Languages: The Role of Domain Similarity (2024.findings-eacl)
Copied to clipboard
Eric Khiu, Hasti Toossi, Jinyu Liu, Jiaxu Li, David Anugraha, Juan Flores, Leandro Roman, A. Seza Doğruöz, En-Shiun Lee
| Challenge: | Existing approaches for predicting the performance of NLP models for low-resource languages (LRLs) focus on high-resourced languages, overlooking LRLs and domain shifts. |
| Approach: | They investigate the impact of domain similarity on predicting performance of machine translation models in low-resource languages. |
| Outcome: | The results show that domain similarity has the most important impact on predicting the performance of Machine Translation models. |
EmoAgent: Assessing and Safeguarding Human-AI Interaction for Mental Health Safety (2025.emnlp-main)
Copied to clipboard
Jiahao Qiu, Yinghui He, Xinzhe Juan, Yimin Wang, Yuhan Liu, Zixin Yao, Yue Wu, Xun Jiang, Ling Yang, Mengdi Wang
| Challenge: | EmoAgent evaluates and mitigates mental health hazards in human-AI interactions, especially for vulnerable human users with psychological disorders. |
| Approach: | EmoAgent is a multi-agent AI framework designed to evaluate and mitigate mental health hazards in human-AI interactions. |
| Outcome: | EmoAgent evaluates and mitigates mental health hazards in human-AI interactions. |
ODL-TempLLM: Ontology-Guided and Description Logic-Reasoned Temporal Reasoning with LLMs (2026.acl-long)
Copied to clipboard
| Challenge: | Temporal reasoning is crucial for large language models to understand event concurrency and complex temporal interactions in natural language. |
| Approach: | They propose an ontology-guided and description logic–constrained temporal reasoning paradigm that shifts focus from internal inference to the explicit modeling of temporal structure. |
| Outcome: | The proposed method outperforms state-of-the-art methods by 2.07–31.83 F1 points and 1.00–30.73 EM points, exhibiting strong generalization and highlighting the potential of explicit temporal reasoning. |
Knowledge Graph Pooling and Unpooling for Concept Abstraction (2025.coling-main)
Copied to clipboard
| Challenge: | Knowledge graph embedding (KGE) aims to embed entities and relations as vectors in a continuous space. |
| Approach: | They propose a framework with KG Pooling and unpooling and Contrastive Learning to abstract and encode latent concepts for better KG prediction. |
| Outcome: | The proposed framework outperforms baselines on link prediction task. |
UniMorph 4.0: Universal Morphology (2022.lrec-1)
Copied to clipboard
Khuyagbaatar Batsuren, Omer Goldman, Salam Khalifa, Nizar Habash, Witold Kieraś, Gábor Bella, Brian Leonard, Garrett Nicolai, Kyle Gorman, Yustinus Ghanggo Ate, Maria Ryskina, Sabrina Mielke, Elena Budianskaya, Charbel El-Khaissi, Tiago Pimentel, Michael Gasser, William Abbott Lane, Mohit Raj, Matt Coler, Jaime Rafael Montoya Samame, Delio Siticonatzi Camaiteri, Esaú Zumaeta Rojas, Didier López Francis, Arturo Oncevay, Juan López Bautista, Gema Celeste Silva Villegas, Lucas Torroba Hennigen, Adam Ek, David Guriel, Peter Dirix, Jean-Philippe Bernardy, Andrey Scherbakov, Aziyana Bayyr-ool, Antonios Anastasopoulos, Roberto Zariquiey, Karina Sheifer, Sofya Ganieva, Hilaria Cruz, Ritván Karahóǧa, Stella Markantonatou, George Pavlidis, Matvey Plugaryov, Elena Klyachko, Ali Salehi, Candy Angulo, Jatayu Baxi, Andrew Krizhanovsky, Natalia Krizhanovskaya, Elizabeth Salesky, Clara Vania, Sardana Ivanova, Jennifer White, Rowan Hall Maudslay, Josef Valvoda, Ran Zmigrod, Paula Czarnowska, Irene Nikkarinen, Aelita Salchak, Brijesh Bhatt, Christopher Straughn, Zoey Liu, Jonathan North Washington, Yuval Pinter, Duygu Ataman, Marcin Wolinski, Totok Suhardijanto, Anna Yablonskaya, Niklas Stoehr, Hossep Dolatian, Zahroh Nuriah, Shyam Ratan, Francis M. Tyers, Edoardo M. Ponti, Grant Aiton, Aryaman Arora, Richard J. Hatcher, Ritesh Kumar, Jeremiah Young, Daria Rodionova, Anastasia Yemelina, Taras Andrushko, Igor Marchenko, Polina Mashkovtseva, Alexandra Serova, Emily Prud’hommeaux, Maria Nepomniashchaya, Fausto Giunchiglia, Eleanor Chodroff, Mans Hulden, Miikka Silfverberg, Arya D. McCarthy, David Yarowsky, Ryan Cotterell, Reut Tsarfaty, Ekaterina Vylomova
| Challenge: | The Universal Morphology project provides broad-coverage instantiated morphological inflection tables for hundreds of diverse languages. |
| Approach: | They propose a language-independent feature schema for rich morphological annotation and a type-level resource of annotated data in diverse languages realizing that schema. |
| Outcome: | The proposed schema has added 66 new languages, including 24 endangered languages. |
StoryTrans: Non-Parallel Story Author-Style Transfer with Discourse Representations and Content Enhancing (2023.acl-long)
Copied to clipboard
| Challenge: | Existing studies on text style transfer neglect long style transfer at the discourse level. |
| Approach: | They propose a model that transfers text style into target styles with learnable style embeddings . they use a mask-and-fill framework to explicitly fuse style-specific keywords into generation . |
| Outcome: | The proposed model outperforms baselines in style transfer and content preservation. |
The Invisible Hand: Unveiling Provider Bias in Large Language Models for Code Generation (2025.acl-long)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) have emerged as the new recommendation engines, surpassing traditional methods in both capability and scope, particularly in code generation. |
| Approach: | They propose to use a dataset to investigate a new type of bias in Large Language Models for code generation, provider bias, to determine whether the model favors specific providers. |
| Outcome: | The proposed model favors services from Google and Amazon, but without explicit directives, and can modify input code to incorporate their preferred providers without user requests. |