Papers by Yunan Lu
Mixture of Soft Prompts for Controllable Data Generation (2023.findings-emnlp)
Copied to clipboard
| Challenge: | Large language models (LLMs) generate fluent text when the target output follows natural language patterns. |
| Approach: | They propose a method that uses large language models to generate fluent text from a limited ontology rather than direct prediction by using soft prompts. |
| Outcome: | The proposed method produces diverse and natural text while preserving label semantics. |
SAGE : A Top-Down Bottom-Up Knowledge-Grounded User Simulator for Multi-turn Agent Evaluation (2026.findings-eacl)
Copied to clipboard
| Challenge: | Existing evaluation methods rely on static benchmarks or narrow task-specific datasets that fail to capture the open-ended nature of real-world interactions. |
| Approach: | They propose a user Simulation framework for multi-turn AGent Evaluation that integrates top-down knowledge from business contexts and bottom-up knowledge from agent infrastructure. |
| Outcome: | The proposed framework produces interactions that are more realistic and diverse while identifying up to 33% more agent errors. |
LocalRQA: From Generating Data to Locally Training, Testing, and Deploying Retrieval-Augmented QA Systems (2024.acl-demos)
Copied to clipboard
| Challenge: | Existing tools for augmented question-answering do not support researchers and developers to customize the training, testing, and deployment process. |
| Approach: | They propose an open-source toolkit that features a wide selection of model training algorithms, evaluation methods, and deployment tools curated from the latest research. |
| Outcome: | The proposed framework trains and deploys 7B-models with the same performance as OpenAI’s text-ada-002 and GPT-4-turbo. |