Papers by Xuhong Li
Tokenization Falling Short: On Subword Robustness in Large Language Models (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Language models typically tokenize raw text into sequences of subword identifiers from a predefined vocabulary. |
| Approach: | They propose to tokenize raw text into sequences of subword identifiers from a predefined vocabulary . they also investigate the challenges and their impact on large language models . |
| Outcome: | The proposed model can mitigate tokenization issues, but still suffer from typos and other variations. |
HumanEval-XL: A Multilingual Code Generation Benchmark for Cross-lingual Natural Language Generalization (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing benchmarks focus on translating English prompts to multilingual codes or have been constrained to very limited natural languages (NLs). |
| Approach: | They propose a benchmark to evaluate multilingual LLMs using multiple natural languages. |
| Outcome: | The proposed benchmarks focus on translating English prompts to multilingual code or have been constrained to very limited natural languages (NLs). |
Knowledge Triplets Derivation from Scientific Publications via Dual-Graph Resonance (2024.lrec-main)
Copied to clipboard
| Challenge: | Existing relation extraction methods aim to extract explicit triplet knowledge from documents, but they can hardly perceive unobserved factual relations. |
| Approach: | They propose a novel Extraction-Contextualization-Derivation strategy to generate a document-specific dynamic graph from a shared static knowledge graph. |
| Outcome: | The proposed method can generate richer explicit and implicit relations under the guidance of static and dynamic knowledge topologies. |