Papers by Chu-Cheng Lin
Limitations of Autoregressive Models and Their Alternatives (2021.naacl-main)
Copied to clipboard
| Challenge: | Standard autoregressive language models only perform polynomial-time computation to compute probability of next symbol. |
| Approach: | authors propose alternative to standard autoregressive language models that use polynomial-time computation to compute probability of next symbol. |
| Outcome: | a large model size can grow superpolynomially in length, allowing it to store precomputed results and verify solutions. |
Neural Particle Smoothing for Sampling from Conditional Sequence Models (N18-1)
Copied to clipboard
| Challenge: | In structured prediction problems, labeling an input string with a length-T sequence of tags becomes intractable. |
| Approach: | They propose a sequential Monte Carlo method for sampling annotations of an input string from a given probability model. |
| Outcome: | The proposed method improves the quality of the sample. |
Neural Finite-State Transducers: Beyond Rational Relations (N19-1)
Copied to clipboard
| Challenge: | a finite state transducer defines joint and conditional probability distributions over strings . a weighted finite-state transducers can only model certain functions, known as the rational relations . |
| Approach: | They propose a family of string transduction models defining joint and conditional probability distributions over pairs of strings. |
| Outcome: | The proposed models are more powerful than previous finite-state models with neural features. |
Low-Rank Adaptation for Multilingual Summarization: An Empirical Study (2024.findings-naacl)
Copied to clipboard
| Challenge: | Pre-trained Large Language Models have significantly advanced NLP, but their ever-increasing size poses significant challenges for conventional fine-tuning. |
| Approach: | They investigate the potential of Low-Rank Adaptation (LoRA) in multilingual summarization, a task that is challenging and relatively unexplored. |
| Outcome: | The proposed method outperforms full fine-tuning and cross-lingual transfer strategies in multilingual summarization tasks. |