Papers by Yixiao Ma
CaseEncoder: A Knowledge-enhanced Pre-trained Model for Legal Case Encoding (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing legal-oriented PLMs rely on replacing general domain training data with legal data or extending the input length to fit the long-length characteristic of legal data. |
| Approach: | They propose a legal document encoder that leverages fine-grained legal knowledge in both the data sampling and pre-training phases. |
| Outcome: | The proposed model outperforms existing general domain pre-training models and legal-specific pre-trainers on multiple benchmarks. |
RePair: Automated Program Repair with Process-based Feedback (2024.findings-acl)
Copied to clipboard
| Challenge: | Commercial-scale language models (LMs) have taken APR to unprecedented levels, but they are limited by parameters and humans interact with them through explicit prompts. |
| Approach: | They propose a method that utilizes process supervision to improve program repair by allowing users to input feedback from compilers and test cases. |
| Outcome: | The proposed method outperforms large outcome-based generation methods and is inspired by strategies used in programming competitions. |
CH-SIMS: A Chinese Multimodal Sentiment Analysis Dataset with Fine-grained Annotation of Modality (2020.acl-main)
Copied to clipboard
| Challenge: | Existing studies in multimodal sentiment analysis only use unified multimodal annotations, which do not reflect the independent sentiment of single modalities. |
| Approach: | They propose a Chinese single- and multi-modal sentiment analysis dataset with multimodal and independent unimodal annotations that can be used to study the interaction between modalities. |
| Outcome: | The proposed methods achieve state-of-the-art performance and learn more distinctive unimodal representations. |