\mathcal XFT: Unlocking the Power of Code Instruction Tuning by Simply Merging Upcycled Mixture-of-Experts (2024.acl-long)
Copied to clipboard
| Challenge: | Existing studies focus on the data perspectives of instruction tuning, leaving room for exploring advanced training schemes. |
| Approach: | They argue that prior works overlook the possibility of improving code instruction tuning by advancing existing training schemes. |
| Outcome: | The proposed model is dense because all parameters are activated to predict the next token (assuming it is a decoder-only LLM). |
Similar Papers
KnowCoder: Coding Structured Knowledge into LLMs for Universal Information Extraction (2024.acl-long)
Copied to clipboard
Zixuan Li, Yutao Zeng, Yuxin Zuo, Weicheng Ren, Wenxuan Liu, Miao Su, Yucan Guo, Yantao Liu, Lixiang Lixiang, Zhilei Hu, Long Bai, Wei Li, Yidan Liu, Pan Yang, Xiaolong Jin, Jiafeng Guo, Xueqi Cheng
| Challenge: | None. None.. None! |
| Approach: | None. None.. None! |
| Outcome: | None. None. No. : |
Proceedings of the 2019 Conference of the North American Chapter of the Association for Computational Linguistics: Tutorials (N19-5)
Copied to clipboard
| Challenge: | NAACL-HLT 2019 tutorials session is organized to give conference attendees a comprehensive introduction to a topic of importance drawn from our rapidly growing and changing research field from expert researchers. |
| Approach: | the tutorials committee at NAACL HLT 2019 received 46 tutorial submissions . 6 of the tutorial submission were selected for presentation at the conference . |
| Outcome: | the tutorials committee at NAACL-HLT 2019 received 46 submissions . 6 of the tutorial submissions were selected for presentation . |
Improving Tokenisation by Alternative Treatment of Spaces (2022.emnlp-main)
Copied to clipboard
| Challenge: | Subword tokenisation is a key initial step in processing natural language . it uses a number of different methods to tokenise text, including a stringsearching technique and a word-matching technique. |
| Approach: | They propose to use a vocabulary-based approach to tokenise text using a numerical ID and a mathematical function to manipulate it. |
| Outcome: | The method is based on a set of training data and learning from it to build a vocabulary and tokenise it at inference time using this vocabulary and learnt parameters. |
Proceedings of the 2nd Workshop on Deep Learning Approaches for Low-Resource NLP (DeepLo 2019) (D19-61)
Copied to clipboard
| Challenge: | EMNLP-IJCNLP 2019 Workshop on Deep Learning Approaches for Low-Resource Natural Language Processing takes place in Hong Kong, China . |
| Approach: | EMNLP-IJCNLP 2019 Workshop on Deep Learning Approaches for Low-Resource Natural Language Processing takes place in Hong Kong, China . call for papers for this second workshop met with a strong response . |
| Outcome: | the EMNLP-IJCNLP 2019 workshop on deep learning approaches for low-resource natural language processing takes place in Hong Kong, China. |
Proceedings of the 28th International Conference on Computational Linguistics: Tutorial Abstracts (2020.coling-tutorials)
Copied to clipboard
| Challenge: | COLING tutorials session is organised to give conference attendees a comprehensive introduction by expert researchers to some topics of importance drawn from our rapidly growing and changing research field. |
| Approach: | a total of 43 tutorial submissions were received, of which seven were selected for presentation at COLING 2020. |
| Outcome: | a total of 43 tutorial submissions were received, of which seven were selected for presentation at COLING 2020. |
Proceedings of the 2nd Workshop on New Frontiers in Summarization (D19-54)
Copied to clipboard
| Challenge: | EMNLP 2017 is a workshop on enhancing natural language processing's ability to produce concise, fluent summaries. |
| Approach: | the workshop provides a forum for cross-fertilization of ideas towards automatic summarization . four invited speakers will be present at the workshop . |
| Outcome: | the workshop aims to provide a forum for cross-fertilization of ideas towards automatic summarization. |
Proceedings of the 2021 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies: Tutorials (2021.naacl-tutorials)
Copied to clipboard
| Challenge: | NAACL 2021 tutorials session is a conference for researchers to present on a topic of importance . a total of 35 tutorial submissions were received, of which 6 were selected for presentation . |
| Approach: | NAACL 2021 tutorials session is organized to give conference attendees a comprehensive introduction from expert researchers to a topic of importance drawn from our research field. |
| Outcome: | the tutorials committee selected 6 tutorials for presentation at NAACL 2021 . the topics chosen this year range from transformers to crowdsourcing . |
Proceedings of the 2018 Conference of the North American Chapter of the Association for Computational Linguistics: Tutorial Abstracts (N18-6)
Copied to clipboard
| Challenge: | NAACL-HLT tutorials are an opportunity for conference attendees to participate in a tutorial on a timely topic of importance to the field. |
| Approach: | NAACL-HLT 2018 is a tutorial session for conference attendees to participate in . a total of 51 tutorial submissions were received, of which 6 were selected for presentation . |
| Outcome: | the tutorials committee at the 2018 NAACL-HLT in New Orleans received 51 submissions . the six tutorials demonstrate the increasing relevance of NLP to a wide range of fields . |
Proceedings of the 63rd Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) (2025.acl-tutorials)
Copied to clipboard
| Challenge: | ACL 2025 tutorial sessions are a cornerstone event of the conference . 76 tutorial submissions were received this year, many of which were very engaging . |
| Approach: | 76 tutorial submissions were received this year for the tutorial session at ACL 2025 . the tutorials are designed to equip you with the latest insights, tools, and methodologies . |
| Outcome: | the tutorial sessions at ACL 2025 will be held in london on november 8 . the conference received 76 tutorial submissions this year . |
Proceedings of the 64th Annual Meeting of the Association for Computational Linguistics (Volume 5: Tutorial Abstracts) (2026.acl-tutorials)
Copied to clipboard
| Challenge: | 61 submissions were received for the tutorials at ACL 2026 . |
| Approach: | 61 tutorials were submitted for the joint call for proposals with EACL . the call for submissions was a highly competitive selection process . |
| Outcome: | 61 submissions were received for the tutorial session at the conference this year . the tutorials cover a range of topics that have moved to the forefront of NLP research in 2026 . |