CrystalICL: Enabling In-Context Learning for Crystal Generation (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing methods for crystal generation are limited to zero-shot scenarios and are unable to benefit from few-shot situations. |
| Approach: | They propose a model designed for few-shot crystal generation that exploits in-context learning by capturing structure-property relationships from limited data. |
| Outcome: | The proposed model reduces complexity of modeling crystal symmetry in LLMs and exploits ICL by capturing structure-property relationships from limited data. |
Similar Papers
OpenICL: An Open-Source Framework for In-context Learning (2023.acl-demo)
Copied to clipboard
| Challenge: | In-context Learning (ICL) is a new paradigm for large language model evaluation. |
| Approach: | They propose an open-source toolkit for ICL and LLM evaluation. |
| Outcome: | The proposed framework is highly flexible and flexible and can be easily combined with other tools to suit users' needs. |
More is not always better? Enhancing Many-Shot In-Context Learning with Differentiated and Reweighting Objectives (2025.acl-long)
Copied to clipboard
Xiaoqing Zhang, Ang Lv, Yuhan Liu, Flood Sung, Wei Liu, Jian Luan, Shuo Shang, Xiuying Chen, Rui Yan
| Challenge: | Large language models excel at few-shot in-context learning but performance plateaus as ICL demonstrations increase from a few to many. |
| Approach: | They propose a novel optimization method that optimizes the negative log-likelihood objective and reweights the model to achieve many-shot performance. |
| Outcome: | The proposed method achieves significant performance improvements across a large-scale dataset. |
ParaICL: Towards Parallel In-Context Learning (2025.naacl-long)
Copied to clipboard
| Challenge: | Existing methods to improve ICL performance are limited by the length of the input context. |
| Approach: | They propose a method that utilizes all demonstration examples without exceeding the manageable context length. |
| Outcome: | The proposed method can be scaled up to integrate with existing methods. |
Large Language Models for Controllable Multi-property Multi-objective Molecule Optimization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for molecule optimization fail to capture property-specific objectives . a series of instruction-tuned LLMs can perform targeted property-specific optimization . |
| Approach: | They propose a set of instruction-tuned LLMs that can perform targeted property-specific optimization. |
| Outcome: | a new instruction-tuned LLM can perform targeted property-specific optimization. |
Enhancing Low-Resource LLMs Classification with PEFT and Synthetic Data (2024.lrec-main)
Copied to clipboard
| Challenge: | Large Language Models (LLMs) operating in 0-shot or few-shot settings achieve competitive results in Text Classification tasks. |
| Approach: | They propose to make Large Language Models (LLMs) operating in 0-shot or few-shot settings as efficient as 0- shot text classifiers by leveraging a small number of samples. |
| Outcome: | The proposed model is able to perform better on multiple datasets than existing models on 0-shot or few-shot settings. |
C-ICL: Contrastive In-context Learning for Information Extraction (2024.findings-emnlp)
Copied to clipboard
| Challenge: | Existing methods for in-context learning with large language models focus on using correct or negative examples, ignoring the potential value of incorrect or negative samples. |
| Approach: | They propose a few-shot technique that leverages both correct and incorrect sample constructions to create in-context learning demonstrations. |
| Outcome: | The proposed technique outperforms previous few-shot in-context learning methods on a broad spectrum of related tasks. |
GAMIC: Graph-Aligned Molecular In-context Learning for Molecule Analysis via LLMs (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Current methods for retrieving large language models rely on molecule feature similarity, such as Morgan fingerprints, which do not adequately capture the global molecular and atom-binding relationships. |
| Approach: | They propose a self-supervised learning technique that embeds demonstration examples into the input prompt. |
| Outcome: | The proposed technique outperforms simple Morgan-based retrieval methods across tasks by up to 45%. |
Beyond In-Context Learning: Aligning Long-form Generation of Large Language Models via Task-Inherent Attribute Guidelines (2025.findings-acl)
Copied to clipboard
Do Xuan Long, Duong Ngoc Yen, Do Xuan Trong, Anh Tuan Luu, Kenji Kawaguchi, Shafiq Joty, Min-Yen Kan, Nancy F. Chen
| Challenge: | In-context learning is an important but not fully understood ability of pre-trained large language models. |
| Approach: | They propose a tool that generates two streams of guidelines capturing task language and format distributions and prompts them to define them by prompting. |
| Outcome: | The proposed model improves both strong open- and closed-source LLMs by over 5% in both zero- and few-shot settings. |
Training Text-to-Molecule Models with Context-Aware Tokenization (2025.findings-emnlp)
Copied to clipboard
| Challenge: | Text-to-molecule models have shown great potential across chemical applications . however, they rely on atom-level tokenizations, which limiting the ability of models to capture global structural context within molecules. |
| Approach: | They propose a text-to-molecule model that uses substructure-level tokenizations to model global connectivity. |
| Outcome: | The proposed model outperforms state-of-the-art models using only 2% of training tokens. |
Focused Large Language Models are Stable Many-Shot Learners (2024.emnlp-main)
Copied to clipboard
Peiwen Yuan, Shaoxiong Feng, Yiwei Li, Xinglin Wang, Yueqi Zhang, Chuyi Tan, Boyuan Pan, Heda Wang, Yao Hu, Kan Li
| Challenge: | In-Context Learning (ICL) enables large language models to achieve rapid task adaptation by learning from demonstrations. |
| Approach: | They propose a training-free method that disperses model attention from the query . they propose 'focus' search strategy that uses model perplexity to ensure sufficient attention . |
| Outcome: | The proposed method achieves an average performance improvement of 5.2% over vanilla ICL and scales well with many-shot demonstrations. |