A Survey of Text Games for Reinforcement Learning Informed by Natural Language (2022.tacl-1)
Copied to clipboard
| Challenge: | Interactive Fiction Games (text games) are a problem type that require natural language to solve complex tasks. |
| Approach: | They propose to use interactive fiction games as a testing environment to test the new Reinforcement Learning solutions using natural language. |
| Outcome: | The proposed solutions are based on the proposed interactive fiction games and the generated environments. |
Similar Papers
Interactive Fiction Game Playing as Multi-Paragraph Reading Comprehension with Reinforcement Learning (2020.emnlp-main)
Copied to clipboard
| Challenge: | Interactive Fiction (IF) games with real human-written natural language texts provide a new natural evaluation for language understanding techniques. |
| Approach: | They propose to re-formulate IF game solving as Multi-Passage Reading Comprehension tasks using context-query attention mechanisms and structured prediction to efficiently generate and evaluate action outputs. |
| Outcome: | The proposed methods achieve high winning rates and low data requirements on the recent IF benchmark (Jericho) |
Perceiving the World: Question-guided Reinforcement Learning for Text-based Games (2022.acl-long)
Copied to clipboard
| Challenge: | Text-based games provide an interactive way to study natural language processing. |
| Approach: | They propose a two-phase training framework to decouple language learning from reinforcement learning and improve the sample efficiency. |
| Outcome: | The proposed method significantly improves performance and sample efficiency against compound error and limited pre-training data. |
Playing Text-Adventure Games with Graph-Based Deep Reinforcement Learning (N19-1)
Copied to clipboard
| Challenge: | Text adventure games provide a platform for exploring reinforcement learning in combinatorial action space, such as natural language. |
| Approach: | They propose a deep reinforcement learning architecture that represents the game state as a knowledge graph which is learned during exploration. |
| Outcome: | The proposed architecture can learn a control policy faster than baseline alternatives. |
Deep Reinforcement Learning for NLP (P18-5)
Copied to clipboard
| Challenge: | Many natural language processing tasks can be formulated as deep reinforcement learning (DRL) problems. |
| Approach: | This tutorial provides an introduction to the foundations of deep reinforcement learning . it describes recent advances in designing deep reinforcement for NLP . |
| Outcome: | This tutorial provides an introduction to the foundations of deep reinforcement learning and some practical solutions for NLP tasks. |
On the Effects of Fine-tuning Language Models for Text-Based Reinforcement Learning (2025.coling-main)
Copied to clipboard
| Challenge: | Text-based reinforcement learning is a form of interactive fiction where players manipulate the environment using text and admissible actions in natural language. |
| Approach: | They show that rich semantic understanding leads to efficient training of text-based RL agents . they also show that semantic degeneration occurs when LMs are inappropriately fine-tuned . |
| Outcome: | The results suggest that semantic understanding is not important for the task . they also show that fine-tuning language models can degenerate the agent's performance . |
STARLING: Self-supervised Training of Text-based Reinforcement Learning Agent with Large Language Models (2024.findings-acl)
Copied to clipboard
| Challenge: | Existing environments for text-based RL are domain-specific or time-consuming to generate and do not train the agents to master a specific set of skills. |
| Approach: | They propose an interactive environment for self-supervised RL that bootstraps the text-based RL agents with automatically generated games to boost their generalization capabilities. |
| Outcome: | The proposed environment bootstraps the agents with automatically generated games to boost their generalization capabilities to reach a goal of the target environment. |
Self-imitation Learning for Action Generation in Text-based Games (2023.eacl-main)
Copied to clipboard
| Challenge: | Text-based games are situated systems where the game agents observe textual descriptions, and generate textual commands to interact with the environment. |
| Approach: | They propose a confidence-based self-imitation model to generate action candidates for the RL agent by exploiting past valuable trajectories to adapt a pre-trained language model towards a target game. |
| Outcome: | The proposed model performs well in multiple challenging games. |
A Survey of Reinforcement Learning for Large Language Models under Data Scarcity: Challenges and Solutions (2026.acl-long)
Copied to clipboard
Zhiyin Yu, Yuchen Mou, Juncheng Yan, Junyu Luo, Chunchun Chen, Xing Wei, Yunhui Liu, Hongru Sun, Yuxing Zhang, Jun Xu, Yatao Bian, Ming Zhang, Wei Ye, Tieke He, Jie Yang, Guanjie Zheng, Zhonghai Wu, Bo Zhang, Lei Bai, Xiao Luo
| Challenge: | Existing research on reinforcement learning for LLMs under data scarcity has not been unified. |
| Approach: | They propose a top-up hierarchical framework built around three complementary perspectives: data-centric, training-centric and framework-centric. |
| Outcome: | The proposed framework provides a clear conceptual foundation for understanding the design space of data-efficient RL for large language models and to guide researchers working in this emerging area. |
Revisiting the Roles of “Text” in Text Games (2022.findings-emnlp)
Copied to clipboard
| Challenge: | Recent work has shown that random text hashes could be complementary rather than contrasting in text games. |
| Approach: | They propose a scheme to extract contextual information into an approximate state hash as extra input for an RNN-based text agent. |
| Outcome: | The proposed scheme achieves competitive performance with state-of-the-art text agents using advanced NLU techniques such as knowledge graph and passage retrieval. |
Reader: Model-based language-instructed reinforcement learning (2023.emnlp-main)
Copied to clipboard
| Challenge: | Existing models of RL are limited and need to be re-trained for every new problem. |
| Approach: | They propose a model-based reinforcement learning approach to tackle the environment Read To Fight Monsters, a grounded policy learning problem. |
| Outcome: | The proposed approach performs better than existing model-free SOTA agents in the read to fight monsters environment and is more sample efficient than existing models. |