Challenge: Existing approaches perform significantly worse in unseen environments compared to seen ones.
Approach: They propose to use a ‘environmental dropout’ method to generate unseen triplets to generate new paths and instructions to generalize the agent.
Outcome: The proposed agent outperforms the state-of-the-art approaches on the private unseen test set and is ranked top on the leaderboard.

Similar Papers

CLEAR: Improving Vision-Language Navigation with Cross-Lingual, Environment-Agnostic Representations (2022.findings-naacl)

Copied to clipboard

Challenge: Using multilingual instructions to learn a better cross-lingual representation is challenging for multilingual agents.
Approach: They propose to use multilingual instructions to learn a shared cross-lingual language representation for the three languages in a Room-Across-Room dataset.
Outcome: The proposed model improves on the room-Across-room and vision-and-dialogue navigation tasks by maximizing similarity between semantically aligned image pairs from different environments.
Sub-Instruction Aware Vision-and-Language Navigation (2020.emnlp-main)

Copied to clipboard

Challenge: Despite significant advances, few previous works are able to fully utilize the strong correspondence between visual and textual sequences.
Approach: They propose to provide agents with fine-grained annotations during training and provide them with sub-instructions and their corresponding paths.
Outcome: The proposed method improves the performance of four state-of-the-art agents in a room-to-room (R2R) benchmark dataset.
Reader: Model-based language-instructed reinforcement learning (2023.emnlp-main)

Copied to clipboard

Challenge: Existing models of RL are limited and need to be re-trained for every new problem.
Approach: They propose a model-based reinforcement learning approach to tackle the environment Read To Fight Monsters, a grounded policy learning problem.
Outcome: The proposed approach performs better than existing model-free SOTA agents in the read to fight monsters environment and is more sample efficient than existing models.
When Being Unseen from mBERT is just the Beginning: Handling New Languages With Multilingual Language Models (2021.naacl-main)

Copied to clipboard

Challenge: Language models are a new standard to build state-of-the-art NLP systems.
Approach: They compare multilingual and monolingual models on unseen languages . they show that some languages benefit from transfer learning whereas others don't .
Outcome: The proposed model behaves in multiple ways on unseen languages, while others fail to transfer . the results provide a promising direction towards making multilingual models useful for a new set of unseense languages.
Robust Navigation with Language Pretraining and Stochastic Sampling (D19-1)

Copied to clipboard

Challenge: Existing methods to learn visual representations and action decoding schemes are limited to previously unseen instructions and environments.
Approach: They propose a stochastic sampling scheme to reduce the gap between the expert actions in training and sampled actions in test to correct its own mistakes.
Outcome: The proposed methods achieve 6% absolute gain over the previous best results on the Room-to-Room benchmark.
Can MLLMs Find Their Way in a City? Exploring Emergent Navigation from Web-Scale Knowledge (2026.eacl-long)

Copied to clipboard

Challenge: Existing evaluation benchmarks for multimodal large language models (MLLMs) are language-centric or heavily reliant on simulated environments, rarely probing the nuanced, knowledge-intensive reasoning essential for practical, real-world scenarios.
Approach: They propose a task of Sparsely Grounded Visual Navigation to evaluate MLLM-driven agents in city navigation in four diverse global cities.
Outcome: The proposed benchmark encompassing four diverse global cities evaluates agents' decision-making abilities in city navigation.
EXPLORER: Exploration-guided Reasoning for Textual Reinforcement Learning (2024.eacl-long)

Copied to clipboard

Challenge: Text-based games (TBGs) combine natural language understanding with reasoning.
Approach: They propose an exploration-guided reasoning agent for textual reinforcement learning that integrates natural language with reasoning.
Outcome: The proposed agent outperforms baseline agents on TWG and TWC games.
Teaching Large Language Models an Unseen Language on the Fly (2024.findings-acl)

Copied to clipboard

Challenge: Existing large language models struggle to support numerous low-resource languages . Existing models lack sufficient training data for effective parameter updating .
Approach: They propose a framework for adapting LLMs to unseen languages by in-context learning.
Outcome: The proposed framework improves Chinese-to-Zhuang translation performance and Zhuan-to Chinese translation performance.
Translating Navigation Instructions in Natural Language to a High-Level Plan for Behavioral Robot Navigation (D18-1)

Copied to clipboard

Challenge: Existing models for translating free-form natural language instructions to a high-level plan for behavioral robot navigation are difficult due to the variability in the way people describe routes.
Approach: They propose an end-to-end deep learning model for translating free-form natural language instructions to a high-level plan for robot navigation.
Outcome: The proposed model significantly outperforms baseline approaches on a new dataset containing 10,050 pairs of navigation instructions.
Analyzing Generalization of Vision and Language Navigation to Unseen Outdoor Areas (2022.acl-long)

Copied to clipboard

Challenge: Recent work on visual-grounded navigation has focused on indoor scenarios with sharp drops in performance when testing on unseen data.
Approach: They focus on visual agent navigation in outdoor scenarios with panorama images . they find that most gain in outdoor VLN on unseen data is due to specific features .
Outcome: The results show a bias to specifics of graph representations of urban environments, demanding that VLN tasks grow in scale and diversity of geographical environments.

What is GenGO?

GenGO is an NLP powered publication search system. It currenctly indexes 30k+ papers from ACL Anthology, and implements multi-aspect summarization, semantic search, and more!

Information

About
Limitations