Task-Oriented Language Grounding for Language Input with Multiple Sub-Goals of Non-Linear Order

October 27, 2019 · Entered Twilight · 🏛 arXiv.org

"Last commit was 6.0 years ago (≥5 year threshold)"

Evidence collected by the PWNC Scanner

Repo contents: .gitignore, Dockerfile, LICENSE, README.md, build_run.sh, envs, experiments, instructions, pics, results_investigation.ipynb, runner.py, runner_hypothesis_synonyms.py, utils

Authors Vladislav Kurenkov, Bulat Maksudov, Adil Khan arXiv ID 1910.12354 Category cs.CL: Computation & Language Cross-listed cs.AI, cs.LG Citations 1 Venue arXiv.org Repository https://github.com/vkurenkov/language-grounding-multigoal ⭐ 8 Last Checked 2 months ago

Abstract

In this work, we analyze the performance of general deep reinforcement learning algorithms for a task-oriented language grounding problem, where language input contains multiple sub-goals and their order of execution is non-linear. We generate a simple instructional language for the GridWorld environment, that is built around three language elements (order connectors) defining the order of execution: one linear - "comma" and two non-linear - "but first", "but before". We apply one of the deep reinforcement learning baselines - Double DQN with frame stacking and ablate several extensions such as Prioritized Experience Replay and Gated-Attention architecture. Our results show that the introduction of non-linear order connectors improves the success rate on instructions with a higher number of sub-goals in 2-3 times, but it still does not exceed 20%. Also, we observe that the usage of Gated-Attention provides no competitive advantage against concatenation in this setting. Source code and experiments' results are available at https://github.com/vkurenkov/language-grounding-multigoal