Arxiv on Feb. 8th


Title: A Critical Investigation of Deep Reinforcement Learning for Navigation
Authors: Vikas Dhiman, Shurjo Banerjee, Brent Griffin, Jeffrey M Siskind, Jason
J Corso
Categories: cs.RO cs.AI

The navigation problem is classically approached in two steps: an exploration
step, where map-information about the environment is gathered; and an
exploitation step, where this information is used to navigate efficiently. Deep
reinforcement learning (DRL) algorithms, alternatively, approach the problem of
navigation in an end-to-end fashion. Inspired by the classical approach, we ask
whether DRL algorithms are able to inherently explore, gather and exploit
map-information over the course of navigation. We build upon Mirowski et al.
[2017] work and introduce a systematic suite of experiments that vary three
parameters: the agent’s starting location, the agent’s target location, and the
maze structure. We choose evaluation metrics that explicitly measure the
algorithm’s ability to gather and exploit map-information. Our experiments show
that when trained and tested on the same maps, the algorithm successfully
gathers and exploits map-information. However, when trained and tested on
different sets of maps, the algorithm fails to transfer the ability to gather
and exploit map-information to unseen maps. Furthermore, we find that when the
goal location is randomized and the map is kept static, the algorithm is able
to gather and exploit map-information but the exploitation is far from optimal.
We open-source our experimental suite in the hopes that it serves as a
framework for the comparison of future algorithms and leads to the discovery of
robust alternatives to classical navigation methods. ,  8585kb)
Title: Evaluation of Deep Reinforcement Learning Methods for Modular Robots
Authors: Risto Kojcev, Nora Etxezarreta, Alejandro Hern\’andez and V\’ictor
Categories: cs.RO

We propose a novel framework for Deep Reinforcement Learning (DRL) in modular
robotics using traditional robotic tools that extend state-of-the-art DRL
implementations and provide an end-to-end approach which trains a robot
directly from joint states. Moreover, we present a novel technique to transfer
these DLR methods into the real robot, aiming to close the simulation-reality
gap. We demonstrate the robustness of the performance of state-of-the-art DRL
methods for continuous action spaces in modular robots, with an empirical study
both in simulation and in the real robot where we also evaluate how
accelerating the simulation time affects the robot’s performance. Our results
show that extending the modular robot from 3 degrees-of-freedom (DoF), to 4
DoF, does not affect the robot’s learning. This paves the way towards training
modular robots using DRL techniques. ,  3128kb)

Title: From Game-theoretic Multi-agent Log Linear Learning to Reinforcement
Authors: Mohammadhosein Hasanbeig, Lacra Pavel
Categories: cs.LG cs.MA

Multi-agent Systems (MASs) have found a variety of industrial applications
from economics to robotics, owing to their high adaptability, scalability and
applicability. However, with the increasing complexity of MASs, multi-agent
control has become a challenging problem to solve. Among different approaches
to deal with this complex problem, game theoretic learning recently has
received researchers’ attention as a possible solution. In such learning
scheme, by playing a game, each agent eventually discovers a solution on its
own. The main focus of this paper is on enhancement of two types of
game-theoretic learning algorithms: log linear learning and reinforcement
learning. Each algorithm proposed in this paper, relaxes and imposes different
assumptions to fit a class of MAS problems. Numerical experiments are also
conducted to verify each algorithm’s robustness and performance. ,  919kb)

No Responses Yet to “Arxiv on Feb. 8th”

  1. Leave a Comment

Leave a Reply

Please log in using one of these methods to post your comment: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: