Arxiv on Feb. 9th


Title: Deep Reinforcement Learning for Image Hashing
Authors: Jian Zhang, Yuxin Peng and Zhaoda Ye
Categories: cs.CV
Comments: 18 pages, submitted to ACM Transactions on Multimedia Computing,
Communications, and Applications (TOMM). arXiv admin note: text overlap with

Deep hashing methods have received much attention recently, which achieve
promising results by taking advantage of the strong representation power of
deep networks. However, most existing deep hashing methods learn a whole set of
hashing functions independently and directly, while ignore the correlation
between different hashing functions that can promote the retrieval accuracy
greatly. Inspired by the sequential decision ability of deep reinforcement
learning, in this paper, we propose a new Deep Reinforcement Learning approach
for Image Hashing (DRLIH). Our proposed DRLIH models the hashing learning
problem as a Markov Decision Process (MDP), which learns each hashing function
by correcting the errors imposed by previous ones and promotes retrieval
accuracy. To the best of our knowledge, this is the first work that tries to
address hashing problem from deep reinforcement learning perspective. The main
contributions of our proposed DRLIH approach can be summarized as follows: (1)
We propose a deep reinforcement learning hashing network. In our proposed DRLIH
approach, we utilize recurrent neural network (RNN) as agents to model the
hashing functions, which take actions of projecting images into binary codes
sequentially, so that current hashing function learning can take previous
hashing functions’ error into account. (2) We propose a sequential learning
strategy based on proposed DRLIH. We define the state as a tuple of internal
features of RNN’s hidden layers and image features, which can well reflect
history decisions made by the agents. We also propose an action group method to
enhance the correlation of the hash functions in the same group. Experiments on
three widely-used datasets demonstrate the effectiveness of our proposed DRLIH
approach. ,  751kb)

Title: Efficient collective swimming by harnessing vortices through deep
  reinforcement learning
Authors: Siddhartha Verma and Guido Novati and Petros Koumoutsakos
Categories: physics.flu-dyn cs.AI physics.comp-ph
Comments: 26 pages, 14 figures

Fish in schooling formations navigate complex flow-fields replete with
mechanical energy in the vortex wakes of their companions. Their schooling
behaviour has been associated with evolutionary advantages including collective
energy savings. How fish harvest energy from their complex fluid environment
and the underlying physical mechanisms governing energy-extraction during
collective swimming, is still unknown. Here we show that fish can improve their
sustained propulsive efficiency by actively following, and judiciously
intercepting, vortices in the wake of other swimmers. This swimming strategy
leads to collective energy-savings and is revealed through the first ever
combination of deep reinforcement learning with high-fidelity flow simulations.
We find that a `smart-swimmer’ can adapt its position and body deformation to
synchronise with the momentum of the oncoming vortices, improving its average
swimming-efficiency at no cost to the leader. The results show that fish may
harvest energy deposited in vortices produced by their peers, and support the
conjecture that swimming in formation is energetically advantageous. Moreover,
this study demonstrates that deep reinforcement learning can produce navigation
algorithms for complex flow-fields, with promising implications for energy
savings in autonomous robotic swarms. ,  9281kb)

No Responses Yet to “Arxiv on Feb. 9th”

  1. Leave a Comment

Leave a Reply

Please log in using one of these methods to post your comment: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

%d bloggers like this: