Please use this identifier to cite or link to this item: http://dl.pgu.ac.ir/handle/Hannan/72385
Title: Markerless Perspective Taking for Humanoid Robots in Unconstrained Environments
Issue Date: 16-May-2016
14-Jan-2016
Publisher: IEEE
Description: Perspective taking enables humans to imagine the world from another viewpoint. This allows reasoning about the state of other agents, which in turn is used to more accurately predict their behavior. In this paper, we equip an iCub humanoid robot with the ability to perform visuospatial perspective taking (PT) using a single depth camera mounted above the robot. Our approach has the distinct benefit that the robot can be used in unconstrained environments, as opposed to previous works which employ marker-based motion capture systems. Prior to and during the PT, the iCub learns the environment, recognizes objects within the environment, and estimates the gaze of surrounding humans. We propose a new head pose estimation algorithm which shows a performance boost by normalizing the depth data to be aligned with the human head. Inspired by psychological studies, we employ two separate mechanisms for the two different types of PT. We implement line of sight tracing to determine whether an object is visible to the humans (level 1 PT). For more complex PT tasks (level 2 PT), the acquired point cloud is mentally rotated, which allows algorithms to reason as if the input data was acquired from an egocentric perspective. We show that this can be used to better judge where object are in relation to the humans. The multifaceted improvements to the PT pipeline advance the state of the art, and move PT in robots to markerless, unconstrained environments.
URI: http://dx.doi.org/10.1109/ICRA.2016.7487504
Other Identifiers: http://hdl.handle.net/10044/1/29466
612139
Type Of Material: OTHER
Appears in Collections:Faculty of Engineering

Files in This Item:
Click on the URI links for accessing contents.


Items in HannanDL are protected by copyright, with all rights reserved, unless otherwise indicated.