Header logo is

Non-parametric hand pose estimation with object context




In the spirit of recent work on contextual recognition and estimation, we present a method for estimating the pose of human hands, employing information about the shape of the object in the hand. Despite the fact that most applications of human hand tracking involve grasping and manipulation of objects, the majority of methods in the literature assume a free hand, isolated from the surrounding environment. Occlusion of the hand from grasped objects does in fact often pose a severe challenge to the estimation of hand pose. In the presented method, object occlusion is not only compensated for, it contributes to the pose estimation in a contextual fashion; this without an explicit model of object shape. Our hand tracking method is non-parametric, performing a nearest neighbor search in a large database (.. entries) of hand poses with and without grasped objects. The system that operates in real time, is robust to self occlusions, object occlusions and segmentation errors, and provides full hand pose reconstruction from monocular video. Temporal consistency in hand pose is taken into account, without explicitly tracking the hand in the high-dim pose space. Experiments show the non-parametric method to outperform other state of the art regression methods, while operating at a significantly lower computational cost than comparable model-based hand tracking methods.

Author(s): Romero, Javier and Kjellström, Hedvig and Ek, Carl Henrik and Kragic, Danica
Journal: Image and Vision Computing
Volume: 31
Number (issue): 8
Pages: 555 - 564
Year: 2013

Department(s): Perceiving Systems
Bibtex Type: Article (article)
Paper Type: Journal

URL: http://www.sciencedirect.com/science/article/pii/S0262885613000656

Links: Publisher site
Attachments: pdf


  title = {Non-parametric hand pose estimation with object context },
  author = {Romero, Javier and Kjellstr{\"o}m, Hedvig and Ek, Carl Henrik and Kragic, Danica},
  journal = {Image and Vision Computing },
  volume = {31},
  number = {8},
  pages = {555 - 564},
  year = {2013},
  url = {http://www.sciencedirect.com/science/article/pii/S0262885613000656}