Capturing and reproducing hand-object interactions through vision-based force sensing

T.-H. Pham, A. Kheddar, A. Qammaz, A. A. Argyros, IEEE ICCV Workshop on Object Understanding for Interaction (OUI), 2015

Capturing and reproducing hand-objects interactions would open considerable possibilities in computer vision, human-computer interfaces, robotics, animation and rehabilitation. Recently, we witnessed impressive vision-based hand tracking solutions that can potentially be used for such purposes. Yet, a challenging question is: to what extent can vision also capture haptic interactions? These induce... [Read More]
Tags: research

Towards force sensing from vision - observing hand-object interactions to infer manipulation forces

T.-H. Pham, A. Kheddar, A. Qammaz, A. A. Argyros, IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015

We present a novel, non-intrusive approach for estimating contact forces during hand-object interactions relying solely on visual input provided by a single RGB-D camera. We consider a manipulated object with known geometrical and physical properties. First, we rely on model-based visual tracking to estimate the object’s pose together with that... [Read More]
Tags: research