HOME >> English >> SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality

SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality

We present SoftAR, a novel spatial augmented reality (AR) technique based on a pseudo-haptics mechanism that visually manipulates the sense of softness perceived by a user pushing a soft physical object. Considering the limitations of projection-based approaches that change only the surface appearance of a physical object, we propose two projection visual effects, i.e., surface deformation effect (SDE) and body appearance effect (BAE), on the basis of the observations of humans pushing physical objects. The SDE visualizes a two-dimensional deformation of the object surface with a controlled softness parameter, and BAE changes the color of the pushing hand. Through psychophysical experiments, we confirm that the SDE can manipulate softness perception such that the participant perceives significantly greater softness than the actual softness. Furthermore, fBAE, in which BAE is applied only for the finger area, significantly enhances manipulation of the perception of softness. We create a computational model that estimates perceived softness when SDE+fBAE is applied. We construct a prototype SoftAR system in which two application frameworks are implemented. The softness adjustment allows a user to adjust the softness parameter of a physical object, and the softness transfer allows the user to replace the softness with that of another object.

Overview of SoftAR application. The user can manipulate an object’s softness by projecting the surface deformation and body appearance effects (see supplementary video shown above for the motion presentation).

Publications

  • Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato, "SoftAR: Visually Manipulating Haptic Softness Perception in Spatial Augmented Reality," IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE International Symposium on Mixed and Augmented Reality), Vol. 21, No. 11, pp. 1279-1288, 2015.
  • Parinya Punpongsanon, Daisuke Iwai, and Kosuke Sato, "A Preliminary Study on Altering Surface Softness Perception in Spatial Augmented Reality," In Proceedings of IEEE International Symposium on Mixed and Augmented Reality (ISMAR), pp. 301-302, 2014.