Image Texture/Perception-Based Haptic Model Assignment to 3D Mesh and Synthesizing Haptic Texture Model based on Haptic Affective Space

Researchers: Waseem Hassan, Arsen Abdulali, and Seokhee Jeon

As the lack of haptic contents is one of the limitations of current haptics technology, this research aims at developing a hardware and software framework for efficient haptic model building based on actual measurement data. In this work, we develop and integrate data-driven haptic contents modeling methods for stiffness, friction, and surface texture, and construct "The Haptic Library." Then, we seek for new perception and image-based techniques to automatically assign the acquired models into 3D mesh models.

Then, we changed our focus toward haptic texture model synthesization. The main goal is to synthesize new virtual textures by manipulating the affective properties of already existing real life textures. To this end, two different spaces are established: two-dimensional "affective space" built from a series of psychophysical experiments where real textures are arranged according to affective properties (hard-soft, rough-smooth) and two-dimensional "haptic model space" where real textures are placed based on features from tool-surface contact acceleration patterns (movement-velocity, normal-force). Another space, called "authoring space" is formed to merge the two spaces; correlating changes in affective properties of real life textures to changes in actual haptic signals in haptic space. As a result, new texture signals corresponding to any point in authoring space can be synthesized based on weighted interpolation of three nearest real surfaces in a perceptually correct manner.

Funding: Part of the Global Frontier project funded by NRF Korea.

Topics: The Haptic Library, Affective and haptic model spaces, Image and perception-based texture assignment

Related Publications:

• Waseem Hassan and Seokhee Jeon, "Evaluating Differences Between Bare-handed and Tool-Based Interaction in Perceptual Space," 2016 IEEE Haptics Symposium (HAPTICS), 2016.
• Waseem Hassan, Arsen Abdulali, and Seokhee Jeon, "Authoring New Haptic Textures Based on Interpolation of Real Textures in Affective Space," IEEE Transactions on Industrial Electronics, 2019.
• Waseem Hassan, Arsen Abdulali, Muhammad Abdullah, Sang Chul Ahn, and Seokhee Jeon, "Towards Universal Haptic Library – Library-Based Haptic Texture Assignment Using Image Texture and Perceptual Space," IEEE Transactions on Haptics, vol. 11, no. 2, 2018.