Surface Stickiness Perception by Multisensory Cues
Hyungeol Lee, Eunsil Lee, Jiye Jung, and Junsuk Kim
“To interact effectively with surrounding objects, humans need to acquire surface texture information from objects using different sensory modalities. How do we perceive texture information (1) by looking at the surface, (2) by touching it with our hands, or (3) by hearing sounds generated by interacting with it?”
This study aimed to explore the psychophysical bases of multisensory surface stickiness perception by investigating how sensitively humans perceive different levels of stickiness intensity conveyed by auditory, tactile, and visual cues. First, we sorted five different sticky stimuli by perceived intensity in ascending order for each modality separately and evaluated the discrimination sensitivities of each participant using a fitted psychometric curve. Results showed that perceptual intensity orders were not identical to physical intensity order and that the sequential order of perceived intensities for different modalities was inconsistent. Moreover, estimated perceptual sensitivities to surface stickiness indicated that auditory cues result in better discrimination sensitivity than tactile and visual cues. Second, we calculated the relative perceptual distances of stickiness intensities using multidimensional scaling. A follow-up statistical test demonstrated that the perceptual mapping of vision and touch are similar but that auditory perception is different. These results suggest that the discriminability of stickiness intensity is best served by auditory cues and that texture information processing in the auditory domain is distinctive from that of other modalities.
Hyungeol Lee, Eunsil Lee, Jiye Jung, and Junsuk Kim, "Multisensory Stickiness Perception: Comparison between Auditory, Tactile, and Visual Perception," Frontiers in Psychology, Accepted.