Asset Details
Do you wish to reserve the book?
Capturing forceful interaction with deformable objects using a deep learning-powered stretchable tactile array
Hey, we have placed the reservation for you!
By the way, why not check out events that you can attend while you pick your title.
Oops! Something went wrong.
Looks like we were not able to place the reservation. Kindly try again later.
Are you sure you want to remove the book from the shelf?
Capturing forceful interaction with deformable objects using a deep learning-powered stretchable tactile array
Do you wish to request the book?
Capturing forceful interaction with deformable objects using a deep learning-powered stretchable tactile array
Please be aware that the book you have requested cannot be checked out. If you would like to checkout this book, you can reserve another copy
We have requested the book for you!
Your request is successful and it will be processed during the Library working hours. Please check the status of your request in My Requests.
Oops! Something went wrong.
Looks like we were not able to place your request. Kindly try again later.
Journal Article
Capturing forceful interaction with deformable objects using a deep learning-powered stretchable tactile array
2024
Overview
Capturing forceful interaction with deformable objects during manipulation benefits applications like virtual reality, telemedicine, and robotics. Replicating full hand-object states with complete geometry is challenging because of the occluded object deformations. Here, we report a visual-tactile recording and tracking system for manipulation featuring a stretchable tactile glove with 1152 force-sensing channels and a visual-tactile joint learning framework to estimate dynamic hand-object states during manipulation. To overcome the strain interference caused by contact with deformable objects, an active suppression method based on symmetric response detection and adaptive calibration is proposed and achieves 97.6% accuracy in force measurement, contributing to an improvement of 45.3%. The learning framework processes the visual-tactile sequence and reconstructs hand-object states. We experiment on 24 objects from 6 categories including both deformable and rigid ones with an average reconstruction error of 1.8 cm for all sequences, demonstrating a universal ability to replicate human knowledge in manipulating objects with varying degrees of deformability.
The authors report a stretchable tactile array with strain insensitivity, and a visual-tactile joint learning framework, achieving high-accuracy force measurement and replicating full states of hand and manipulated objects with fine-grained geometry.
Publisher
Nature Publishing Group UK,Nature Publishing Group,Nature Portfolio
Subject
