An Enhanced FingerVision for Contact Spatial Surface Sensing
- 30 April 2021
- journal article
- research article
- Published by Institute of Electrical and Electronics Engineers (IEEE) in IEEE Sensors Journal
- Vol. 21 (15), 16492-16502
- https://doi.org/10.1109/jsen.2021.3076815
Abstract
Vision-based tactile sensor is a promising solution for tactile sensing. In this paper, we customized FingerVision sensor with multi-layer structure and biomimetic features, and used it to verify a two-step spatial surface sensing method. For the custom sensor, the multi-layer structure imitated the skin and tissue, and the sensing area and frequency range were consistent with the Meissner’s corpuscles and Merkel discs. The two-step sensing method was verified through spatial reconstruction and surface recognition. First, we employed the integration method for surface reconstruction based on the gradients estimated from the marker displacements. The similarity between the reconstructed and the actual contact surface was 85.33% in average according to the evaluation on heights. Then we improved the features by correcting the marker displacements according to the boundary condition during surface reconstruction for surface recognition implementing K-Nearest Neighbor (KNN) algorithm. The accuracy was up to 99.26% when the training set was only 15% for 19 surface classes. While with the features extracted from the original coordinates, the accuracy was only 95.58%. The two-step sensing method implied that the surface reconstruction and recognition were related, and the reconstruction step indeed helped to the recognition. Additionally, the excellent recognition capability indicated the practical value of our custom sensor and the feature processing method in surface recognition through touch.Keywords
Funding Information
- National Natural Science Foundation of China (61733011)
- Guangdong Science and Technology Research Council (2020B1515120064)
- State Key Laboratory of Mechanical System and Vibration of Shanghai Jiao Tong University
This publication has 40 references indexed in Scilit:
- A Robust Capacitive Digital Read-Out Circuit for a Scalable Tactile SkinIEEE Sensors Journal, 2017
- Object Recognition Using Tactile Measurements: Kernel Sparse Coding MethodsIEEE Transactions on Instrumentation and Measurement, 2016
- Novel Tactile-SIFT Descriptor for Object Shape RecognitionIEEE Sensors Journal, 2015
- Measurement of shear and slip with a GelSight tactile sensorPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2015
- Seeing by Touch: Evaluation of a Soft Biologically-Inspired Artificial Fingertip in Real-Time Active TouchSensors, 2014
- Development of a Skin-Like Tactile Sensor Array for Curved SurfaceIEEE Sensors Journal, 2013
- Directions Toward Effective Utilization of Tactile Skin: A ReviewIEEE Sensors Journal, 2013
- Tactile Sensing—From Humans to HumanoidsIEEE Transactions on Robotics, 2009
- State-of-the-Art in Force and Tactile Sensing for Minimally Invasive SurgeryIEEE Sensors Journal, 2008
- Feature detection with an image based compliant tactile sensorPublished by Institute of Electrical and Electronics Engineers (IEEE) ,2003