Tactile sensor lets robots gauge objects’ hardness and manipulate small tools
来源:互联网 发布:python post本地文件 编辑:程序博客网 时间:2024/05/19 09:14
Researchers at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL) have added sensors to grippers on robot arms to give robots greater sensitivity and dexterity. The sensor can judge the hardness of surfaces it touches, enabling a robot to manipulate smaller objects than was previously possible.
The “GelSight” sensor consists of a block of transparent soft rubber — the “gel” of its name — with one face coated with metallic paint. It is mounted on one side of a robotic gripper. When the paint-coated face is pressed against an object, the face conforms to the object’s shape and the metallic paint makes the object’s surface reflective. Mounted on the sensor opposite the paint-coated face of the rubber block are three colored lights at different angles and a single camera.
Humans gauge hardness by the degree to which the contact area between the object and our fingers changes as we press on it. Softer objects tend to flatten more, increasing the contact area. The MIT researchers used the same approach.
A GelSight sensor, pressed against each object manually, recorded how the contact pattern changed over time, essentially producing a short movie for each object. A neural network was then used to look for correlations between changes in contact patterns and hardness measurements. The resulting system takes frames of video as inputs and produces hardness scores with very high accuracy.
The researchers also designed control algorithms that use a computer vision system to guide the robot’s gripper toward a tool and then turn location estimation over to a GelSight sensor once the robot has the tool in hand.
“I think that the GelSight technology, as well as other high-bandwidth tactile sensors, will make a big impact in robotics,” says Sergey Levine, an assistant professor of electrical engineering and computer science at the University of California at Berkeley. “For humans, our sense of touch is one of the key enabling factors for our amazing manual dexterity. Current robots lack this type of dexterity and are limited in their ability to react to surface features when manipulating objects. If you imagine fumbling for a light switch in the dark, extracting an object from your pocket, or any of the other numerous things that you can do without even thinking — these all rely on touch sensing.”
The researchers presented their work in two papers at the International Conference on Robotics and Automation.
Wenzhen Yuan | Measuring hardness of fruits with GelSight sensor
Abstract of Tracking Objects with Point Clouds from Vision and Touch
We present an object-tracking framework that fuses point cloud information from an RGB-D camera with tactile information from a GelSight contact sensor. GelSight can be treated as a source of dense local geometric information, which we incorporate directly into a conventional point-cloud-based articulated object tracker based on signed-distance functions. Our implementation runs at 12 Hz using an online depth reconstruction algorithm for GelSight and a modified secondorder update for the tracking algorithm. We present data from hardware experiments demonstrating that the addition of contact-based geometric information significantly improves the pose accuracy during contact, and provides robustness to occlusions of small objects by the robot’s end effector.
references:
- Gregory Izatt, Geronimo Mirano, Edward Adelson, and Russ Tedrake. Tracking Objects with Point Clouds from Vision and Touch. (open access)
- Tactile sensor lets robots gauge objects’ hardness and manipulate small tools
- Tactile Sensor and Force Torque Sensor: What's the Difference?
- VizualPV3D (VizualPV3D is a Flash Visualization Application that provides a GUI interface to create and manipulate objects in 3
- Create and manipulate PDF documents - 100% .NET
- Gauge
- float, small and random
- Take (and Manipulate!) a Photo with a Web Page
- Big Endian and Small Endian
- TCP and UDP Small Servers
- Magento And Drupal : Small Tips
- COM Objects and Interfaces
- Interfaces and Scripting Objects
- Primitive Types and Objects
- Classes and Objects
- Defining Classes and Objects
- Primitive values and Objects
- Textures objects and parameters
- Mutable and Immutable Objects
- 全国淘宝村数量已超2100个 阿里巴巴打造乡村振兴新样本
- 深度学习 21天实战caffe
- 请求链接参数Base64加解密
- windows服务器之间自动传输问题解决过程
- groovy操作map,json
- Tactile sensor lets robots gauge objects’ hardness and manipulate small tools
- 会场安排 最少用几个会场 贪心
- 软件项目版本号的命名规则及格式
- 图像处理的一般流程(opencv)
- Entity Framework(1)基础类接口
- 二分查找算法,斐波那契数列的递归及非递归。(分析时间复杂度及空间复杂度)
- BigDecimal类型比较数字大小,invalue方法数值大于9位变成负数
- 脚本无法挂载软链接的问题
- 日志-php-fpm慢日志查询