Google teaches robots to recognize objects by interacting with their environment

Google teaches robots to recognize objects by interacting with their environment. Grasp2Vec is based on the intuition that an attempt to pick up anything provides several pieces of information— if a robot grasps an object and holds it up, the object had to be in the scene before the grasp.

On the left, the gripper is holding the brush and there are some objects (yellow cup, blue plastic block) in the background. On the right, the gripper is holding the yellow cup and the brush is in the background. If the left image was the desired outcome, a good reward function should “understand” that the two images above correspond to different objects.
We humans, are capable of recognizing our surrounding objects since our early age. This ability to interact with objects in our environments plays a vital role in the emergence of object perception and manipulation capabilities.

This also benefits us by teaching self-supervision- what actions we shall take and learn from the result. This is the case in humans, whereas, in robots, this capability is actually researched. It enables robots to learn without the need for large amounts of training data or manual supervision.


Considering the fact of object permanence, Google scientists now have proposed a new system called Grasp2Vec, an algorithm to gather object representation.
Grasp2Vec is based on the intuition that an attempt to pick up anything provides several pieces of information — if a robot grasps an object and holds it up, the object had to be in the scene before the grasp.
Eric Jang, Software Engineer, Robotics at Google and Coline Devin, Berkeley Ph.D. Student and former Research Intern wrote, “In robotics, this type of learning is actively researched because it enables robotic systems to learn without the need for large amounts of training data or manual supervision. By using this form of self-supervision, machines like robots can learn to recognize objects by visual changes in the scene.”
Collaborating with X Robotics, scientists taught a robotic arm to grasp objects unintentionally, and that experience enables the learning of a rich representation of objects. Those representations eventually led to “intentional grasping” of tools and toys chosen by the scientists.
Scientists then used reinforcement learning to encourage the arm to grasp objects by inspecting them using its camera and answer basic object recognition questions. They then implemented a perception system to extract meaningful information about the items by analyzing a series of three images: an image before grasping, an image after grasping, and an isolated view of the grasped object.
In tests, Grasp2Vec and the researchers’ novel policies achieved a success rate of 80 percent on objects seen during data collection and 59% on novel objects the robot hasn’t encountered before.
Scientists noted, “We show how robotic grasping skills can generate the data used for learning object-centric representations. We then can use representation learning to ‘bootstrap’ more complex skills like instance grasping, all while retaining the self-supervised learning properties of our autonomous grasping system. Going forward, we are excited not only for what machine learning can bring to robotics by way of better perception and control, but also what robotics can bring to machine learning in new paradigms of self-supervision.”

Journal Reference: arXiv:1811.06964

Source: Tech Explorist

Subscribe Newsletter

Name

Health,44,Nature,12,Science,94,Space,75,Technology,97,
ltr
item
Scien-Tech News: Google teaches robots to recognize objects by interacting with their environment
Google teaches robots to recognize objects by interacting with their environment
Google teaches robots to recognize objects by interacting with their environment. Grasp2Vec is based on the intuition that an attempt to pick up anything provides several pieces of information— if a robot grasps an object and holds it up, the object had to be in the scene before the grasp.
https://4.bp.blogspot.com/-pkms3fN9eNU/XBCod8xC-gI/AAAAAAAABVQ/7VQB78KzNWYfaPb19YjndeEf2TOC3D9bwCLcBGAs/s400/gripper-is-holding-the-brush.jpg
https://4.bp.blogspot.com/-pkms3fN9eNU/XBCod8xC-gI/AAAAAAAABVQ/7VQB78KzNWYfaPb19YjndeEf2TOC3D9bwCLcBGAs/s72-c/gripper-is-holding-the-brush.jpg
Scien-Tech News
https://www.scien-technews.com/2018/12/google-teaches-robots-recognize-objects-interacting-environment.html
https://www.scien-technews.com/
https://www.scien-technews.com/
https://www.scien-technews.com/2018/12/google-teaches-robots-recognize-objects-interacting-environment.html
true
8514685892313606732
UTF-8
Loaded All Posts Not found any posts VIEW ALL Readmore Reply Cancel reply Delete By Home PAGES POSTS View All RECOMMENDED FOR YOU LABEL ARCHIVE SEARCH ALL POSTS Not found any post match with your request Back Home Sunday Monday Tuesday Wednesday Thursday Friday Saturday Sun Mon Tue Wed Thu Fri Sat January February March April May June July August September October November December Jan Feb Mar Apr May Jun Jul Aug Sep Oct Nov Dec just now 1 minute ago $$1$$ minutes ago 1 hour ago $$1$$ hours ago Yesterday $$1$$ days ago $$1$$ weeks ago more than 5 weeks ago Followers Follow THIS PREMIUM CONTENT IS LOCKED STEP 1: Share. STEP 2: Click the link you shared to unlock Copy All Code Select All Code All codes were copied to your clipboard Can not copy the codes / texts, please press [CTRL]+[C] (or CMD+C with Mac) to copy