Functional Object-Oriented Network for Manipulation Learning

Document Type

Conference Proceeding

Publication Date

10-2016

Keywords

videos, merging, robots, mirrors, neurons, object oriented modeling, visualization, manipulation motion sequences, functional object-oriented network, manipulation learning, structured knowledge representation, FOON, functional-related objects connectivity, manipulation tasks, graphical model, object state change, human manipulations

Digital Object Identifier (DOI)

https://doi.org/10.1109/IROS.2016.7759413

Abstract

This paper presents a novel structured knowledge representation called the functional object-oriented network (FOON) to model the connectivity of the functional-related objects and their motions in manipulation tasks. The graphical model FOON is learned by observing object state change and human manipulations with the objects. Using a well-trained FOON, robots can decipher a task goal, seek the correct objects at the desired states on which to operate, and generate a sequence of proper manipulation motions. The paper describes FOON's structure and an approach to form a universal FOON with extracted knowledge from online instructional videos. A graph retrieval approach is presented to generate manipulation motion sequences from the FOON to achieve a desired goal, demonstrating the flexibility of FOON in creating a novel and adaptive means of solving a problem using knowledge gathered from multiple sources. The results are demonstrated in a simulated environment to illustrate the motion sequences generated from the FOON to carry out the desired tasks.

Was this content written or created while at USF?

Yes

Citation / Publisher Attribution

2016 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), Daejeon, 2016, p. 2655-2662.

Link to Full Text

Share

COinS