This project will aid in the development of measurement science and standards to enable advancements in planning by robots in scenarios relevant to manufacturing, starting with kitting and aiming towards assembly. Plans enable a robot to change its actions to deal with uncertainty in its environment and to rapidly switch to new tasks. Plans are based on models of the current environment, predictions about the future, and a priori knowledge of causal relationships between current actions and results. The breadth and usability of knowledge in these models is one of the main factors that constrains the flexibility and performance of manufacturing planning systems. Currently, there is no accepted standardized way to represent this knowledge, to reason with this knowledge, or to measure the performance of these systems.
To develop the measurement science and standards for planning and modeling by robots so that they are able to be more quickly re-tasked and are more flexible and adaptive by the end of FY2014.What is the new technical idea?
The new technical idea is to aid in the development of standard data abstractions for maintaining and sharing knowledge of the world and planning actions in it. Performance measurement techniques and artifacts will be developed to enable manufacturers to use these standards and abstractions in a cost-effective manner. The lack of sensor processing to detect objects in the world and details about environmental conditions as well as an abstraction that is capable of storing and reasoning over this knowledge has led current manufacturing robots to have little or no understanding of the world around them and no capability to dynamically change their actions if the environment changes. This restricts them to operate in highly constrained environments and makes it difficult to change from one task to another. The Robot Perception for Identifying and Locating Parts for Assembly and Robot Perception for Workspace Situational Awareness projects are addressing the sensor processing aspects of this problem. This project is addressing the knowledge abstraction aspects of the problem. The primary challenges that may be solved by a unified knowledge abstraction are:
Initially, an open-source simulation engine is being used to simulate plan execution in content rich worlds. This will be augmented to include semantic labels and virtual sensors capable of detecting and reporting relevant environmental features. Repeatable scenarios will allow for the comparison of planning systems that are capable of exploiting this rich content. In FY2014, work in the project will migrate to real robotic hardware.What is the research plan?
While knowledge abstractions are needed across manufacturing, a program-wide decision was made to start addressing the problem by focusing on assembly, and in particular on the bin-picking problem. This project will focus on a generalization of the bin-picking problem known as kitting. The use of kitting allows us to model bin-picking from multiple bins, as well as complex planning and optimization needed for the construction of kits. The techniques developed here will be directly applicable to the general assembly problem. The work focuses on three key areas:
Knowledge Representation: Perform research into knowledge abstractions that will aid in the development of standard representations for world knowledge and plan knowledge, and the related performance evaluation criteria. We will design a comprehensive model that is able to represent knowledge for the general class of manufacturing problems in the area of rapid re-tasking for general assembly tasks. We will work in cooperation with the IEEE Standards Working Group on Knowledge Representation for Robotics and Automation to create a standard for knowledge representation for robotic applications and will provide a test implementation of the proposed standard to validate its usability. We will also derive methods of defining the performance requirements for the knowledge and will develop performance methods and metrics.
Planning: Develop methods to compare planning algorithms that utilize the representations developed above to address next generation robotics for the class of manufacturing problems in the area of adaptable and reconfigurable assembly. Under this task, we will examine input/output standards and performance measures for planning systems.
Simulation: Develop a simulated manufacturing test method that is capable of verifying the performance of rapid re-tasking using our performance measures. This test method will validate the utility of our interfaces and performance measures. In order to populate the semantic world representation, the existing simulation system (called USARSim) will be augmented and expanded to include new virtual sensing and representation capabilities. The simulation system will provide representations that are not yet possible to obtain from the real sensing systems. It therefore provides a high-fidelity but more advanced testbed for developing performance requirements and validating test methods.Recent Results:
Standards and Codes:
We are working with the NIST-led IEEE Working Group on Knowledge Representation for Robotics and Automation. As part of this project’s efforts, we are working with industry to produce new standards and performance measures for Knowledge Representation.
Simulated view of the NIST Manufacturing Test Bed
Start Date:October 1, 2011
Lead Organizational Unit:el
Related Programs and Projects:
Stephen Balakirsky, Project Leader