Skip to content

Multi-agent task planner for collaborative human-robot assemblies

Notifications You must be signed in to change notification settings

robsndr/assembly-planner

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Assembly Planner

The assembly planner provides a performant framework that can be used for allocating workloads in collaborative human-robot assembly planning problems. It employs AND/OR graphs to model industrial assembly procedures, and differentiates between agents using cost functions.

Description

The combination of human cognitive reasoning with skills of industrial robots makes it possible to utilize robots as collaborative agents in increasingly complex environments. In the following, an industrial assembly process is considered, where most of the tasks can be done by singular entities, but some might require assistance from other agents. AND/OR graphs are used as an abstract world model, with AND/OR nodes representative for tasks [actions] and stages of the assembly process [subassemblies] respectively. A full assembly plan is obtained, when all possibilities of how to assemble an object are introduced into the AND/OR model. A small-scale example of an assembly plan P is illustrated here, with rectangular nodes used to depict subassemblies, and round nodes mapped to actions.

The planning problem strives to find a sub-graph of the top-level assembly plan, with an optimal agent-action assignment and maximum task parallelism. The search is driven by a cost function, that can be used to model the various abilities of different agents. For example, if a4 in P denotes the task of lifting an object, the cost might be high or infeasible [inf] for a human, but quite cheap for a robot. An example cost function for a scenario with 2 robots [r1, r2], 1 human h1 and assembly P is provided below:

a1 a2 a3 a4 a5 a6 a7 a8 a9 a10 a11 a12
r1 inf inf inf 10 15 20 10 inf 20 10 10 10
r2 inf inf inf 20 5 10 5 5 20 10 10 10
h 50 50 50 200 50 30 40 100 50 50 100 100

For some cases, even though an agent can perform a given task, it might need some assistance to do so. Let's suppose that a certain tool is required to deal with the H subassembly in P, before executing task a12. Agent r1 might not be equipped with that component, making a12 only feasible for r2 under the assumption that r1 or h provide support. This ability of agents to directly deal with subassemblies is regarded as reachability, with possible assistance modeled as interactions. An example specification of reachability for the H subassembly with the corresponding interaction cost is shown below:

Reachability Interaction
H
Reach r1 i0
Reach r2
Reach h
i0
r1 inf
r2 12
h 10

The search for the optimal solution is executed in an online manner, using a divide-conquer approach to handle the combinatorial explosion of the search space. An example input assembly is provided under ./example/assembly.xml, with the corresponding output in ./example/output.xml. A visual representation of the optimum plan found for the example assembly is shown here.

Getting Started

The assembly planner depends on the argparse and tinyxml2 C++ libraries, which are referenced in the repository as submodules.

$ git clone [email protected]:symm3try/assembly-planner.git --recurse-submodules

Running

The seach itself can be run either directly on a host, or within a docker container.

$ cmake . && make
$ ./planner ./example/assembly.xml ./example/plan.xml

Running using Docker:

$ docker build -t planner .
$ docker run --rm -v ${PWD}/example/:/data planner /data/assembly.xml /data/plan.xml

Acknowledgments

[1] L. S. Homem de Mello and A. C. Sanderson, “And/or graph representation of assembly plans,” Robotics and Automation, IEEE Transactions on, vol. 6, no. 2, pp. 188–199, 1990
[2] L. Johannsmeier and S. Haddadin, "A Hierarchical Human-Robot Interaction-Planning Framework for Task Allocation in Collaborative Industrial Assembly Processes," in IEEE Robotics and Automation Letters, vol. 2, no. 1, pp. 41-48, Jan. 2017
[3] L. S. H. De Mello and A. C. Sanderson, “A correct and complete algorithm for the generation of mechanical assembly sequences,” Robotics and Automation, IEEE Transactions on, vol. 7, no. 2, pp. 228–240, 1991

About

Multi-agent task planner for collaborative human-robot assemblies

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published