Devine et al., 2016 - Google Patents

Real time robotic arm control using hand gestures with multiple end effectors

Devine et al., 2016

Document ID
15655511926283714358
Author
Devine S
Rafferty K
Ferguson S
Publication year
Publication venue
2016 UKACC 11th International Conference on Control (CONTROL)

External Links

Snippet

This article describes experiments that explore the possibility of using an optical tracking device input to remotely control dual-arm robots. We propose using the Leap Motion controller as an alternative to using joysticks, this allows for more intuitive 6-DOF control …
Continue reading at ieeexplore.ieee.org (other versions)

Classifications

    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1674—Programme controls characterised by safety, monitoring, diagnostic
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1679—Programme controls characterised by the tasks executed
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/40—Robotics, robotics mapping to robotics vision
    • G05B2219/40053—Pick 3-D object from pile of objects
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00—Program-control systems
    • G05B2219/30—Nc systems
    • G05B2219/39—Robotics, robotics to robotics hand
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J9/00—Programme-controlled manipulators
    • B25J9/16—Programme controls
    • B25J9/1656—Programme controls characterised by programming, planning systems for manipulators
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B25—HAND TOOLS; PORTABLE POWER-DRIVEN TOOLS; MANIPULATORS
    • B25J—MANIPULATORS; CHAMBERS PROVIDED WITH MANIPULATION DEVICES
    • B25J13/00—Controls for manipulators
    • B25J13/08—Controls for manipulators by means of sensing devices, e.g. viewing or touching devices
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING; COUNTING
    • G06F—ELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G05—CONTROLLING; REGULATING
    • G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B19/00—Programme-control systems
    • G05B19/02—Programme-control systems electric

Similar Documents

Publication Publication Date Title
Rosenberger et al. Object-independent human-to-robot handovers using real time robotic vision
Muelling et al. Autonomy infused teleoperation with application to brain computer interface controlled manipulation
Li et al. Survey on mapping human hand motion to robotic hands for teleoperation
Rakita et al. A motion retargeting method for effective mimicry-based teleoperation of robot arms
Devine et al. Real time robotic arm control using hand gestures with multiple end effectors
Edsinger et al. Human-robot interaction for cooperative manipulation: Handing objects to one another
Natale et al. A sensitive approach to grasping
Laghi et al. Shared-autonomy control for intuitive bimanual tele-manipulation
Fritsche et al. First-person tele-operation of a humanoid robot
Meeker et al. Intuitive hand teleoperation by novice operators using a continuous teleoperation subspace
Nakanishi et al. Towards the development of an intuitive teleoperation system for human support robot using a VR device
Micelli et al. Perception and control challenges for effective human-robot handoffs
Gorjup et al. An intuitive, affordances oriented telemanipulation framework for a dual robot arm hand system: On the execution of bimanual tasks
Hirschmanner et al. Virtual reality teleoperation of a humanoid robot using markerless human upper body pose imitation
Yang et al. Real-time human-robot interaction in complex environment using kinect v2 image recognition
Toh et al. Dexterous telemanipulation with a multi-touch interface
JP7035309B2 (en) Master-slave system
Chen et al. Development of a user experience enhanced teleoperation approach
Liu et al. Virtual reality based tactile sensing enhancements for bilateral teleoperation system with in-hand manipulation
Zhou et al. A bilateral dual-arm teleoperation robot system with a unified control architecture
Hertkorn Shared grasping: A combination of telepresence and grasp planning
SaLoutos et al. Towards robust autonomous grasping with reflexes using high-bandwidth sensing and actuation
Chen et al. Human-aided robotic grasping
Chan et al. Implementation of a framework for learning handover grasp configurations through observation during human-robot object handovers
Shi et al. Application of visual servoing and eye tracking glass in human robot interaction: A case study