Skip to content

Home Automation using Hand Gesture Recognition. Using YoloV8, Gold Yolo, RTMpose. Deploying on Rockchip SoC

License

Notifications You must be signed in to change notification settings

mimicosnsyc/Gesture-Based-Home-Automation

Repository files navigation

UNDER CONSTRUCTION...

Introduction

Controll smart home devices through gesture.

  • Multi person
  • Low lantency
  • Long distance

Install

Test on:

  • Ubuntu 22.04 on Orange Pi
  • Python 3.10.12
  • RKNPU driver: v0.9.2
  • librknnrt version: 2.0.0b0
pip install -r requirements.txt

Run

set frequency of cpu and npu

sudo ./performance.sh

demo

python demo.py

app

run

python app.py

quit

Ctrl + C

pause

curl -X POST https://localhost:5000/update_status -H "Content-Type: application/json" -d "{\"hasperson\": false}"

resume

curl -X POST https://localhost:5000/update_status -H "Content-Type: application/json" -d "{\"hasperson\": true}"

About Latency

  • Human Detection: ~50ms
  • Head & Hand Detection: ~20ms
  • Hand Pose: ~30ms

Credits

About

Home Automation using Hand Gesture Recognition. Using YoloV8, Gold Yolo, RTMpose. Deploying on Rockchip SoC

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published