Skip to content

A-Frame AI wants to make it super easy to create Extended Reality prototypes powered by AI.

Notifications You must be signed in to change notification settings

aframeai/aframe-ai

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

3 Commits
 
 

Repository files navigation

The idea of aframe-ai is to lower the entry-barrier for designers, students and the general public to explore ideas and create prototypes powered by AI.

A-Frame as Artificial-Intelligence-Simulator

A-Frame can act as an AI-Simulator like this:

  1. Capture input:
    • capture images from the current VR-scene
    • capture images from the web cam looking at the user
    • capture audio from the user
    • capture audio from the current VR-scene
  2. Send the input to a machine-learning service
  3. Use the result to:
    • control non-human-players / robots
    • simulate assistive technology in the browser

Ideas

This repo will showcase some examples of this approach...

  • Assistive-Aframe — AI describing the virtual world to vision-impaired users
  • Voice-Control — Use your voice to navigate a virtual world
  • Head-Control — Move your head to navigate a virtual world

About

A-Frame AI wants to make it super easy to create Extended Reality prototypes powered by AI.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published