Gesture Game Demo using ML Agent

Gesture Game Demo in Unity3D, Dynamic Gesture Recognition using ML Agent

Game(final release version) demo screenshot(video link)

Screenshot(video link)

Game(demo) purpose: Draw gesture by mouse(It is possible to change Leap motion, VR Controller and mobile(Android/iOS) and kill zombies.

Features

1. Dynamic Gesture Recognition based Deep Neural Networks
2. Model Serving using ML Agent
3. Unity3D Game Demo(*.exe link)

Information

1. Collected gesture data using leap motion
2. With main pivot(etc..head direction,front direction), you can use gestures in 3D space.
3. Final release version is diffrent form(current demo : DNN based, final release version: K-NN(1$ recognizer) based, only demo!!)

Setup

1. Install Unity3D(version>=2018)
2. Run unity and play projects

Baseline gesture recognition algorithm

https://github.com/jhcnode/Dynamic-Gesture-Recognition-in-3D-space

Reference

Chae, Ji Hun, et al. "Deep Learning Based 3D Gesture Recognition Using Spatio-Temporal Normalization." Journal of Korea Multimedia Society 21.5 (2018): 626-637.