-
Notifications
You must be signed in to change notification settings - Fork 1
Commit
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
Description, features, usage instructions added
- Loading branch information
1 parent
ca78116
commit e26b4c0
Showing
1 changed file
with
30 additions
and
5 deletions.
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Original file line number | Diff line number | Diff line change |
---|---|---|
@@ -1,10 +1,35 @@ | ||
# HUE Vision 👀 | ||
This is a demo web application to try out TensorFlow.js.<br> | ||
The neural network model detects & learns to track your eye movement through your webcam. | ||
# HUE Vision: Eye Tracking using TensorFlow JS and clmtrackr | ||
|
||
HUE Vision is a web-based application that harnesses the power of eye tracking technology using web technologies and machine learning. This project serves as a demonstration of real-time gaze prediction directly in the browser. | ||
|
||
# Demo | ||
Check it out: https://simplysuvi.github.io/hue-vision/ | ||
|
||
## Features | ||
- Real-time eye tracking using the webcam | ||
- Integration of machine learning with clmtrackr.js for facial feature detection | ||
- Training and prediction of gaze direction using TensorFlow.js | ||
- Heatmap visualization for model evaluation | ||
|
||
## Technologies Used | ||
- JavaScript | ||
- TensorFlow.js | ||
- clmtrackr.js | ||
- HTML/CSS | ||
- jQuery | ||
|
||
## Getting Started | ||
1. Clone this repository to your local system. | ||
2. Open `index.html` in a web browser that supports getUserMedia (e.g., Chrome or Firefox). | ||
3. Follow the on-screen instructions to start the webcam and begin eye tracking. | ||
|
||
## How to Use | ||
1. Allow access to your webcam when prompted. | ||
2. Position your face within the webcam frame. | ||
3. Follow the instructions to start training the machine learning model. | ||
4. Use your gaze to interact with the screen in real time. | ||
5. Explore the heatmap visualization to evaluate the model's performance. | ||
|
||
## Instruction | ||
Open index.html in a browser like Chrome or Firefox and follow the instructions on screen. | ||
## Credits | ||
- This project was inspired by advanced eye tracking technologies such as Apple's Vision Pro. | ||
- Special thanks to the creators of [clmtrackr.js](https://github.com/auduno/clmtrackr) and TensorFlow.js for their invaluable contributions to computer vision and machine learning in the browser. |