Skip to content

Commit

Permalink
Description, features, usage instructions added
Browse files Browse the repository at this point in the history
  • Loading branch information
simplysuvi authored May 3, 2024
1 parent ca78116 commit e26b4c0
Showing 1 changed file with 30 additions and 5 deletions.
35 changes: 30 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,10 +1,35 @@
# HUE Vision 👀
This is a demo web application to try out TensorFlow.js.<br>
The neural network model detects & learns to track your eye movement through your webcam.
# HUE Vision: Eye Tracking using TensorFlow JS and clmtrackr

HUE Vision is a web-based application that harnesses the power of eye tracking technology using web technologies and machine learning. This project serves as a demonstration of real-time gaze prediction directly in the browser.

# Demo
Check it out: https://simplysuvi.github.io/hue-vision/

## Features
- Real-time eye tracking using the webcam
- Integration of machine learning with clmtrackr.js for facial feature detection
- Training and prediction of gaze direction using TensorFlow.js
- Heatmap visualization for model evaluation

## Technologies Used
- JavaScript
- TensorFlow.js
- clmtrackr.js
- HTML/CSS
- jQuery

## Getting Started
1. Clone this repository to your local system.
2. Open `index.html` in a web browser that supports getUserMedia (e.g., Chrome or Firefox).
3. Follow the on-screen instructions to start the webcam and begin eye tracking.

## How to Use
1. Allow access to your webcam when prompted.
2. Position your face within the webcam frame.
3. Follow the instructions to start training the machine learning model.
4. Use your gaze to interact with the screen in real time.
5. Explore the heatmap visualization to evaluate the model's performance.

## Instruction
Open index.html in a browser like Chrome or Firefox and follow the instructions on screen.
## Credits
- This project was inspired by advanced eye tracking technologies such as Apple's Vision Pro.
- Special thanks to the creators of [clmtrackr.js](https://github.com/auduno/clmtrackr) and TensorFlow.js for their invaluable contributions to computer vision and machine learning in the browser.

0 comments on commit e26b4c0

Please sign in to comment.