The project is devoted to creation of camera based human-computer interface software.
This software is designed primarily for the persons that are unable to use conventional
means of HCI (keyboard, mouse), for example for children suffering from cerebral palsy.
The requirements are the following: the equipment required must be cheap and simple in use;
the software should function on a regular home computer in parallel with conventional user
interface devices. The first version of software includes special marked helmet for the user,
to ease the head orientation calculation. The system with no additional gear for the user to
wear is under development right now.
Project
tasks include:
- Object tracking, face tracking;
- Facial features detection and tracking;
- Facial expression recognition;
- Optical flow calculation;
- Calculation of head orientation from 2D facial
features positions;
- Transformation of head orientation information into cursor movement.
Publications
-
V. Vezhnevets "Method For Localization Of Human Faces In Color-Based Face Detectors And Trackers" to appear in The Third International Conference "Digital
Information Processing And Control In Extreme Situations" May 28-30,
2002, Minsk, Belarus.
.pdf (83kb)
.ps.gz (123kb)
- V. Vezhnevets "Face and facial feature tracking for
natural Human-Computer Interface" to appear in "Graphicon - 2002"
September 16 - September 21, 2002, Nizhny Novgorod,
Russia.
.pdf (513kb)
.ps.gz (276kb)
The project team:
Principal researcher
Researchers:
- Stanislav Soldatov
- Ivanov Petr
- Sazonov Vasiliy
Fig 1. Face tracking
|
 |
Fig 2. Head orientation estimation by facial features |
|