Logo Questions Linux Laravel Mysql Ubuntu Git Menu
 

Eye-tracking for code editing

Is there a decent eye tracking package to replace the mouse for code editing?

I want to free up the mouse, but keep using my keyboard for editing code.

Having done some research on it, I concluded that proper eye tracking hardware is expensive. Using a webcam or high resolution video camera seems to be the most viable option.

Unfortunately, image-based tracking (as opposed to infra-red tracking) restricts the accuracy, and so not all features might be practical.

Desired eye-tracking IDE features:

  • Page scrolling
  • Tab selection
  • Setting cursor position
  • Selecting gaze-focused text with keyboard

A similar question recommends Opengazer for webcams, but I am particularly interested in speeding up basic text-editing. Any recommendations are appreciated, especially if you have experience with eye tracking and practical use cases.

like image 745
Petrus Theron Avatar asked Apr 01 '10 16:04

Petrus Theron


People also ask

How is eye tracking used in language?

In the field of linguistics, eye-trackers are generally used for measuring fixations (i.e., temporal pauses on a single location), saccades (i.e., rapid movement of the eyes from one fixation to another), and pupil size (Hepach, Vaish, & Tomasello, 2015. (2015).

Which software is used in eye tracking?

GazeParser / Simple Gaze Tracker.

How do you do the eye track on the computer?

Use Windows 10 eye control To turn on eye control, go to Settings > Ease of Access > Eye control and turn on the toggle.

What is eye tracking in usability testing?

Eye tracking is, simply, the observation and recording of eye behaviour such as pupil dilation and movement. It has applications in many areas, including psychological research and packaging design, but with regards to screen-based media, it's primarily used by researchers to identify where users are looking.


3 Answers

The kind of accuracy you're looking for is pretty difficult to achieve (Since text tends to be pretty small).

IR tracking is actually pretty easy to accomplish. A few IR LEDs and an IR camera (which is really just a normal camera with different filters) and your pupil lights up (This can be done with under $100, more if you want a better camera though).

It's the head tracking that might be more of an issue.

You end up with quite a few degrees of freedoms that you need to track and your inaccuracies will just build up.

like image 174
CookieOfFortune Avatar answered Oct 20 '22 07:10

CookieOfFortune


I'm pretty sure there is no out-of-the-box solution for problem, but on eyewriter.org there are really nice instructions how to build your own eye-tracker. It's accurate enought to let someone "draw" graphities using only his eyes. so it should be possible to convert the eye-movements into mouse-events.

like image 36
Nikolaus Gradwohl Avatar answered Oct 20 '22 06:10

Nikolaus Gradwohl


It can be done reasonably accurately (al la this article on how people read code) but i've never seen a commercial product that does what you're asking for

Maybe take a look at Emotiv's headsets, they use thought patterns to perform tasks. They're designed for games but you can probably repurpose it for normal tasks

like image 2
Dave L Avatar answered Oct 20 '22 07:10

Dave L