How to use "Tobii Eye Tracker 4C" to communicate with a child who can not talk and move (SMA, CP, BAS)
The methodology is based on tracking the direction of view, which is carried out by the device "Tobii Eye Tracker 4C". A table with several pictures is displayed on the computer screen. If you hold your eyes on a separate picture, then the corresponding phrase will be sounded, for example, "drink", "turn on your side", "watch cartoons".
When a child learns letters, it will be possible to use more complex methods, such as typing the text with the eyes (see Habr.com/post/208108 )
What will be required (in a nutshell)?
2) light trekker - tracking device
3) free software (from the author of the article)
How it works?
1. Select the computer
2. Device Tobii Eye Tracker 4C
2.1 Mounting of the aytrekera on the monitor
3. Installing the software
3.1. Obtain the file TobiiGazeCore32.dll version ???.938 or newer
3.2. Driver installation and calibration
3.3. Installation and configuration of free software (from the author of the article)
???. Setting up the program for working in table mode
4. Using the program
5. How to change the contents of the table
And can you instead buy a complete system from a well-known manufacturer?
Greetings and thanks
So, download Tobii EyeX ??? ( Files.update.tech.tobii.com/engine/Tobii.EyeX_???.293.exe ) And start. We agree with the terms: put a tick and click the 'Next' button.
We are waiting
Finish, click "Finish".
After installation two files TobiiGazeCore32.DLL appeared. A newer one is in the "C: Program Files (x86) TobiiTobii EyeX" directory. This can be checked if you right-click on the file name and select "Properties" from the shortcut menu.
And then, on the "Details" tab, look at the version number:
Copy this file to a safe place, for example, create the BKB directory on drive C and put the file there:
Now you can uninstall the program Tobii EyeX - we took from it all that is needed.
In Windows 1? for that, press the "Start" button, then the appeared button with the gear.
Then select the section "Applications"
We find and delete everything that starts on "Tobii", by clicking on the "Delete" button:
tobiigaming.com/getstarted and click on the button "Tobii Eyetracking":
Then on the appeared button "Download":
Save the file (for the future), and then run it:
We put a tick, click the "Next" button:
We are waiting
Click the "Continue" button:
Then click the "Get Started" button:
Next it will be necessary to drag the lines on the screen with the mouse so that they coincide with the strips on the body of the aytracker:
When finished, click the "Done" button.
Then on the screen there will be two circles that illustrate whether the aytracker sees your eyes well.
If the circles are not in the center of the screen (as in the picture above), tilt the monitor to move them.
If the circles are large and cloudy - you are too close to the monitor.
If the mugs are small and muddy - you are too far from the monitor.
As I wrote above, the optimal distance from the monitor to the eyes is about 50 cm.
Next, the tracking engine begins.
If the child uses the childrens tracker, then the eyes of the child need to be calibrated !!
For a start, you can calibrate the device under your eyes, and then under the eyes of the child.
On the screen will appear blue dots, you will need to look at each of them in turn.
After you fix a look at one of the points, it will split into pieces, like the top dot in the picture above.
After finishing the calibration, enter the name of the person whose eyes were calibrated and press the "Save" button
Next, a game starts in which you move the eyes of the sight of the spaceship, and then shoot the asteroid with the space bar:
You can exit the game by clicking on the "Escape" button.
An icon with two circles representing the eyes will appear on the taskbar:
If the device sees only one eye, then tOnly one circle:
If the device does not find the eye at all, two crosses will be drawn:
IMPORTANT! To ensure that the programs do not interfere with each other's work, you need to disable the standard actions that the Tobii driver produces.
To do this, click on the icon with circles (1) and go to the Interactions (2) section in the opened menu:
In each of the sections (Touchpad, Mouse, Windows) switch all the switches to the "OFF" position:
If you want another person to work with the device, you need to perform calibration for his eyes too. To do this, again click on the icon with two circles, and then on the arrow to the left:
Then select the item "Create New Profile " (1) and repeat the calibration for the new person.
Switching between profiles of different people is done in the area below (2). The current profile is marked with a blue circle:
After that, click the "Download" or "View Raw" button
Save the file.
(if anyone is interested, there are also source codes in the C ++ language)
Create a directory "C: bkb" and copy the contents of the downloaded archive "bkb32c-Russian.zip".
Then copy the file "TobiiGazeCore32.dll" (see section 3.1.).
Should get the directory with these files and the subdirectory "grid":
In fact, you can choose another directory for the program, but it should not be a subdirectory of "Program Files ". The point is that the program saves the configuration file "config.bkb" in this directory, and the subdirectories "Program Files " are closed for writing. (Yes, I know that it was necessary to write in% AppData%, but so it happened historically).
If you see a message when you run the program that the msvcrt110.dll file is not found, then download and install "Microsoft Visual C ++ Redistributable for Visual Studio 2012 Update 4". You can take it here: www.microsoft.com/en-us/download/details.aspx?id=30679 .
sova.by ) From Belarus. Alexander also helped me with the collection of requirements and testing. The Foundation, among other things, organizes distance education for people with disabilities with subsequent employment. Sasha, hello and good luck to you!
It may be interesting
Situs QQ Online
Situs QQ Online