Blue eyes technology was developed by IBM research
center at Almaden. It consists of modern video cameras
and sensors. Blue eyes Technology is designed to provide
computers with clues on how a users "feels".
Blue eyes are working on determining a variety of information
from user through facial expressions, through eyes,
through voice and through its presence. Emotion mouse
uses various sensors to get information about the user
who is using mouse. SUITOR is a simple user interest
tracker, scroll point mouse is designed for the user
to scroll the screen up, down, or sideways without having
to steal his visual attention away from what he is currently
doing, MAGIC is a manual and gaze Input cascaded pointing
uses eyes in conjunction with hand to move the cursor
on the screen.
INTRODUCTION
Communication is often described as a two way street,
but the analogy of a multilane highway would be clor,?r
to the truth. People communicate by words and local
inflections by subtle bodily movements and nuances of
gaze, by touch and gesture, and even by uncontrollable
reactions like blushing or falling speechless.
By comparison, human - computer interaction is an impoverished
affair. The primary interfaces - a keyboard and pointing
device - not only force the user to master new techniques
but they restrict the range of the interaction, scientist
at IBM Research labs around the world are working on
a wide range of human computer interaction technologies
that are helping to make it easier to get computers
to do what we want them to do.
Human cognition depends primarily on the ability to
perceive, interpret and integrate audio visual and sensory
information. Adding extraordinary perceptual abilities
to computers would enable computers with human beings
as intimate partner. Thus Blue eyes Technology add more
capabilities to computer that will allow them to interact
like humans, recognize human presence, talk, listen
or even guess there feeling.
Broadly saying that, Blue eyes is aiming at creating
computational machines that have perceptual and sensory
abilities like those of Human beings.
BLUE EYE TECNOLOGY
THE TECHNOLOGY
The Blue Eye Technology uses non obtrusive sensing
methods, employing most modern video cameras and microphones
to identify the user's action through the uses of imparted
sensory abilities. The machine can understand what a
user wants, where he is looking at, and even realise
physical or emotional states. The valance extraction
is related to the emotions.
The three studies made by different scientist make
an attempt to quantify emotions Peter Lang Explored
the use of slodes to induce emotion in subjects. He
than assigned and arousal co-ordinates to each picture
and mapped them in two dimentional spce. Ward Winton,
Lios Potnam and Robert Krauss added Heart rate sensors
(HR) and galvanic skin conduction detectors (SC) to
subject, viewing simiar evocative slide. Winton, Putnam
and Krauss correlated their slides pleasantness against
the measure HR and SC of the subject. Dr Manfred Clynes
asked his subjects to remember and relive past emotional
experiences while collecting senatic data from his subjects.
Combining test of all 5 of these researcher provide
a new technique for measuring the valance of the stimulus.
The work of Dr. Clynes illustrates that valence can
readily be extracted from senatic data and the work
Waston, Putnam and Krauss demonstrates the valence information
exists in the acceleration of Heart rate.
VIDEO CAMERAS
The basic feature of Blue Eyes Technology is the video
camera used is the most advanced and uses very important
technologies i.e. charge coupled Device Technology.
EVOLUTION OF CCD
The charge couple Device (CCD) was Invented in the
late 1960 by researchers at Bell Laboratory, originally
conceived as a new type of Computer memory circuit,
it soon become apparent that the CCD had many other
potential applications, including signal processing
and imaging.
CCD'S being on a thin wafer of silicon processed with
a series of steps that define the various functions
with the circuit. On each wafer lie several identical
devices, or die, each capable of yielding a functional
device. Selected die are then cut from the wafer and
packed in a carrier for use in a system. Like the engine
of a car, the CCD sensor in a digital camera act as
the primary tool to capture an image in its most elementary
form. The CCD sensor is like the camera's" Electronic
Eye" - collecting light and converting it to charge
and susequently emitting the signal that results in
a digital image. The CCD is shown below :
WORKING : IMAGE CAPTURE
There are different methods by which the image is captured
by CCD sensors. But for the Blue Eye Technology the
full frame image capture technique is used. It allows
more charge capacity better dynamic range, reduced noise
and delivery of optical resolution.
Full frame CCDS consist of a parallel CCD shift register,
a serial register and a signal sensing output amplifier
in a full frame CCD, the exposure is controlled by a
mechanical shutter or strobe to preserve scene integrity,
because a parallel register is used for both scene detection
and read out.
Images are optically projected on to the parallel arrays,
which acts as the image plane. The device takes the
scene information and partition it into discrete elements,
which are defined by the number of pixels "quantizing"
the scene. The resulting rows of information are then
shifted in a parallel fashion to the serial registers
which shifts the information to the output as a serial
stream of data. This process repeats untill all row
are transferred off the chip.
After the image is captured, the energy associated
with each pixel is absorbed by the silicon and a reaction
takes place that creates an electron hole charge pair.
The number of electrons collected at each pixel is linearly
dependent on light level and exposure time and non linearly
dependent on wavelength.
SPECIAL FEATURES
The camera's used have increased blue channel reaponse.
This is done by leveraging Indium Tin Oxide (ITO), an
advanced technology to replace the polysilicon sensor
in digital cameras.
The key benefit of the ITO sensor is its ability to
increase spectral response from the camera allowing
two and one half times more blue light to reach the
sensor. Therefore improving the colour accuracy and
reducing image noise.
COMPUTER PROJECTS
The blue eyes technology proposes various revolutions
in computing devices these are explained below.
EMOTION MOUSE
The need of an hour is to design an adaptive smart
computer system that could possibly recognize your face
gestures, speed and even track your eye. An alternative
approach to gather personal information through touch
. A smart computer can gain information about the user
through touch via a special mouse and determine his
emotional state, which in turn is related to the task
user is currently involved in with the computer.
Emotional aspect of a person are critical for rational
decision making In other words, emotion detection is
the best approach to an adaptive computer system by
imparting the computer a longitudenal understanding
of emotional state of the user, it could adapt a working
style that fit's well users requirements.
THE OPERATION
The computer will determine the emotional state the
user when he simply touches the mouse. Sensors in themouse
sense the physiological attributes which, intern, are
related to the personal emotional state. The changes
in the temperature of the fingers also form a reliable
measure for prediction of the users emotion.
The other physiological measures that may affect the
emotions of the user are
A) HEART RATE
Heart rate is the frequency at which the heart generates
impulses.
B) GALVANIC SKIN RESPONSE
In response to an external stimulus (stimulus is anything
which excites functional activity in an organ or part),
such as touching a sharp points the resistance of skin
response.
C) GALVANIC SOMATIC ACTIVITY (GSA)
The activities of afferent nerves that carry sensory
information from the sensors on the skin to the brain
is called as galvanic somatic activity.
D) BLOOD PRESSURE
This is the pressure exerted by the blood vessel walls
usually refers to the pressure within the arteries.
Heart rate are measured through a chest strap sensor.
GSA samples are taken through the mouse driver. GSR
sample through finger tips. Blood pressure through blood
pressure sensor (BVP) which the user have to wear.
ADVANTAGE
Today, most computer users spend three fourth of their
time scrolling through the screen using the input device,
mouse, thus using emotion mouse this time is reduced
to a large extend.
SUITOR
The need of the present scenario is to develop intimate
relationship between the computer and humans. And the
simple user interest trackers (SUITOR) is a revolutionary
approach in this direction.
By observing the webpage a netizen is browsing, the
suitor can help fetch more related information at his
desktop. By simply noticing where the users eyes focus
on the computer screen the SUITOR can be more precise
eyes focus on the computer screen the SUITOR can be
more precise in determineing his topic of interest.
If can even deliver relevant information to a handheld
device.
SUITOR WORKING
SUITOR fills a scrolling ticker on a computer screen
with information related to the users current task.
SUITOR knows where you are looking what application
you are working and what web pages you may browsing.
If we are reading a webpage about something and If we
need to read the heading off the ticker, it pops up
the story in a Browser window. If we start to read the
story it adds related stories to the tickes. That's
the whole idea of an attentive system. One that attends
to what you are doing, typing, reading. So that it can
attend to yours information need. (Ticker is a type
of watcher, or a type machine)
SCROLL POINT MOUSE
IBM'S scroll points mouse is one of the latest example
of the products emerging from its activity. The scroll
point mouse was originally designed to satisfy the underlying
principles of a good user interface. The user interacts
with his computer, and computer understands his interests
based on what he is doing.
The scroll point mouse allows the user to scroll the
screen up, down, or sideways, without having to steal
his visiual attention away from what he is currently
doing. The user needs not fiddle with scroll bars or
move the window up and down, nor will he have to divert
his attention frequently for doing such acts.
OPERATION
The solution which was driven by intensive human factors
studies was to put a scrolling joystick on the mouse
itself. The saddle shaped control responds to finger
pressure exerted forward or backward, as well as left
or right. The finger can be easily positioned on it
without looking at the mouse. It is also very efficient
because it embodies the concept of rate control. The
harder you push the faster the document scroll.
The first model came out in 1997 An improved version,
with control resolution and continuous scrolling, was
shipped at the end of 1999. And the scroll point program
relation 2000 adds a scupled shape for greater comfort.
MAGIC
Another technology termed as magic (manual and gaze
input cascaded) pointing used eyes in conjuction with
hands. When the user stares at a specific area on the
screen and touches the mouse simulteneously the cursor
moves automatically to the area that the user is currently
looking at with an accuracy of 1.27 cm (0,5 inch). In
this the gaze tracking camera follow your eyes, but
your fmgures have to be involved as well. When you use
gaze initiated cursor, you just look at the screen and
touch the input device and the cursor moves close to
where you are looking and then you make the final adjustment
with the input device.
FUTURE
FUTURE APPLICATION
1. The Massachusetts institute of Technology (MIT)
is currently involved in project called 'oxygen' being
a personal network composing both hardware and software,
oxygen sits atop the global network. Each unit has a
small screen, camera, GPS module. Handy 21 mobile phone,
infrared detector, handy radio and a network connected
device that needs to be programmed as per requirement.
2. This technology is endless ranging from the voice
operated lighting system at your house hold to the most
advanced aeroplanes that can communicates with the pilot.
CONCLUSION
The Blue eyes technology is convenient way of simplifying
the life by more delicate and user friendly facilities
in computing device. The day is not far when this technology
will push its way into your house and making human work
easy.
Contributor: Pradeep Jha is a Student of B.
Tech, at NIT, Patna
