Microsoft PixelSense is the most revolutionary technology in which not only touch but also real objects can be recognized. It is basically a combination of software and hardware that provides a natural user interface for better interaction with the device.
Microsoft PixelSense was initially released as Microsoft Surface. Both hardware and software were provided by Microsoft. The current version of PixelSense is Samsung SUR40 for Microsoft PixelSense, which is a partner product of Microsoft and Samsung.
The technology is designed especially for companies that encounter a lot of public interaction. It allows companies to provide their customers with a better shopping experience. Customers can interact with products through direct touch interactions and by placing objects on the screen. The system is capable of identifying objects of different sizes, shapes and patterns. Based on the identified object, the system invokes a command to the processing unit.
The biggest advantage of PixelSense is that it doesn’t require the use of traditional input devices like mouse, keyboard, camera, etc. It is designed to accommodate various numbers of users at the same time. It can detect up to 52 keys simultaneously, taking device usage to the next level, far beyond the limitations of single-user devices.
How does it work?
Microsoft PixelSense is capable of identifying fingers, hands, and objects placed on the display device. Enables vision-based interaction without the need for a camera. Each individual pixel on the device is capable of identifying activities such as touching and objects placed on the screen and transmitting the received input to the processing unit. The processing unit interprets the received input very quickly and returns the desired output faster than the blink of an eye. According to the official Microsoft PixelSense site, this technology works in the following steps:
- The display device identifies a contact, be it a touch or an object.
- An IR light source located on the back provides light that passes through the optical sheets, LCD screen, and protection glass and ultimately strikes the contact.
- IR rays reflect off the contact and are identified by the integrated sensors
- The sensors convert IR signals into electrical signals.
- A large number of these pixels work together to create an image of whatever is placed on the screen.
- The image is analyzed using image processing techniques.
- The output is sent to the PC. Includes correct sensor image and various types of contact (finger/smudge/label)