iXBT Labs - Computer Hardware in Detail

Platform

Video

Multimedia

Mobile

Other

Latest News


 « Previous Day News Archive  

Sony Develops SmartAR Integrated Augmented Reality Technology

Sony has developed integrated Augmented Reality technology' called 'Smart AR.' When capturing visuals through a camera on a device such as a smartphone, the technology enables additional information to be displayed on the device's screens such as virtual objects, or images and texts that cannot be identified by visual perception alone.


Video clip courtesy of Sony

The technology employs the markerless approach, forgoing any requirement for special markers such as 2D barcodes. The object captured by the camera is quickly recognized and can be tracked at high-speed along with the movement of the camera, as it is displayed over the actual 3D space.

Sony began researching AR in 1994 with two-dimensional barcodes recognition (marker approach), and in 1998, it developed VAIO 'PCG-C1' personal computers equipped with software which automatically recognized 'CyberCode.'

SmartAR combines object recognition technology (markerless approach in which no special markers are required) for recognition of general objects such as photographs and posters with Sony's own proprietary 3D space recognition technology, which has been fostered through the research of robots such as AIBO and QRIO. With SmartAR, objects can be recognized and tracked at high-speed. In addition to displaying virtual objects or additional image or text information (hereafter, 'AR information'), the technology also facilitates the expression of AR information over an extended space, thus producing a dynamic, large-scale AR experience.

Furthermore, information can be acquired or navigated by simply touching the AR information directly on the screen of the smartphone or other device.

Main features:

  1. Object recognition that enables the markerless approach.
    AR information can be displayed on the captured image which appears on a device's screen, including those images that do not have any special markers for AR. This technology is also compatible with image recognition technologies that use conventional markers (such as CyberCode). Because SmartAR can recognize everyday objects such as posters and menus, it has the potential for a wide variety of applications.
    SmartAR object recognition technology identifies objects by analyzing features detected from a portion of the image ('local features') together with their positional relationship. Sony's feature matching technology that employs a proprietary probabilistic method that matches local features with minimal calculations enables high-speed recognition that is resistant to changes in lighting or the position of the object. In addition, recognition is still possible even if the object captured appears to be comparatively small in the display.
  2. High-speed tracking.
  3. 3D space recognition.
    With Sony's dynamic, large-scale AR, virtual objects can be merged with 3D structures detected in the physical world. For example, even if the AR image is a gigantic virtual character whose size exceeds the dimensions of the device's screen, the technology allows the user to grasp the entirety of the virtual character when the camera is moved around. Furthermore, it is also possible to move the virtual object in the actual 3D space as if it were really there.
    Three-dimensional space recognition technology is based on use of the disparity observed by the camera movements to estimate the shape of the 3D space and the position and angle of the camera. By combining this with object recognition technology, devices become capable of identifying and remembering 3D space constructions.
  4. AR interaction.
    Information can be intuitively acquired and navigated by directly touching the AR information displayed on the smartphone or device's screen. The distinctiveness of SmartAR technology comes from the user interface which enables users to naturally use and operate additional information and virtual objects.

Source: Sony


 « Previous Day News Archive  

Write a comment below. No registration needed!




blog comments powered by Disqus

  Most Popular Reviews More    RSS  

AMD Phenom II X4 955, Phenom II X4 960T, Phenom II X6 1075T, and Intel Pentium G2120, Core i3-3220, Core i5-3330 Processors

Comparing old, cheap solutions from AMD with new, budget offerings from Intel.
February 1, 2013 · Processor Roundups

Inno3D GeForce GTX 670 iChill, Inno3D GeForce GTX 660 Ti Graphics Cards

A couple of mid-range adapters with original cooling systems.
January 30, 2013 · Video cards: NVIDIA GPUs

Creative Sound Blaster X-Fi Surround 5.1

An external X-Fi solution in tests.
September 9, 2008 · Sound Cards

AMD FX-8350 Processor

The first worthwhile Piledriver CPU.
September 11, 2012 · Processors: AMD

Consumed Power, Energy Consumption: Ivy Bridge vs. Sandy Bridge

Trying out the new method.
September 18, 2012 · Processors: Intel
  Latest Reviews More    RSS  

i3DSpeed, September 2013

Retested all graphics cards with the new drivers.
Oct 18, 2013 · 3Digests

i3DSpeed, August 2013

Added new benchmarks: BioShock Infinite and Metro: Last Light.
Sep 06, 2013 · 3Digests

i3DSpeed, July 2013

Added the test results of NVIDIA GeForce GTX 760 and AMD Radeon HD 7730.
Aug 05, 2013 · 3Digests

Gainward GeForce GTX 650 Ti BOOST 2GB Golden Sample Graphics Card

An excellent hybrid of GeForce GTX 650 Ti and GeForce GTX 660.
Jun 24, 2013 · Video cards: NVIDIA GPUs

i3DSpeed, May 2013

Added the test results of NVIDIA GeForce GTX 770/780.
Jun 03, 2013 · 3Digests
  Latest News More    RSS  

Platform  ·  Video  ·  Multimedia  ·  Mobile  ·  Other  ||  About us & Privacy policy  ·  Twitter  ·  Facebook


Copyright © Byrds Research & Publishing, Ltd., 1997–2011. All rights reserved.