NEC's Robot Helps Create Multi-Media Blogs

NEC's Robot Helps Create Multi-Media Blogs

NEC Corporation announced development of a new system for automatically creating multi-media blogs. The new system has been developed on NEC's prototype robot PaPeRo, and is initialized when a user begins a conversation with PaPeRo about the events of their day, which the system then records and analyzes. Following this, PaPeRo searches for suitable multi-media contents on the internet, including images, illustrations and music, which are automatically uploaded and edited along with the video recording on the user's blog. This new system facilitates ease of multi-media-rich blog creation.

The novel system has been realized by integrating (1) large-vocabulary, continuous speech recognition technology, which converts the speech content of the video message into text and extracts important keywords, and (2) natural language, text retrieval technology, which enables searching of contents on the internet.

The features of the new system are as follows:

1. Chat with PaPeRo to create your daily blog. The speech contents of the video message are converted into text and extracted through large-vocabulary, continuous speech recognition technology. Multi-media web contents matching the extracted keywords are then uploaded and edited on the user's blog, enabling effortless creation of a multi-media blog.
2. Natural language, text retrieval technology enables searching of internet contents. Analyzing the syntactic relationship, such as direct objects and predicate verbs, the system calculates similarities between the text in the contents on the internet and the video message text converted by a speech recognition engine (developed with a large database of spoken words). This allows searching and accurate location of multi-media contents suitable to the contents of the text message.

The technology developed for this system can also be applied to a variety of other information terminals. NEC will continue to develop this system toward early commercialization.

Source: NEC Corporation

Write a comment below. No registration needed!