Search engine for MultimediA enviRonment generated contenT (SMART)

FP7 EU funded project (Grant Number: 287583) – http://www.smartfp7.eu

The main goal of the SMART project was to research and implement a next generation multimedia search engine that will be able to search information stemming from the physical world. The SMART engine is able to answer queries based on the intelligent collection and combination of sensor generated data, based on sensors and sensor processing algorithms that match the context at hand.

SMART will introduce a holistic open source web-scale multimedia search framework for multimedia data stemming from the physical world. To this end, SMART will develop a scalable search and retrieval architecture for multimedia data, along with intelligent techniques for real-time processing, search and retrieval of physical world multimedia. The SMART framework will boost scalability in both functional and business terms, while being extensible in terms of sensors and multimedia data processing algorithms. The SMART framework will enable answering of queries based on the intelligent collection and combination of sensor generated multimedia data, using sensors and perceptual (A/V) signal processing algorithms that match the application context at hand.

This matching will be based on the sensors’ context and metadata (e.g., location, state, capabilities), as well as on the dynamic context of the physical world as the later is perceived by processing algorithms (such as face detectors, person trackers, classifiers of acoustic events and components for crowd analysis). At the same time, SMART will be able to leverage Web2.0 social networks information in order to facilitate social queries on physical world multimedia. The main components of the SMART search framework will be implemented as open source software over the Terrier open source engine.