IST LIVE

Content related to "intelligent-media-framework"

(1) D7.8 Final Specification of the Intelligent Media Framework

This report presents the final specification of the Intelligent Media Framework (IMF), one of the core subsystems acting as the middleware for the LIVE Production Support System. The framework provides the following services to other LIVE subsystems and to the broadcaster’s environment: • Services to create, annotate and manage the intelligent media assets (IMA) in a realtime production environment. These services operate on a metadata level. They do not store, but rather reference raw video streams (“IMA Service”). • Services to access the vocabularies and the terms of the controlled vocabulary constituting the knowledge base of the LIVE staging domain (“Knowledge Service”). • Services to access and search semantically enriched information across the system (“Semantic Context Service”). • Services to manage and access information about the staged events, e.g. the date and place of the competitions, the participating athletes, the results, etc. (“Event Information Service”). • Services to support the real-time aspects of the staging process by offering propagation and subscription methods to other subsystems (“Real-time Notification Services”). • Additionally, the IMF provides modules for (1) the processing of spatial, temporal and free text annotation of media assets (“MPEG7 Annotation Module”), and (2) the integration of support and planning data for the Olympic Games from the Olympic Sport Information System.

(1) Second Prototype of the Intelligent Media Framework (D7.6)

This document is part of LIVE’s deliverable D7.6 “Second Prototype of the Intelligent Media Framework” which is delivered in two parts: 1. Software: delivered on DVD/CD 2. Documentation: this document The IMF software package consists of the service implementation, the IMF Client packages and the IMF Toolset. The core part of the IMF is delivered as an Enterprise Archive File (EAR) which can be deployed on JEE1 compatible Applications Servers. The accompanying IMF Toolset has been developed as Eclipse Rich Client Platform (RCP) applications which are currently deployed for the Windows Platform. The required communication between clients and the server part is covered by the IMF Client packages. However, access to the core part of the IMF is not limited to the IMF Toolset: The LIVE annotation tools and the LIVE recommender tools are build on top of the IMF client packages. The documentation, provides detailed information about the setup, deployment, installation and configuration of the 2nd prototype of the Intelligent Media Framework. This document serves on one hand as an installation guide for the software delivered on DVD/CD. On the other hand it aims to provide usage instruction of the provided services and how to benefit from the provided client packages.

(1) Bringing 'Intelligence' to iTV: The Intelligent Media Framework - Poster

Poster presentation of the role of the intelligent media framework in the LIVE project. It also provides and overview of the technologies and services of the intelligent media framework.

(1) State of the Art Report Intelligent Media Framework (Deliverable 7.1)

The integrated project “LIVE Staging of Media Events” (LIVE; FP6-27312) aims at the creation of novel intelligent content production methods and tools for interactive digital broadcasters to stage live media events in the area of sports, such as the 2008 Olympic Games. This report presents the state of the art of the concepts, technologies and standards related to one of the core subsystems developed in the LIVE project: The “Intelligent Media Framework” provides a robust framework for the creation, management and delivery of so called “Intelligent Media Assets” under real-time conditions. Topics covered in this report are: - Selected technologies in the area of (semantic) media asset management, recommender systems, metadata generation systems, video conducting systems and interface technologies. - Selected standards in the broadcasting domain and for knowledge representation. - Derived architectural requirements as well as requirements for content model of the envisaged Intelligent Media Framework - An assessment and comparison of selected intelligent content models.

(1) Semantic-based Realization of Novel iTV Formats for the Broadcasting of Media Events (Full Paper)

Broadcasting of media events is a real-time action demanding reliable just in time decisions based on the current content of incoming video streams and the availability of background material. Novel iTV formats for broadcasting this type of event thus demand monitoring of multiple streams and background material. Due to the potentially large amount of streams and other available material, manual monitoring is likely to fail on the long term. We therefore developed an indexing pipeline based on semantic technologies that enables real-time analysis of broadcasted streams and reliable content recommendations of streams and background material based on formal machine understandable descriptions of content. Our approach enables real-time interpretation of broadcasted streams and thus establishes a bridge over the “Semantic Gap” in video analysis.

(1) D7.2 Basic Specification of the Intelligent Media Framework

This report presents the basic specification of one of the core subsystems developed in the LIVE project: The “Intelligent Media Framework” provides a robust framework for the creation, management and delivery of so called “Intelligent Media Assets” under real-time conditions. The specification provided in this report is called “basic” in the sense, that it reflects the requirements of the first 18 months of the project duration and specifies the subsystem to serve the integration of the first prototype of the LIVE production support system. The basic specification will be further extended in the course of the project.

(1) Extended Specification of the Intelligent Media Framework (D7.5)

This report presents the extended specification of the Intelligent Media Framework (IMF), one of the core subsystems acting as the middleware for the LIVE production support system. The framework provides the following services to other LIVE subsystems, such as the Metadata Generation System and the Recommender System: Services to create, annotate and manage the intelligent media assets that make up the show under real-time conditions. These services operate on a metadata level and do not actually store any raw video streams (they rather reference these so called “essences”); Services to access the vocabularies and the terms of the controlled vocabulary constituting the knowledge base of the live staging domain; Services to manage and deliver information about the staged events, e.g. the schedule of the contests and races, the participating athletes, the results, etc; A messaging system to support the real-time aspects of the staging process by offering subscription methods to other subsystems. The Intelligent Media Framework is based on a combination of a classical three-tier architecture with the principles of service oriented architectures (SOA). Moreover, the framework relies on a knowledge model for the LIVE staging domain that on a semantic level integrates information about the event, the content, the users involved in the production process and the concepts of presenting the event (“staging”). The objective of this report is to provide an up to date specification of the knowledge model, the services and the components of the Intelligent Media Framework. A basic specification of the IMF has been presented in [LIVE D7.2]. This documents focuses on those parts of the specification which were updated or extended in comparison to the basic specification. In all other cases D7.2 is just referred. The extended specification presented in this document will form the basis for the implementation of the 2nd prototype of the IMF [LIVE D7.6] which will be used for staging the Olympic Games 2008 in Peking.

(1) Bringing “Intelligence” to iTV: The Intelligent Media Framework

This paper gives an overview of a software frame¬work designed for the creation of interactive multi-channel television shows. The “Intelligent Media Framework” forms the middleware of an iTV production support system developed in the context of the European integrated project “LIVE”. The framework is designed according to service oriented architecture (SOA) principles for easy integration into existing iTV and TV production environments. Moreover, the Intelligent Media Frame-work is based on a knowledge model formalising the main aspects identified to make up the domain of real-time staging of media events: the content (media clips and media streams), the events, the staging and the users (professional users and consumers). The framework offers services for the development of tools assisting the production team of multi-channel iTV shows in an intelligent way: The envisaged “intelligence” is based on formal, machine understandable descriptions of the content and the events: This document introduces the knowledge model and provides an overview of the architecture of a media framework designed to support the iTV production process in an intelligent way.

(1) IMF Toolset (D7.9)

This document provides an introduction to the technological platform as well as the user guide for a set of applications developed on top of LIVE’s Intelligent Media Framework (IMF) to support the preparation and the production of the LIVE staging process. In the preparation phase the tools allow editing of Intelligent Media Assets (ingest of archival clips into the production archive) and the management of event related information (such as event schedule, participants). To support the LIVE staging in real-time during the production process, the IMF Toolset provides the Staging Console, an application visualising real-time event data but enriched with annotations from the meta data generation system.

(1) Final Implementation of the Intelligent Media Framework (D7.10)

This document provides detailed information about the setup, deployment, installation and configuration of the final implementation of the Intelligent Media Framework. The document serves as an installation guide for the software delivered on DVD/CD.

(1) First Prototype of the Intelligent Media Framework - D7.3 Documentation

This document is part of LIVE’s deliverable D7.3 “First Prototype of the Intelligent Media Framework” which is delivered in two parts: 1.Software: delivered on DVD/CD; 2.Documentation: this document. Part 2, the documentation, provides detailed information about the implementation of the Intelligent Media Framework for the 1st prototype as well as installation guidelines for the installation of the software delivered on DVD/CD as well as instructions on how to use the services of the Intelligent Media Framework. Not contained within this document are instructions on how to build the Intelligent Media Framework out of the TRAC-subversion system. Part 1 however is a packaged version of a tested IMF installation; all the described installation steps have been executed beforehand. The only required steps to run this particular installation are to extract the archive and the start the JBoss server by invoking the run.bat or run.sh file in the servers bin directory.

(1) An Intelligent Media Framework for Multimedia Content

Search, retrieval and navigation in multimedia repositories is a task common to all multimedia management systems: Users are supported by a wide range of features which are traditionally based on full text search and metadata queries. However generating metadata is an error-prune and work-intensive task, that for multimedia content cannot yet be made fully automatically. In this position paper we describe our vision of an Intelligent Media Framework that is capable of combining metadata and knowledge about media items in order to support user- orientation, search and retrieval in media-rich information spaces: We try to integrate heterogeneous sources to create an Intelligent Media Framework containing Intelligent Media Objects carrying behavioural knowledge and capable of fully describing themselves. The properties of these objects amongst others serve to the fact that users more likely search by the ”meaning” of audiovisual objects and what is represented tby them respectively, than by their pure low-level features.

(1) Basic Specification of the Intelligent Media Framework (D7.4)

The objective of this report is to provide a synopsis of the basic specification of the Intelligent Media Framework as developed during the first iteration cycle of the LIVE project (from January 2006 to June 2007). The implementation of this specification formed the middleware of the first prototype of the LIVE production support system. The Intelligent Media Framework is introduced to be based on a combination of a classical three-tier architecture with the principles of service oriented architectures (SOA). This report is made available for and addressed to, the interested public. It presupposes some basic knowledge of software and knowledge engineering as well as some understanding of broadcasting issues. Topics covered in this report are: - An overview of the architecture of the LIVE production support system - An overview of the LIVE staging domain and the requirements of different agents in the LIVE staging process - The knowledge and the framework requirements of the Intelligent Media Framework - The knowledge model of the Intelligent Media Framework comprising the knowledge structure, the term model, the event domain model and the basic IMA model. - The architecture of the Intelligent Media Framework (system design). - Initial conclusions and an assessment of the requirements.