IST LIVE

Content related to "knowledge-model"

(2.4) Smart Content Factory - Assisting Search for Digital Objects by Generic Linking Concepts to Multimedia Content

Search, retrieval and navigation in audiovisual repositories is a task common to all media asset management systems: Users are supported by a wide range of features which are traditionally based on full text search and metadata queries. In this paper we describe an approach to superimpose a semantic indexing infrastructure over the media assets and the metadata associated with them. The infrastructure is based on formal knowledge models and facilitates the use of further navigation dimensions: By identifying semantic concepts we are able to create a dynamic navigation structure which is based on the underlying knowledge model and the conceptual relations defined therein.

(2.4) D7.8 Final Specification of the Intelligent Media Framework

This report presents the final specification of the Intelligent Media Framework (IMF), one of the core subsystems acting as the middleware for the LIVE Production Support System. The framework provides the following services to other LIVE subsystems and to the broadcaster’s environment: • Services to create, annotate and manage the intelligent media assets (IMA) in a realtime production environment. These services operate on a metadata level. They do not store, but rather reference raw video streams (“IMA Service”). • Services to access the vocabularies and the terms of the controlled vocabulary constituting the knowledge base of the LIVE staging domain (“Knowledge Service”). • Services to access and search semantically enriched information across the system (“Semantic Context Service”). • Services to manage and access information about the staged events, e.g. the date and place of the competitions, the participating athletes, the results, etc. (“Event Information Service”). • Services to support the real-time aspects of the staging process by offering propagation and subscription methods to other subsystems (“Real-time Notification Services”). • Additionally, the IMF provides modules for (1) the processing of spatial, temporal and free text annotation of media assets (“MPEG7 Annotation Module”), and (2) the integration of support and planning data for the Olympic Games from the Olympic Sport Information System.

(2.4) D7.2 Basic Specification of the Intelligent Media Framework

This report presents the basic specification of one of the core subsystems developed in the LIVE project: The “Intelligent Media Framework” provides a robust framework for the creation, management and delivery of so called “Intelligent Media Assets” under real-time conditions. The specification provided in this report is called “basic” in the sense, that it reflects the requirements of the first 18 months of the project duration and specifies the subsystem to serve the integration of the first prototype of the LIVE production support system. The basic specification will be further extended in the course of the project.

(2.4) Second Prototype of the Intelligent Media Framework (D7.6)

This document is part of LIVE’s deliverable D7.6 “Second Prototype of the Intelligent Media Framework” which is delivered in two parts: 1. Software: delivered on DVD/CD 2. Documentation: this document The IMF software package consists of the service implementation, the IMF Client packages and the IMF Toolset. The core part of the IMF is delivered as an Enterprise Archive File (EAR) which can be deployed on JEE1 compatible Applications Servers. The accompanying IMF Toolset has been developed as Eclipse Rich Client Platform (RCP) applications which are currently deployed for the Windows Platform. The required communication between clients and the server part is covered by the IMF Client packages. However, access to the core part of the IMF is not limited to the IMF Toolset: The LIVE annotation tools and the LIVE recommender tools are build on top of the IMF client packages. The documentation, provides detailed information about the setup, deployment, installation and configuration of the 2nd prototype of the Intelligent Media Framework. This document serves on one hand as an installation guide for the software delivered on DVD/CD. On the other hand it aims to provide usage instruction of the provided services and how to benefit from the provided client packages.

(1.7) Basic Specification of the Intelligent Media Framework (D7.4)

The objective of this report is to provide a synopsis of the basic specification of the Intelligent Media Framework as developed during the first iteration cycle of the LIVE project (from January 2006 to June 2007). The implementation of this specification formed the middleware of the first prototype of the LIVE production support system. The Intelligent Media Framework is introduced to be based on a combination of a classical three-tier architecture with the principles of service oriented architectures (SOA). This report is made available for and addressed to, the interested public. It presupposes some basic knowledge of software and knowledge engineering as well as some understanding of broadcasting issues. Topics covered in this report are: - An overview of the architecture of the LIVE production support system - An overview of the LIVE staging domain and the requirements of different agents in the LIVE staging process - The knowledge and the framework requirements of the Intelligent Media Framework - The knowledge model of the Intelligent Media Framework comprising the knowledge structure, the term model, the event domain model and the basic IMA model. - The architecture of the Intelligent Media Framework (system design). - Initial conclusions and an assessment of the requirements.

(1.7) Knowledge Acquisition from Multimedia Content

Proceedings of the First International Workshop, KAMC 2007 Genova, Italy, December 5, 2007. In recent years significant advances have been made in the area of automatic ex- traction of low-level features from audiovisual content. However, little progress has been achieved in the identification of high-level semantic features or the effective combination of semantic features derived from different modalities. Knowledge acquisition is becoming a key-enabling factor of the above tasks towards more scalable and reliable solutions, and thus its automation is becoming critical. As the deployment of knowledge enhances the robustness of extraction while on the other hand the continuous extraction of semantic information can enrich this knowledge, synergistic approaches that combine multimedia extraction and knowledge evolution in a bootstrapping common framework introduce new opportunities in semantic multimedia applications. Integration with additional sources of information, e.g. by using human annotation tools or real-time event services, may further simplify and disambiguate semantic multimedia information systems. Moreover, adaptation to a particular domain, for example to sports events, such as the Olympic games, is essential in order to reduce the complexity of multimedia analysis. In this context, unified modelling and representation of multimedia and domain-specific knowledge, ontology evolution, and standard and non-standard inference services for multimodal semantic knowledge fusion, form cutting edge technologies. The aim of this workshop is to intensify the exchange of ideas between the different research communities involved which range from multimedia analysis to reasoning with ontologies. The submitted contributions published in these proceedings therefore reflect current research in this area: the topics range from multimedia classification based on textual information, content based shot classification, feature extraction to image classification based on ontologies. The submitted papers cover different application domains, i.e. broadcasted news or legal documents. We would like to thank all members of the program committee for supporting us in the reviewing process, the organizers of the main conference SAMT 2007 to which this workshop was co-located - especially Yannis Avrithis, Michela Spagnuolu and Francesco Robbiano - for their kind support throughout the organizational process.We also would like to thank the authors for their willingness to revise their initial submissions based on the reviewers comments. Finally we would like to thank our invited speakers, Fabio Ciravegna and Alan Smeaton for their willingness to give a talk at our workshop.

(1.7) IMF Toolset (D7.9)

This document provides an introduction to the technological platform as well as the user guide for a set of applications developed on top of LIVE’s Intelligent Media Framework (IMF) to support the preparation and the production of the LIVE staging process. In the preparation phase the tools allow editing of Intelligent Media Assets (ingest of archival clips into the production archive) and the management of event related information (such as event schedule, participants). To support the LIVE staging in real-time during the production process, the IMF Toolset provides the Staging Console, an application visualising real-time event data but enriched with annotations from the meta data generation system.

(1.7) Mind the Gap - Requirements for the combination of content and knowledge

Semantic enrichment of content can be done manually, which is expensive, or automatically, which is error-prone. In particular, automatic semantic enrichment must be aware of the gap between the semantics that are directly retrievable from the content and those which can be inferred within a given interpretative context. We report on a model for content and knowledge which distinguishes between three descriptive levels: information relating directly to the resource, to the metadata of the resource and to the subject matter addressed by the content. This model addresses five fundamental requirements for automation: formality, interoperability, multiple interpretations, contextualization, and independence of knowledge items from the resource’s content.

(1.7) Bringing “Intelligence” to iTV: The Intelligent Media Framework

This paper gives an overview of a software frame¬work designed for the creation of interactive multi-channel television shows. The “Intelligent Media Framework” forms the middleware of an iTV production support system developed in the context of the European integrated project “LIVE”. The framework is designed according to service oriented architecture (SOA) principles for easy integration into existing iTV and TV production environments. Moreover, the Intelligent Media Frame-work is based on a knowledge model formalising the main aspects identified to make up the domain of real-time staging of media events: the content (media clips and media streams), the events, the staging and the users (professional users and consumers). The framework offers services for the development of tools assisting the production team of multi-channel iTV shows in an intelligent way: The envisaged “intelligence” is based on formal, machine understandable descriptions of the content and the events: This document introduces the knowledge model and provides an overview of the architecture of a media framework designed to support the iTV production process in an intelligent way.

(1.4) Final Implementation of the Intelligent Media Framework (D7.10)

This document provides detailed information about the setup, deployment, installation and configuration of the final implementation of the Intelligent Media Framework. The document serves as an installation guide for the software delivered on DVD/CD.

(1.4) Bringing 'Intelligence' to iTV: The Intelligent Media Framework - Poster

Poster presentation of the role of the intelligent media framework in the LIVE project. It also provides and overview of the technologies and services of the intelligent media framework.

(1) First Prototype of the Intelligent Media Framework - D7.3 Documentation

This document is part of LIVE’s deliverable D7.3 “First Prototype of the Intelligent Media Framework” which is delivered in two parts: 1.Software: delivered on DVD/CD; 2.Documentation: this document. Part 2, the documentation, provides detailed information about the implementation of the Intelligent Media Framework for the 1st prototype as well as installation guidelines for the installation of the software delivered on DVD/CD as well as instructions on how to use the services of the Intelligent Media Framework. Not contained within this document are instructions on how to build the Intelligent Media Framework out of the TRAC-subversion system. Part 1 however is a packaged version of a tested IMF installation; all the described installation steps have been executed beforehand. The only required steps to run this particular installation are to extract the archive and the start the JBoss server by invoking the run.bat or run.sh file in the servers bin directory.

(0.7) Semantic-based Realization of Novel iTV Formats for the Broadcasting of Media Events (Full Paper)

Broadcasting of media events is a real-time action demanding reliable just in time decisions based on the current content of incoming video streams and the availability of background material. Novel iTV formats for broadcasting this type of event thus demand monitoring of multiple streams and background material. Due to the potentially large amount of streams and other available material, manual monitoring is likely to fail on the long term. We therefore developed an indexing pipeline based on semantic technologies that enables real-time analysis of broadcasted streams and reliable content recommendations of streams and background material based on formal machine understandable descriptions of content. Our approach enables real-time interpretation of broadcasted streams and thus establishes a bridge over the “Semantic Gap” in video analysis.

(0.7) State of the Art Report Intelligent Media Framework (Deliverable 7.1)

The integrated project “LIVE Staging of Media Events” (LIVE; FP6-27312) aims at the creation of novel intelligent content production methods and tools for interactive digital broadcasters to stage live media events in the area of sports, such as the 2008 Olympic Games. This report presents the state of the art of the concepts, technologies and standards related to one of the core subsystems developed in the LIVE project: The “Intelligent Media Framework” provides a robust framework for the creation, management and delivery of so called “Intelligent Media Assets” under real-time conditions. Topics covered in this report are: - Selected technologies in the area of (semantic) media asset management, recommender systems, metadata generation systems, video conducting systems and interface technologies. - Selected standards in the broadcasting domain and for knowledge representation. - Derived architectural requirements as well as requirements for content model of the envisaged Intelligent Media Framework - An assessment and comparison of selected intelligent content models.

(0.7) Extended Specification of the Intelligent Media Framework (D7.5)

This report presents the extended specification of the Intelligent Media Framework (IMF), one of the core subsystems acting as the middleware for the LIVE production support system. The framework provides the following services to other LIVE subsystems, such as the Metadata Generation System and the Recommender System: Services to create, annotate and manage the intelligent media assets that make up the show under real-time conditions. These services operate on a metadata level and do not actually store any raw video streams (they rather reference these so called “essences”); Services to access the vocabularies and the terms of the controlled vocabulary constituting the knowledge base of the live staging domain; Services to manage and deliver information about the staged events, e.g. the schedule of the contests and races, the participating athletes, the results, etc; A messaging system to support the real-time aspects of the staging process by offering subscription methods to other subsystems. The Intelligent Media Framework is based on a combination of a classical three-tier architecture with the principles of service oriented architectures (SOA). Moreover, the framework relies on a knowledge model for the LIVE staging domain that on a semantic level integrates information about the event, the content, the users involved in the production process and the concepts of presenting the event (“staging”). The objective of this report is to provide an up to date specification of the knowledge model, the services and the components of the Intelligent Media Framework. A basic specification of the IMF has been presented in [LIVE D7.2]. This documents focuses on those parts of the specification which were updated or extended in comparison to the basic specification. In all other cases D7.2 is just referred. The extended specification presented in this document will form the basis for the implementation of the 2nd prototype of the IMF [LIVE D7.6] which will be used for staging the Olympic Games 2008 in Peking.

(0.7) A Management System for Distributed Knowledge and Content Objects

We present the results of a European research project which developed specifications for so-called Knowledge Content Objects (KCO) and for an attendant infrastructure, the Knowledge Content Carrier Architecture (KCCA). The work addresses the problem that while there are many standards for content and for meta data, there is at present, no suitable framework that enables organizations to manage knowledge alongside content, in a coherent manner. Our approach postulates the KCO as a common structural entity which can be recognized and manipulated by a KCCA enabled system.

(0.7) Smart Content Factory - Approaching the Vision

In this paper we describe the objectives and achievements in developing the vision of a “Smart Content Factory”. The “Smart Content Factory” aims at the creation of a knowledge-aware system infrastructure to improve the utilization (re-use and adaptation) of audiovisual content. We will provide an overview of the project objectives and introduce “digital content engineering” as a scientific discipline dealing with concepts, methodologies, techniques and tools for a quantifiable approach towards the vision of smart content, thereby addressing future scenarios of electronic publishing, especially for embedded publishers. We will further take a look at the user and system requirements of the “Smart Content Factory” and their impact on the architecture of the system prototype.

(0.7) Smart Content – Scenarios and Technologies for a Knowledge-based Audiovisual Archive

In our paper we present the intermediate results of a project aiming at the creation of a knowledge-based infrastructure for search and navigation in audiovisual repositories. The approach is based on highly automated media processing and is therefore specifically targeted to historically grown archives (broadcasters, universities, public and corporate media archives, etc.) lacking the time and/or the financial means to manually annotate their digital media assets. In the project a conceptual architecture was developed to meet the requirements of a set of knowledge-intensive user scenarios for the utilization of rich media content in the B2B and B2C areas. Pluggable RDF knowledge components act as a link between a semantic indexing and knowledge-based navigation.