Knowledge Base

No albums or photos uploaded yet.

Series of LIVE postcards: A series of 7 LIVE postcards promoting the main objectives of the project.
Concepts for Semantic Search in Audio-visual Repositories: Eine auch fuer Anwender spuerbaren Auswirkungen semantischer Technologien besteht im verbesserten Zugang zu Information. Auf diesem Grundgedanken basieren nicht nur semantische Suchmaschinen (z.B. Swoogle), sondern es gibt auch eine Reihe von Content Management Systemen, die derzeit an einem „Semantic Lifting“ ihrer Middleware arbeiten, um die Suche und den Zugang zur Information aufgrund formaler Modelle fuer die Bedeutung der (meist) unstrukturierten Inhalte zu erleichtern. Der Beitrag umreißt die Grundlagen der semantischen Suche als eine Anwendungsmoeglichkeit fuer die Technologien des Semantic Web und zeigt anhand eines Fallbeispieles, wie semantische Technologien zur Indizierung von audiovisuellen Archiven in einem Projekt am Kompetenzzentrum fuer Neue Medien (Salzburg NewMediaLab) mit der Bezeichnung „Smart Content Factory“ genutzt werden koennen.
LIVE Newsletter Issue 1: The aim of this publication is to report on the progress and results of the LIVE project as they happen. Each edition will briefly report on the progress of each work area as well as present a selection of articles from the consortium on a specific research theme being addressed in the project. This first edition provides an introductory overview of the nine main research and development work areas in the project, along with their respective research focus and expected outcomes.
An Intelligent Media Framework for Multimedia Content: Search, retrieval and navigation in multimedia repositories is a task common to all multimedia management systems: Users are supported by a wide range of features which are traditionally based on full text search and metadata queries. However generating metadata is an error-prune and work-intensive task, that for multimedia content cannot yet be made fully automatically. In this position paper we describe our vision of an Intelligent Media Framework that is capable of combining metadata and knowledge about media items in order to support user- orientation, search and retrieval in media-rich information spaces: We try to integrate heterogeneous sources to create an Intelligent Media Framework containing Intelligent Media Objects carrying behavioural knowledge and capable of fully describing themselves. The properties of these objects amongst others serve to the fact that users more likely search by the ”meaning” of audiovisual objects and what is represented tby them respectively, than by their pure low-level features.
Mind the Gap - Requirements for the combination of content and knowledge: Semantic enrichment of content can be done manually, which is expensive, or automatically, which is error-prone. In particular, automatic semantic enrichment must be aware of the gap between the semantics that are directly retrievable from the content and those which can be inferred within a given interpretative context. We report on a model for content and knowledge which distinguishes between three descriptive levels: information relating directly to the resource, to the metadata of the resource and to the subject matter addressed by the content. This model addresses five fundamental requirements for automation: formality, interoperability, multiple interpretations, contextualization, and independence of knowledge items from the resource’s content.
Smart Content Factory - Assisting Search for Digital Objects by Generic Linking Concepts to Multimedia Content: Search, retrieval and navigation in audiovisual repositories is a task common to all media asset management systems: Users are supported by a wide range of features which are traditionally based on full text search and metadata queries. In this paper we describe an approach to superimpose a semantic indexing infrastructure over the media assets and the metadata associated with them. The infrastructure is based on formal knowledge models and facilitates the use of further navigation dimensions: By identifying semantic concepts we are able to create a dynamic navigation structure which is based on the underlying knowledge model and the conceptual relations defined therein.
Smart Content Factory - Approaching the Vision: In this paper we describe the objectives and achievements in developing the vision of a “Smart Content Factory”. The “Smart Content Factory” aims at the creation of a knowledge-aware system infrastructure to improve the utilization (re-use and adaptation) of audiovisual content. We will provide an overview of the project objectives and introduce “digital content engineering” as a scientific discipline dealing with concepts, methodologies, techniques and tools for a quantifiable approach towards the vision of smart content, thereby addressing future scenarios of electronic publishing, especially for embedded publishers. We will further take a look at the user and system requirements of the “Smart Content Factory” and their impact on the architecture of the system prototype.
A Management System for Distributed Knowledge and Content Objects: We present the results of a European research project which developed specifications for so-called Knowledge Content Objects (KCO) and for an attendant infrastructure, the Knowledge Content Carrier Architecture (KCCA). The work addresses the problem that while there are many standards for content and for meta data, there is at present, no suitable framework that enables organizations to manage knowledge alongside content, in a coherent manner. Our approach postulates the KCO as a common structural entity which can be recognized and manipulated by a KCCA enabled system.
Smart Content – Scenarios and Technologies for a Knowledge-based Audiovisual Archive: In our paper we present the intermediate results of a project aiming at the creation of a knowledge-based infrastructure for search and navigation in audiovisual repositories. The approach is based on highly automated media processing and is therefore specifically targeted to historically grown archives (broadcasters, universities, public and corporate media archives, etc.) lacking the time and/or the financial means to manually annotate their digital media assets. In the project a conceptual architecture was developed to meet the requirements of a set of knowledge-intensive user scenarios for the utilization of rich media content in the B2B and B2C areas. Pluggable RDF knowledge components act as a link between a semantic indexing and knowledge-based navigation.
The Role of MPEG-7 in Semantic Annotation and the Cross-Media Publishing Process: During the development of a knowledge-based audio-visual information system the authors of this article defined a conceptual system architecture based on MPEG-7 as the general description scheme for the media assets in the middleware. This concept was not only used to achieve a high abstraction and independence of the underlying media asset management system, it was also and primarily used as the basis of a semantic indexing process. Based on lightweight ontologies the descriptions of the media assets were associated with semantic concepts. Semantically annotated MPEG-7 assets were then propagated to the presentation layer, thus allowing the implementation of a variety of publication scenarios, including cross-media scenarios for the creation of concise video summaries.
An end to interactive television production? Just the opposite: All stories have one beginning, one middle and one end. But with MECiTV’s interactive television (iTV) authoring platform, producers can easily create programmes in which viewers choose how the story unravels and ends.
Identification of Dramaturgical Principles: Identification of Dramaturgical Principles, Deliverable D2.2 of the MECiTV IST Research Project in FP5
Guidelines and Methods for Staging Live Media Events: D4.1 Guidelines and Methods for Staging Live Media Events, Deliverable of WP4 in LIVE. Ee explain our LIVE WP4 research roadmap for staging live digital TV content. The role of the Video Conductor at this stage of development should be seen as a visionary goal guiding our work. The user tests will help us to clarify and form the role of the Video Conductor in the first project phase. We are staging constructive test scenarios (bottom up approach), which will lead us to new methods and guidelines for live staging.
Video Composer and Live Video Conductor: Future Professions for the Interactive Digital Broadcasting Industry: Paper presented the EuroITV 2006: Beyond Usability, Broadcast, and TV - Fourth European Conference on Interactive Television, May 25 - 26, 2006, Athens, Greece. Proceedings pp. 32-38.
Methods, Design Guidelines and Workflows for Online Staging: EU Information Society Technologies – FP6-27312, Report D4.3, EU-IST Project 'Live: Live Staging of Media Events', 2006. After describing the conceptual background which is necessary for the development of future live staging TV formats, this document proposes both visionary as well as first concrete methods and design guidelines for online staging. In addition considerations on the respective future workflows and the results of a first survey on suitable live video performance tools are presented.
EU-IST Project LIVE: Live Staging of Media Events: Paper presented at the SAMT 2006: First International Conference on Semantics and Digital Media Technology, December 6 - 8, 2006, Athens, Greece.
Future Live iTV Production: Challenges and Opportunities: Paper presented at the AXMEDIS 2006: Second International Conference on Automated Production of Cross Media Content for Multi-Channel Distribution, December 13 - 15, 2006, Leeds, UK. Proceedings pp. 325-328. Today's TV broadcasting companies are highly professionalized in the production of linear TV formats. Workflows and technologies for these linear formats are reliable, the production personnel is highly skilled and we can trust in well-known viewing habits of the consumers. The key issue of this paper is: how do we enable such a broadcasting working environment to produce by far more variable, multi-perspective or interactive TV formats? We are especially interested in formats entailing a multitude of live audiovisual material like for example sport events or elections, which shall be transformed into an interactive TV event for the consumer at home. This paper is not concerned with the variety of technical problems the interactive TV paradigm leads to, but with questions of future tools and practices on the producers' side, levels of consumer personalization and the respective consumer interfaces to make digital content accessible.
Virtual Personalised Channels: Video Conducting of Future iTV: Paper presented at the EWIMT 2005: Second European Workshop on the Integration of Knowledge, Semantic and Digital Media Technologies, 30 November - 1 December, 2005, IEE Savoy Place, London. Proceedings pp. 381-382. Abstract: Television is undergoing a historical change. Interactive Digital Broadcasting will be reality in 2010+. Heaps of video material will be produced by TV broadcasters, which will overwhelm both the producers as well as the consumers. Current TV formats and forms of broadcasting do not satisfy the personal moods and interests of the consumer. We hence propose the development of a TV environment which allows for the establishment of 'virtual personalised channels'. To do so, (live) semantic annotation of video material as well as methods for live staging of media events have to be designed. The resulting drastically different process of content production and consuming will lead to the satisfaction of individual human needs. The approaches outlined in this extended abstract are the basis for our upcoming IST research project LIVE.
Afuzzy logic approach for detection of video shot boundaries: Video temporal segmentation is normally the first and important step for content-based video applications. Many features including the pixel difference, colour histogram, motion, and edge information etc. have been widely used and reported in the literature to detect shot cuts inside videos. Although existing research on shot cut detection is active and extensive, it still remains a challenge to achieve accurate detection of all types of shot boundaries with one single algorithm. In this paper, we propose a fuzzy logic approach to integrate hybrid features for detecting shot boundaries inside general videos. The fuzzy logic approach contains two processing modes, where one is dedicated to detection of abrupt shot cuts including those short dissolved shots, and the other for detection of gradual shot cuts. These two modes are unified by a mode-selector to decide which mode the scheme should work on in order to achieve the best possible detection performances. By using the publicly available test data set from Carleton University, extensive experiments were carried out and the test results illustrate that the proposed algorithm outperforms the representative existing algorithms in terms of the precision and recall rates. 2006 Pattern Recognition Society. Published by Elsevier Ltd. All rights reserved.
Video Indexing and Retrieval in Compressed Domain Using Fuzzy-Categorization: There has been an increased interest in video indexing and retrieval in recent years. In this work, indexing and retrieval system of the visual contents is based on feature extracted from the compressed domain. Direct possessing of the compressed domain spares the decoding time, which is extremely important when indexing large number of multimedia archives. A fuzzycategorizing structure is designed in this paper to improve the retrieval performance. In our experiment, a database that consists of basketball videos has been constructed for our study. This database includes three categories: fullcourt match, penalty and close-up. First, spatial and temporal feature extraction is applied to train the fuzzy membership functions using the minimum entropy optimal algorithm. Then, the max composition operation is used to generate a new fuzzy feature to represent the content of the shots. Finally, the fuzzy-based representation becomes the indexing feature for the content-based video retrieval system. The experimental results show that the proposal algorithm is quite promising for semantic-based video retrieval.
An Effective and Fast Scene Change Detection Algorithm for MPEG Compressed Videos: In this paper, we propose an effective and fast scene change detection algorithm directly in MPEG compressed domain. The proposed scene change detection exploits the MPEG motion estimation and compensation scheme by examining the prediction status for each macro-block inside B frames and P frames. As a result, locating both abrupt and dissolved scene changes is operated by a sequence of comparison tests, and no feature extraction or histogram differentiation is needed. Therefore, the proposed algorithm can operate in compressed domain, and suitable for real-time implementations. Extensive experiments illustrate that the proposed algorithm achieves up to 94% precision for abrupt scene change detection and 100% for gradual scene change detection. In comparison with similar existing techniques, the proposed algorithm achieves superiority measured by recall and precision rates.
DCT-Domain Image Retrieval Via Block-Edge-Patterns: A new algorithm for compressed image retrieval is proposed in this paper based on DCT block edge patterns. This algorithm directly extract three edge patterns from compressed image data to construct an edge pattern histogram as an indexing key to retrieve images based on their content features. Three feature-based indexing keys are described, which include: (i) the first two features are represented by 3-D and 4-D histograms respectively; and (ii) the third feature is constructed by following the spirit of run-length coding, which is performed on consecutive horizontal and vertical edges. To test and evaluate the proposed algorithms, we carried out two-stage experiments. The results show that our proposed methods are robust to color changes and varied noise. In comparison with existing representative techniques, the proposed algorithms achieves superior performances in terms of retrieval precision and processing speed.
Constrained Region-Growing and Edge Enhancement Towards Automated Semantic Video Object Segmentation: Most existing object segmentation algorithms suffer from a so-called under-segmentation problem, where parts of the segmented object are missing and holes often occur inside the object region. This problem becomes even more serious when the object pixels have similar intensity values as that of backgrounds. To resolve the problem, we propose a constrained region-growing and contrast enhancement to recover those missing parts and fill in the holes inside the segmented objects. Our proposed scheme consists of three elements: (i) a simple linear transform for contrast enhancement to enable stronger edge detection; (ii) an 8-connected linking regional filter for noise removal; and (iii) a constrained region-growing for elimination of those internal holes. Our experiments show that the proposed scheme is effective towards revolving the undersegmentation problem, in which a representative existing algorithm with edgemap based segmentation technique is used as our benchmark.
Adding Lossless Video Compression to MPEGs: In this correspondence, we propose to add a lossless compression functionality into existing MPEGs by developing a new context tree to drive arithmetic coding for lossless video compression. In comparison with the existing work on context tree design, the proposed algorithm features in 1) prefix sequence matching to locate the statistics model at the internal node nearest to the stopping point, where successful match of context sequence is broken; 2) traversing the context tree along a fixed order of context structure with a maximum number of four motion compensated errors; and 3) context thresholding to quantize the higher end of error values into a single statistics cluster. As a result, the proposed algorithm is able to achieve competitive processing speed, low computational complexity and high compression performances, which bridges the gap between universal statistics modeling and practical compression techniques. Extensive experiments show that the proposed algorithm outperforms JPEG-LS by up to 24% and CALIC by up to 22%, yet the processing time ranges from less than 2 seconds per frame to 6 seconds per frame on a typical PC computing platform.
LIVE press release at Salzburg Road Bicycle World World Championships in September 2006: A LIVE press release to inform the industry of LIVE's objectives and participation at the Salzburg Road Bicycle World World Championships in September 2006. The LIVE project took advantage of the fact that its partner ORF as the host broadcaster of the UCI Road World Bicycle Championships in Salzburg to gain unique access to the live sporting production and broadcasting environment. This experience will be the basis for the first LIVE prototype testing phase in October 2006.
LIVE press release at Salzburg Road Bicycle World World Championships in September 2006: German Version: A LIVE press release to inform the industry of LIVE's objectives and participation at the Salzburg Road Bicycle World World Championships in September 2006. The LIVE project took advantage of the fact that its partner ORF as the host broadcaster of the UCI Road World Bicycle Championships in Salzburg to gain unique access to the live sporting production and broadcasting environment. This experience will be the basis for the first LIVE prototype testing phase in October 2006.
End-user interactive view: A poster demonstrating end-user interactive concepts of the LIVE system
Draft Plan for Using and Disseminating: The LIVE Plan for Using and Disseminating Knowledge (PUDiK) is the operational framework to protect, manage, communicate and exploit the LIVE project’s results (knowledge) within the principles and rules set out by the EC Contract and LIVE Consortium. It is to be seen as a living document, meaning that it will be updated during the life of the project. PUDiK is separated into three sections, this document introduces the first two components Part A and B. Part A deals with the protection and management of knowledge represented by the activities declaration, documentation and reporting, and Part B deals with the task of knowledge dissemination. Each section establishes a framework to integrate the workflow, procedures and division of responsibilities within that area.
State of the Art Report Intelligent Media Framework (Deliverable 7.1): The integrated project “LIVE Staging of Media Events” (LIVE; FP6-27312) aims at the creation of novel intelligent content production methods and tools for interactive digital broadcasters to stage live media events in the area of sports, such as the 2008 Olympic Games. This report presents the state of the art of the concepts, technologies and standards related to one of the core subsystems developed in the LIVE project: The “Intelligent Media Framework” provides a robust framework for the creation, management and delivery of so called “Intelligent Media Assets” under real-time conditions. Topics covered in this report are: - Selected technologies in the area of (semantic) media asset management, recommender systems, metadata generation systems, video conducting systems and interface technologies. - Selected standards in the broadcasting domain and for knowledge representation. - Derived architectural requirements as well as requirements for content model of the envisaged Intelligent Media Framework - An assessment and comparison of selected intelligent content models.
First Specification of the Personalized Content Recommender System (Deliverable 6.1): This document describes the first specification of the Recommender System, which is one of the five basic system components of the LIVE system. The specification is the result of the work carried out within the WP6, Personalization and Feedback. The specification is based on the user requirements described in the Deliverable 9.1, and the basic system architecture, de-fined in D9.2. The document provides a general view of the Recommender System which should allow for different usage scenarios. It represents the WP6’s current view of the final, fully functional Recommender System to be used in the production of LIVE TV programs. The document includes: • User requirements. Users of the Recommender System services and the functionalities that they require are defined. • Usage scenarios are proposed both for Video Conductor as well as for the Consumer. • Functionalities. A list of functionalities provided by the Recommender system is de-fined. • Based on the scenarios, six use cases of RS are defined in more detail. • Internal system architecture of the RS is defined including components that comprise the Recommender System. • Services and Interfaces. Services which are offered by the RS are described together with proposed interfaces. • Activity diagrams. The activity diagrams define workflows that are performed inside the recommender system.
Video & iTV Technology (Deliverable 3.6): This market report collects the most relevant players of each allotment of the iTV industry as we have found to classify. We have been unable to determine other classification structure that would really make more sense than the one provided in this document. Nevertheless, the structure of the document is also based on some written demands, as for example the IPTV and VoD services were too large to include them under network operators and were moved into a section of their own. In addition to the short description of each technology area, the document also includes a short section under each area analysing the technology area regarding LIVE project.
Socioeconomic Impact Report (Deliverable 3.8): In this first socioeconomic report, we aim to pull together the general insights into a future progressive study of LIVE’s socioeconomical impact aspects. To this end, the report provides an initial introduction to the socioeconomic aspects of the project, including an overview of iTV technology from a consumer’s point of view. Furthermore there is a short section describing the use of iTV in society to learn about the needs and patterns that trigger audience increase and iTV services consumption.
Basic System Architecture (D9.2): The goal of this deliverable is to provide a high-level overview of the idea of the LIVE project and its basic system architecture. The description goes to the level of detail that is needed to understand the basic architecture. For more detailed descriptions, particularly of the subsystems, the reader is referred to the respective subsystem deliverables. The described first basic system architecture of this document was developed including the results of the first six months of research within the LIVE project. Derived from the basic idea of a system - whereby an interactive digital broadcaster should be able to create a non-linear multi-stream video show in real-time, which changes due the consumers’ interests - first user tests were made and analysed at the public Austrian broadcaster ORF (Österreichischer Rundfunk). These tests resulted in a set of initial requirements (compare deliverable D9.1 “Results from the initial requirement analysis”). Based on these requirements, actors of the LIVE System and their basic use cases were identified. This finally results in the basic system architecture which is briefly described in this deliverable. For this deliverable a public synopsis (D9.3) is available too.
Public Video iTV Technology (Deliverable 3.7): This report tries to identify the companies, markets and environments surrounding the iTV industry. The report classifies the main actors depending on the nature of their product or service technology. In addition to the short description of each technology area, this document also includes chapter subdivisions analysing the possible implications of technology for the LIVE project.
User Scenarios and Personalization (presentation): Proposal on user scenarios, LIVE services and the use of personalization - presentation at Vienna meeting, March 2006.
Public Synopsis on Basic System Architecture (D9.3): The goal of this public deliverable is to provide a high-level overview of the idea of the LIVE project and its basic system architecture. The description goes to the level of detail that is needed to understand the basic architecture. For more detailed descriptions, particularly of the subsystems, the reader is referred to the respective subsystem deliverables. The described first basic system architecture of this document was developed including the results of the first six months of research within the LIVE project. Derived from the basic idea of a system - whereby an interactive digital broadcaster should be able to create a non-linear multi-stream video show in real-time, which changes due the consumers’ interests - first user tests were made and analyzed at the public Austrian broadcaster ORF (Österreichischer Rund-funk). These tests resulted in a set of initial requirements (compare deliverable D9.1 “Results from the initial requirement analysis”). Based on these requirements, actors of the LIVE Sys-tem and their basic use cases were identified. This finally results in the basic system architec-ture which is briefly described in this deliverable. The target audience for this document is any person inside or outside of the LIVE project in-terested in learning about the proposed functionality and architecture of LIVE.
Description of the overall implementation and integration plan (D8.1): The document D8.1 is the first deliverable from work package 8 (Integration). While other technical work packages are about researching and developing innovative techniques for the application area, WP8 deals with the more mundane tasks of integrating those software pack-ages with each other and into an existing broadcast environment. So the work underlying this document consisted of the following tasks: isolate some attractive usage scenarios showing several of the components working in concert, coordinate the partners efforts on specifying interfaces between their respective components, study the existing target environment at the broadcasters premises and finally develop some missing glue necessary to make a first running prototype feasible as early as possible. The glue mentioned in the preceding paragraph consists of some additional “orphaned” components not included in some other work package, plus some common infrastructure (e.g. standard middleware) on which all components can be based. Both types of software packages are described in this document as well. The document describes the objectives of the prototype and summarises some of its features; the prototype's components and their internal and external interfaces, as well as how the sys-tem will be embedded into the broadcaster’s workflow and infrastructure are explained. Besides, a list of the envisaged implementation techniques and tools is given. The document ends with a presentation of the schedule for the necessary implementation steps.
Design of Interactive Knowledge Map (Deliverable 2.4): In support of -and in addition to the general information available on the LIVE website, LIVE will create an easily accessible and navigable 'Interactive Knowledge Map' (IKM) for the information space spanned by the research domain of the project for both professional and academic users. The tool is designed to support multiple search and inquiry strategies, present contextual relationships between LIVE knowledge products, and provide metadata information to knowledge in process, or not open for public viewing. The major goal of this document is to layout the design approach of the IKM, which will be a part of the LIVE Knowledge Management and Dissemination System (KMDS), which is envisaged as a semi- automatic solution to support the process of declaration, documentation, and reporting of know-how and knowledge in the project. A Knowledge Visualization Framework will be applied for gathering the main requirements for the IKM (section 4), this involves taking a look at the State of the Art in Knowledge Visualization that documents available tools and visualization strategies that could be adapted in the realization of the IKM (section 5). Section 7 outlines the approaches for the visualization of knowledge in LIVE, which includes the basic envisaged functionalities and components. Finally, an approach on how to seamlessly integrate the IKM in the LIVE website is provided. The LIVE IKM will provide three approaches for the visualization of knowledge. The first approach as introduced in section 6.1 is based on an automatic analysis of the document collection of LIVE. The second approach will model the LIVE knowledge domain by use of a taxonomy at a coarse level of granularity (section 6.2). And, the third approach will model a specific selection of the knowledge domain at a finer level of granularity expressed in an ontology (section 6.3). The design of the ontology will be based on the deliverable D3.2 (Technology Market Watch).
Recommender System Evaluation : Scenarios and User interface: A presentation of WP6 plans and their development status. Evaluation of developed tools and scenarios.
Personalised content search: An overview of different personalization approaches (content-based, collaborative.based, feedback gathering mechanisms, existing standards). How can this approaches be used in LIVE environment.
Overall system and Recommender System: An overview of the achieved system development. Presentation of current ideas for the system as a whole and also for the recommender system module.
Personalised content search overwiev: Additional information about usage of personalization approaches in LIVE environment.
WP 6 – Personalization and Feedback: Presentation of possible recommender system usage scenarios in LIVE. Integration of WP9 and WP5 (content description requirements and system specification). Indication of research needed for this integration.
Recommender System: First Specification: Presentation of proposed system design, module structure and functions performed by each module.
Recommender System Interfaces: Discussion of open issues such as input content format, staging workflow, Programme planning tools and user interfaces.
Recommender System Data Models: This specification defines the data models which are used within the Recommender System. First specification on data models of RS was prepared on 10-10-2006, file LIVE_RS_DataModels.xls. Further version of the specification was available in the document LIVE-WP6-TED-Recommender_System_Interfaces-061020.doc.
Recommender System Prototype: This technical document defines the scenarios for the demonstration of the Recommender sys-tem prototype at the Review meeting in March 2007.
Personalization and Feedback, Introduction, Scenarios and Functionalities: This document is intended to serve as an introduction into WP6 Personalization and Feed-back. It gives an overview of the goals of the work within WP6, collects the requirements for personalization and feedback, and gives a proposal on possible solutions to the personalized content recommendations within LIVE framework. A first draft of a work plan is included.
Initial LIVE Exploitation Plan (Deliverable 3.1): This “Initial LIVE Exploitation Plan” is the Part C of the overall Plan for Using and Disseminating Knowledge (PUDiK) which therefore completes the definition of the dissemination and knowledge management strategy. The first section of this document explains the consortium approach to develop a project policy regarding the exploitation of project results. It is foreseen that the development of an Exploitation Agreement is needed to guarantee the appropriate exploitation of the project results.
Consumer Recommender and Feed-back demonstrator: The purpose of the iTV demonstrator is to show the possibilities that can be provided by ad-vanced iTV services. The first prototype described in this document is based on the back-ground architecture work developed at the Laboratory for digital signal, image and video processing , University of Ljubljana and on the JAME Author software, which was developed by the Fraunhofer-Institut für Medienkommunikation IMK (FhG). The prototype is used for demonstration of basic functionalities that are interesting for the coming iTV services such as video on demand, automatic recommendation of interesting TV programmes, acquisition of additional data for particular TV programme, etc.
Recommender System Interfaces and Data Models: This document provides input to the work on interfaces within WP8. It provides first specifi-cation of interfaces of the Recommender System module. The RS interfaces are developed according to the proposed Use cases of the RS, defined in the D6.1. It provides the first speci-fication of the data models used and / or maintained by the RS.
Recommender System Interfaces: This document provides input to the work on interfaces within WP8. It provides first specifica-tion of interfaces of the Recommender System module. The RS interfaces are developed according to the proposed Use cases of the RS, defined in the D6.1.
Sport Database metadata retrieval scenarios: In this document we suppose that the content domain is limited to the sport domain. We only use terms available and defined by the SportML schema. We propose that the first demon-strator capabilities are limited to the sport domain.
Input to Deliverable 9.1: Results from initial requirements analysis: This document includes answers to some questions within WP9.
LIVE Staging and Directing System - a proposal: This document is intended to serve as an input for the definition of LIVE Conducting (Stag-ing) system. It describes envisioned functionalities, user interfaces for the LIVE Professional user, and proposes architecture of the Staging system
System arhitecture proposal: This file present a proposal for architecture of LIVE system and some of it's modules.
System modules: A scheme of modules divided by workpackages
The evaluation of a hybrid recommender system for recommendation of movies: In this paper we present our approach to generation of movie recommendations. The idea of our hybrid approach is to first separately generate predicted ratings for movies using the contentbased and collaborative recommender modules. Predicted ratings from both recommender engines are then combined into final classification by the hybrid recommender using weighted voting scheme. The basis for the calculations are Pearson’s correlation coefficient, True Bayesian prediction and M5Rules decision rules. The evaluation of the system performance was based on the EachMovie data corpus, for around 7000 users. Preliminary results show that this approach works really well, while there is still some room for improvement.
Personal content recommender based on a hierarchical user model for the selection of TV programmes: In this paper we present our approach to user modeling for a personalized selection of multimedia content tested on a corpus of TV programmes. The idea of this approach is to classify content (TV programmes) based on the calculation of similarities between the description of content and the user model for each descrip- tion attribute. Calculated similarities are then combined into a classi¯cation decision using the Support Vector Machines. The basis for the calculation of similarities is a hierarchical structure of the user model, overlaid upon a taxonomy of TV pro- gramme genres. Preliminary results show that it works well with a varying quality of content descriptions including incomplete genre classi¯cation and arbitrary number of description attributes. The evaluation of the system performance was based on content described using the TV-Anytime standard, but the approach can be adapted for search of other types of content with multi-attribute descriptions.
Analysis of cluttered scenes using an elastic matching approach for stereo images.: We present a system for the automatic interpretation of cluttered scenes containing multiple partly occluded objects in front of unknown, complex backgrounds. The system is based on an extended elastic graph matching algorithm that allows the explicit modeling of partial occlusions. Our approach extends an earlier system in two ways. First, we use elastic graph matching in stereo image pairs to increase matching robustness and disambiguate occlusion relations. Second, we use richer feature descriptions in the object models by integrating shape and texture with color features. We demonstrate that the combination of both extensions substantially increases recognition performance. The system learns about new objects in a simple one-shot learning approach. Despite the lack of statistical information in the object models and the lack of an explicit background model, our system performs surprisingly well for this very difficult task. Our results underscore the advantages of view-based feature constellation representations for difficult object recognition problems.
Improvement Speaker Clustering Using Global Similarity Features: In this paper global similarity features that improve speaker clustering based on standard bottom-up clustering are proposed. The novelty of this approach lies in the fact that it exploits the hypothesis that audio segments belonging to the same speaker cluster should demonstrate similar global behavior, i.e. in a way exhibit the same similarity and dissimilarity with all the other segments. Every segment is represented by a global similarity vector whose components are encoded by the distance between that segment and each of the other segments to be clustered. The distance between global similarity vectors is used for pre-selection of segment pairs having high global similarity for further merging. In this paper inter-segment distance for global similarity vectors based on Bayesian Information Criterion (BIC) and based on adapted cross likelihood ratio (CLR) are investigated. The evaluation, performed on radio programs, shows that the proposed approach represents an improvement in comparison with the baseline clustering.
Unsupervised Speaker Clustering Using a Global Similarity and F0 Features: This paper investigates an unsupervised speaker clustering approach that exploits global similarity and also proposes extending the standard cepstal feature set used for speaker clustering with prosodic features, extracted from F0. The global-similarity-based speaker clustering algorithm, initially proposed by the authors in [6], leverages the insight that audio segments within a single cluster are not only similar to one another, but also display the same patterns of similarities and differences with audio segments belonging to all other clusters. First, speaker clustering performance using the standard Bayesian Information Criterion (BIC) is compared to the performance achieved using a BIC-based algorithm incorporating global similarity. Then both clustering techniques are tested using an extended feature set including F0-derived features in addition to the standard cepstral features. The evaluation, which is performed on data recorded from German language radio, shows the clear benefits of using global information when performing clustering. It also demonstrates that in most cases F0-features outperform the cepstral feature set both in standard BIC clustering and in the BIC global-similarity-based approach.
MPEG-2 Compressed-Domain Algorithms for Video Analysis: This paper presents new algorithms for extracting metadata from video sequences in the MPEG-2 compressed domain. Three algorithms for efficient low-level metadata extraction in preprocessing stages are described. The first algorithm detects camera motion using the motion vector field of an MPEG-2 video. The second method extends the idea of motion detection to a limited region of interest, yielding an efficient algorithm to track objects inside video sequences. The third algorithm performs a cut detection using macroblock types and motion vectors.
Annual Public Report (D1.3): This document gives a report on the work and the results of the first year (2006) of the project.
Speaker Clustering via Bayesian Information Criterion using a Global Similarity Constraint: In this paper we proposed a global similarity constraint that improves speaker clustering as standardly performed using the Bayesian Information Criterion (BIC). The novelty of our approach lies in the fact that it exploits the hypothesis that audio segments belonging to the same speaker cluster should demonstrate similar global behavior, i.e. exhibit approximately the same pattern of similarity and dissimilarity with the all other segments. Every segment is represented by a global similarity vector whose components encode the BIC-based local similarity between that segment and each of the other segments to be clustered. Speaker clustering is performed bottom up using the BIC to compare each pair of segments and determine if their similarity is high enough to merge them. We use the global similarity vectors to constrain merging to segment pairs that have approximately the same patterns of global similarity. The evaluation, performed on audio data from 4 different German-language radio programs, shows that the proposed approach represents an improvement on the standard BIC clustering.
Object recognition with deformable feature graphs: A fundamental question in invariant object recognition is that of representation. This chapter reviews object representation based on deformable graphs that describe particular views of an object as a spatial constallation of image features. These representations are particular useful in situations of high clutter and partial occlusions. We demonstrate the benfits of these representations in three recognition applications: face analysis, hand gesture recognition and the interpretation of cluttered scenes composed of mutible partly occluded objects. We conclude by discussing current trends and open challenges.
Automatische Medienanalyse im digitalen Archiv durch Einsatz von MPEG-7 und MXF: Die Rolle des Archivs in den Arbeitsabläufen der Rundfunkanstalten wird mit der Konvergenz von IT-, Kommunikations- und A/V-Technik immer bedeutender. Die Wiederverwertbarkeit von Beiträgen ist zu einem wichtigen Ziel der Medienindustrie geworden. Digitale Archive erlauben den direkten und gleichzeitigen Zugriff auf gespeicherten Content. Damit Inhalte schnell und zielgenau gefunden werden können, werden qualitativ hochwerige Metadaten benötigt. Im vorliegenden Beitrag wird das Medienanalysesystem iFinderSDK zur automatischen Erzeugung von MPEG-7-Metadaten vorgestellt. MPEG-7 bietet ein sehr detailliertes XML-basiertes Metadatenmodell zur effektiven Suche in großen multimedialen Archiven. Zur Integration der Medienanalyse in den digitalen Produktions- und Archivierungsworkflow der Rundfunkunternehmen ist jedoch auch ein Standardformat zum Austausch von A/V-Material nötig. MXF bietet sich für diesen Zweck als eine gute Lösung an. Ein Konzept zur Integration einer MXF-Schnittstelle in das bestehende Medienanalysesystem iFinderSDK wird im folgenden genauer beschrieben.
An Extraction of Speech Data from Audio Stream Using Unsupervised Pre-Segmentaiton: In this paper we investigate an extraction of speech data from audio stream. Our method includes unsupervised optimal self-segmentation of the audio stream into small, homogeneous segments. The homogeneity is defined on a base of the average amplitude and a zero-crossing in a frame. A measure of the homogeneity is entropy. In our approach we calculate a relative ratio between the average amplitudes of the neighboring homogeneous segments. For a speech signal this ratio is less than a threshold defined on a short pure speech signal. As a discriminative feature we use a percent of the homogeneous segments within 1 sec interval having high relative amplitude ratio. In the process of the classification each 1 sec is labeled incrementally as a speech or a non-speech segment. The discrimination technique shows high performance for more than six-hour data that include different types of audio.
Automatic Extraction of MPEG-7 Audio Metadata Using the Media Asset Management System iFinder: This paper describes the MPEG-7 compliant media asset management system iFinder, which provides a set of automatic methods and software tools for media analysis, archiving and retrieval. The iFinder was developed for use in the media industry and consists of the iFinderSDK and the iFinder retrieval engine. The iFinderSDK is composed of a bundle of modules that realize individual technologies for audio and video metadata extraction. In this paper we present the audio content processing workflow and the pattern recognition methods implemented in iFinder. In particular, a technique for precise audio/text alignment and a browser that displays the synchronized media channels of the retrieval results are discussed. This paper also provides practical insight into how to use MPEG-7 as a standardized metadata format for media asset management.
Radio Relief: Radio Archives Departments Benefit from Digital Audio Processing: The archives departments of radio broadcasters are currently facing two significant challenges, namely, how to store rapidly increasing amounts of radio content, and how to satisfy the rising demand for easy retrieval of audio clips that can be recycled into new programs. A pilot project demonstrates that digital audio processing techniques have the potential to provide much-needed support.
Technology Market Watch (Deliverable 3.3): This document provides an overview of the existing technologies relevant to the LIVE project and especially to the future exploitation of the overall LIVE’s platform and other project results. Since the LIVE project is related to advance interactive content that relays on interactive digital television infrastructure, and in order to provide the full potential of the solutions that currently are under research, this document focuses on the study of interactive digital television.
Public Synopsis Interactive Digital Television (Deliverable 3.5): This Public Synopsis on Interactive Digital Television provides an overview of the iDTV market including a short background introduction and outline of interactive features. The different sections in which the document is divided cover the different types of existing services and solutions as well as market trends.
Public Synopsis Initial LIVE Exploitation Plan (Deliverable 3.2): This document is a public synopsis of the first “Initial LIVE Exploitation Plan” which is the Part C of the overall Plan for Using and Disseminating Knowledge (PUDiK). This document is the first step to prepare the LIVE consortium for the exploitation of the project’s results; it provides a detailed work roadmap for the Phase I & II of the project and some initial guidelines for Phase III (M37-45).
Interactive Digital Television (Deliverable 3.4): This document provides an overview of the Interactive Digital Television market including a short background introduction and synopsis of interactive features. The different sections in which the document is divided cover the different types of existing services and solutions as well as market trends; aiming to introduce the LIVE project to the current market depiction.
Risk Plan: This risk plan describes how we plan to assess and maintain possible risks within LIVE. Beside the general plans on how to handle the risk information, it mainly contains the risk table. Each risk entry is described with the following fields: • ID – a unique identifier for the detected risk. • Factor – a short description of the risk • Description – a more explanatory description of the risk • Grading – comprised by likelihood and seriousness (low, medium, high) • Ownership – who is responsible to keep an eye on the risk • Countermeasure – possible strategies to avoid or at least mitigate the risk or to react when the risk turned into a problem.
Quality Plan: The quality plan describes the main streams of LIVE that should be accompanied by QA activities: 1. Research and technical development The main activity to produce results such as know-how, tools, or services. 2. Field tests and analysis of user requirements The practical part for proof of concept and to verify the usability of developed tools. 3. Dissemination and Exploitation The valorisation of all project results. 4. Management The overall control of all activities. Strategies within LIVE are described to keep the project quality at a high level or improve it wherever possible.
Presentation of LIVE at the IST 2006: This is an extract from the presentation given at the IST 2006 conference in Helsinki.
JAME – System Concepts and New Technologies for iTV Services: This paper gives an overview on the JAME technology and its appropriate tools namely, JAME Producer and JAME Author, which constitute two different solutions for the production of so called page based iTV services.
JAME Author - An iTV Authoring System: JAME Author is an advanced MHP/OCAP authoring system for the straightforward creation of sophisticated, well-designed iTV services. By combining the efficiency, reliability and flexibility of JAME with the advantages of an easy-to-use graphical authoring tool, JAME Author adresses the needs of iTV designers, editors and many other media professionals. An assortment of features well-known from popular graphics tools and special TV/MHP related functions such as a built-in emulator for testing during creation right on-site ease and accelerate the process. This makes JAME Author a valuable tool for drafting first ideas and creating complete services. By using JAME Author, you define the design and behaviour of separate pages and connect them to a comprehensive iTV service by an inter page navigation structure. The integrated template and resource management allows the reuse of given and proven looks and helps you to support your branding. After finishing, the project can be deployed by transferring an archive, including all the created data and the MHP application JAME Engine, into an MHP compliant playout system. Further information and a free 30-days trial version can be found at http://www.jame.tv
Initial Requirements Analysis: This deliverable was created out of the very first anaysis of the LIVE-requirements. On the one hand there are the requirements for the staging concepts and on the other hand the supporting and necessary technical requirements to fulfill the new developed workflows and tasks.
Report on Test and Evaluation Methods: The present document provides an overview of approved testing and evaluation methods likely to be applied in the LIVE Project. Aiming at the LIVE System, the User Interfaces (UI) and the production workflow, the methods are adjusted to meet the specific requirements of the different sections.
Evaluation and Validation Plan: On the basis of Deliverable D10.1 this document describes the methods of usability evaluation and testing used for the LIVE System (the LIVE Methodology) and the organisation, consisting of management, communication, accomplishment and the schedule concerning the evaluation and testing of the LIVE System. The schedule is in accordance with the De-liverable 8.1 Description of the overall Implementation and Integration Plan.
Field Survey of Broadcaster (Field Trial Olympic Games Beijing 2008): By a first field survey, this deliverable describes the first outline on the way to the olympic broadcast operation of ORF and the EU-Live project. It gives also further details of the planning phase of the Beijing Broadcast Organisation (called BOB) as well as the planning of the broadcast intensions of ORF. This document is a living document.
IPTV - Definition and scope (Deliverable 3.9): IPTV is one of the biggest challenges of the broadcasting market. It offers various opportunities. This white paper aims to give an overview about these possibilities. IPTV distinguishes itself from several other new broadcasting formats. A short overview about IPTV markets in Europe as well as over its technical basis is given. Finally, the challenges for interface design and user experience are presented.
OCGen - MHP Object carousel generator: OCGen is a software tool generating MHP-compliant object carousels from a given directory structure. Object carousels are used to transmit MHP related data (application code and resources) to a compliant receiver. The tool creates a single or multi PID MPEG-2 transport stream ready for multiplexing with audio and video streams. Please note, that the documentation of the software is only available in German.
LIVE: Bringing broadcasting to the next level: Broadcasting is changing. With the advent of everything from set-up boxes, IPTV and 3DTV what can we expect the viewing experience of the future to be like? One IST project which is gathering steam is LIVE, which could prove to be TV’s most interactive ‘real-time’ experience.
Overview of LIVE Work Package 6, Personalisation and Feedback: Public overview of objectives and results of the work package 6, Personalisation and Feedback.
LIVE Overview Review Presentation 220307: The central idea of Live is to create: • Novel content production methods for live events • Tools for Interactive Digital Broadcasters • New ITV video formats and services • Non-linear, multi-stream formats to stage Live Media Events such as the 2008 Olympic Games
LIVE: Bringing broadcasting to the next level / June Edition: Broadcasting is changing. With the advent of everything from set-up boxes, IPTV and 3DTV what can we expect the viewing experience of the future to be like? One IST project which is gathering steam is LIVE, which could prove to be TV’s most interactive ‘real-time’ experience.
Presentation on integration work in LIVE: The following presentation is a public, shortened version of the presentation given at the review meeting in March 2007 at the ORF.
WP4 - Staging and Content Research - Consumer interfaces: The central aspect of this presentation is the conceptualisation of visions of consumer interfaces. It is based on the scribbles and screens provided on the review meeting in Vienna in March 2007. It envisages propositions of interfaces for two possible iTV (interactive Televi-sion) platforms, namely MHP (Multimedia Home Platform) and IPTV (Internet Protocol Television). The interface proposals rest upon the implications that both platforms provide.
Interaktives Livefernsehen der Zukunft: Mittendrin statt nur dabei: Interaktivität gilt als eine der "Killerapplikationen" der multimedialen Zukunft. Bisher konnten Zuschauer jedoch nur auf vorproduzierte TV-Inhalte Einfluss nehmen. Nun arbeiten Forscher in fünf europäischen Ländern daran auch LIVE-Fernsehen interaktiv zu machen.
Archives Poster: Poster used at the LIVE review meeting in March 2007 to explain the role of the archives in the LIVE system
Editor Room Poster: Poster used at the LIVE review in March 2007 to explain the role of the editor room in the LIVE system
Control Room Poster: Poster used at the LIVE review in March 2007 to explain the role of the control room in the LIVE system
Short Project Description for EU Unit E2 brochure 2007: Putting the viewer where the action is The LIVE project attempts to radically improve on the linear approach to TV broadcasting of live sporting events to deliver digital technologies and content formats that enable viewers to shape their own personal and highly interactive viewing experience as they watch the broadcast. The main idea of LIVE is to provide novel content production methods and new iTV video formats and services to enable interactive digital broadcasters to produce new non-linear multi-stream ‘shows’ to stage live media events such as the 2008 Olympic Games.
Content Recommendation System in the Production of Multi-Channel TV Programs: This paper presents the concept of content recommendations for the production of multi-channel TV shows. Within the 6th Framework project “LIVE – Live Staging of Media Events” [3] we are developing a production support system which will have a functionality of content recommendations and will support production of multi-channels programs. The paper outlines a concept of a multi-channel show and presents a possible workflow scenario on how to use content recommendations in the production. The details of the semantic content annotations are given and an example on computation of personalized recommendation of archive content is presented.
OCGen - MHP Object carousel generator (Software package): OCGen is a software tool generating MHP-compliant object carousels from a given directory structure. Object carousels are used to transmit MHP related data (application code and resources) to a compliant receiver. The tool creates a single or multi PID MPEG-2 transport stream ready for multiplexing with audio and video streams. This entry comprises the software package including the documentation.
D7.2 Basic Specification of the Intelligent Media Framework: This report presents the basic specification of one of the core subsystems developed in the LIVE project: The “Intelligent Media Framework” provides a robust framework for the creation, management and delivery of so called “Intelligent Media Assets” under real-time conditions. The specification provided in this report is called “basic” in the sense, that it reflects the requirements of the first 18 months of the project duration and specifies the subsystem to serve the integration of the first prototype of the LIVE production support system. The basic specification will be further extended in the course of the project.
First Prototype of the Intelligent Media Framework - D7.3 Documentation: This document is part of LIVE’s deliverable D7.3 “First Prototype of the Intelligent Media Framework” which is delivered in two parts: 1.Software: delivered on DVD/CD; 2.Documentation: this document. Part 2, the documentation, provides detailed information about the implementation of the Intelligent Media Framework for the 1st prototype as well as installation guidelines for the installation of the software delivered on DVD/CD as well as instructions on how to use the services of the Intelligent Media Framework. Not contained within this document are instructions on how to build the Intelligent Media Framework out of the TRAC-subversion system. Part 1 however is a packaged version of a tested IMF installation; all the described installation steps have been executed beforehand. The only required steps to run this particular installation are to extract the archive and the start the JBoss server by invoking the run.bat or run.sh file in the servers bin directory.
Semantic-based Realization of Novel iTV Formats for the Broadcasting of Media Events (Full Paper): Broadcasting of media events is a real-time action demanding reliable just in time decisions based on the current content of incoming video streams and the availability of background material. Novel iTV formats for broadcasting this type of event thus demand monitoring of multiple streams and background material. Due to the potentially large amount of streams and other available material, manual monitoring is likely to fail on the long term. We therefore developed an indexing pipeline based on semantic technologies that enables real-time analysis of broadcasted streams and reliable content recommendations of streams and background material based on formal machine understandable descriptions of content. Our approach enables real-time interpretation of broadcasted streams and thus establishes a bridge over the “Semantic Gap” in video analysis.
Journal Paper JVRB 2007 Vol.4: Video Composer and Live Video Conductor: Future Professions for the Interactive Digital Broadcasting Industry: Innovations in hardware and network technologies lead to an exploding number of non-interrelated parallel media streams. Per se this does not mean any additional value for consumers. Broadcasting and advertisement industries have not yet found new formats to reach the individual user with their content. In this work we propose and describe a novel digital broadcasting framework, which allows for the live staging of (mass) media events and improved consumer personalisation. In addition new professions for future TV production workflows which will emerge are described, namely the 'video composer' and the 'live video conductor'. online publication: http://www.jvrb.org/4.2007/1076/
LIVE Newsletter 2: This issue takes a closer look at the ideas and work behind the project. The point of departure is the LIVE technical view from which we will then explore in detail the individual LIVE system components. In short the LIVE approach represents a shift towards live broadcast shows that are dynamic and responsive to real-time events and changing needs of the audience.
Paper ICEC 2007: A Novel System for Interactive Live TV: In this work we describe our vision of next generation live iTV formats, which consist of a broadcast bouquet of meaningfully interwoven and cross-referencing parallel sub-channels covering a single live event in multi-view or even several concurring live events. At the same time these sub-channels have to serve a diversity of consumer interests and moods. To achieve this future live broadcasting production teams will need both, artistic and conceptual patterns to create such live formats, as well as a maximum technological support to realise such shows in real-time. We describe our developed foundational components of the envisaged system, which according to our approach consist of a set of live staging concepts, a framework for the management of intelligent media assets and a recommender system. Furthermore we argue for the integration of knowledge and sophistication achieved by live audio-visual artists, namely Video Jockeys, who hence participated in our first live staging tests. We conclude with a short description of our next step, the integration of instant consumer feedback, to complete the system for the upcoming field trial during the 2008 Olympics.
Paper eChallenges 2007: Next Generation Live iTV Formats and Aesthetics: A Joint Scientific and Artistic Approach: In this work we describe our vision of next generation live iTV formats, which consist of a broadcast bouquet of meaningfully interwoven and cross-referencing parallel sub-channels covering a single live event in multi-view or even several concurring live events. At the same time these sub-channels have to serve a diversity of consumer interests and moods. To achieve this future live broadcasting production teams will need both, artistic and conceptual patterns to create such live formats, as well as a maximum technological support to realise such shows in real-time. We describe our developed foundational components of the envisaged system, which according to our approach consist of a set of live staging concepts, a framework for the management of intelligent media assets and a recommender system. Furthermore we argue for the integration of knowledge and sophistication achieved by live audio-visual artists, namely Video Jockeys, who hence participated in our first live staging tests. We conclude with a short description of our next step, the integration of instant consumer feedback, to complete the system for the upcoming field trial during the 2008 Olympics.
LIVE Flyer: The LIVE project flyer provides a summarised look at the main areas of work in the project. Available as a PDF for download, size 2.6 MB. Designed in a three panel layout.
Basic Specification of the Intelligent Media Framework (D7.4): The objective of this report is to provide a synopsis of the basic specification of the Intelligent Media Framework as developed during the first iteration cycle of the LIVE project (from January 2006 to June 2007). The implementation of this specification formed the middleware of the first prototype of the LIVE production support system. The Intelligent Media Framework is introduced to be based on a combination of a classical three-tier architecture with the principles of service oriented architectures (SOA). This report is made available for and addressed to, the interested public. It presupposes some basic knowledge of software and knowledge engineering as well as some understanding of broadcasting issues. Topics covered in this report are: - An overview of the architecture of the LIVE production support system - An overview of the LIVE staging domain and the requirements of different agents in the LIVE staging process - The knowledge and the framework requirements of the Intelligent Media Framework - The knowledge model of the Intelligent Media Framework comprising the knowledge structure, the term model, the event domain model and the basic IMA model. - The architecture of the Intelligent Media Framework (system design). - Initial conclusions and an assessment of the requirements.
Shaping Tomorrow's LIVE iTV Broadcast Experience: Poster produced for the IBC Event in September 2007. Displays a user interaction scenario. The poster is only for promotional use and does not depict the actual LIVE user interface.
Shift from the single to a multi-channel viewing experience: LIVE poster produced for the IBC event in September 2007.
There is always more than one story to be told: LIVE poster produced for the IBC event in September 2007.
Tools for a complex iTV future: LIVE poster produced for the IBC event in September 2007
Real-time and Automatic Close-up Retrieval from Compressed Videos: In this paper, we propose a thorough scheme, by virtue of camera zooming descriptor with two-level threshold, to automatically retrieve close-ups directly from MPEG compressed videos based on camera motion analysis. In the retrieval process, we build camera-motion-based semantic retrieval. To improve the coverage of the proposed scheme, we investigate close-up retrieval in all kinds of videos. Extensive experiments illustrate that the proposed scheme provides promising retrieval results under real-time and automatic application scenario.
The LIVE System Architecture: This poster was produced for the IBC event in September 2007. It provides an overview of the various components in the LIVE system.
Camera Motion Analysis towards Semantic-based Video Retrieval in Compressed Domain: To reduce the semantic gap between low-level visual features and the richness of human semantics, this paper proposes new algorithms, by virtue of the combined camera motion descriptors with multi-threshold, to automatically retrieve the semantic concepts, i.e., close-up, and panorama, directly in MPEG compressed domain based on camera motion analysis. Extensive experiments illustrate that the proposed algorithms provide promising retrieval results under real-time application scenario and without human intervention
Face Detection based on Skin Color in Image by Neural Networks: Face detection is one of the challenging problems in the image processing. A novel face detection system is prsented in this paper. The approach relies on skin-based color features extracted from two dimentional Discreate Cosine Transfer (DCT) and neural networks, which can be used to detect faces by using skin color from DCT coefficient of Cb and Cr feature vectors. This system contains the skin color which is the main feature of faces for detection, and then the skin face candidate is examined by using the neural networks, which learn from the feature of faces to classify whether the original image includes a face or not. The processing is based on normalization and Discreate Cosin Transfer. Finally the classification based on neural networks approch. The expriment results on upright frontal color face images from the internt show an exellent detection rate.
A New Robust Watermarking Scheme for Color Image in Spatial Domain: This paper presents a new robust watermarking scheme for color image based on a block probability in spatial domain. A binary watermark image is permutated using sequence numbers generated by a secret key and Gray code, and then embedded four times in different positions by a secret key. Each bit of the binary encoded watermark is embedded by modifying the intensities of a non-overlapping block of 8*8 of the blue component of the host image. The extraction of the watermark is by comparing the intensities of a block of 8*8 of the watermarked and the original images and calculating the probability of detecting '0' or '1'. Tested by benchmark Stirmark 4.0, the experimental results show that the proposed scheme is robust and secure against a wide range of image processing operations.
Description of Online and Offline Metadata Extraction out of Sports Videos: We focus on online and offline metadata extraction and annotation out of sports videos. The main benefit of our method is immediate and automatic extraction and annotation of metadata by giving semantics to combinations of heterogeneous low-level visual features. It brings new opportunities for efficient utilisation of sports video in improved ways, and is easily customized to address the characteristics. Firstly, semantic scene classification is described, including key-frames extraction, similarities determination between shots, and rule based estimation of scene boundaries. Secondly, fuzzy logic based categorizing is presented, including paradigm, Fuzzy membership function, and fuzzy feature generation and similarity measure. Thirdly, automatic sports video annotation is proposed, including robust dominant colour region detection, combined motion feature analysis. This work has been evaluated in the TRECVID 2007 competition.
LIVE Public Annual Report 2007: This public annual report takes a look at some of the major activities and achievements of LIVE in 2007.
Specifications of Concepts and Professional User Interfaces for Live Staging with Consumer Feedback: In this document we specify concepts for Live Staging and the planning for Live Staging. In addition – where possible – procedures are defined which facilitate the development of a concrete Live Staging Concept by bringing the primarily artistic and intuitive approaches for the creation of live stories to a more formal level.
D8.2 First prototype broadcast gateway services: This document gives the background, the requirements and the usage of the software components, developed for the first prototype of the LIVE production support system. It serves as documentation to the actual deliverable D8.2, which comprises the binary files of the first prototype broadcast gateway services. The document shall mainly assist to install and to test the developed software.
D8.3 Report on the integration of the first system prototype: This document mainly gives a detailed summary on the components of the first prototype of the LIVE production support system. It reflects the implementation and integration plan and depicts the differences to the first prototype’s current status. Results from the evaluation of the first system integration test are given as well as conclusions based on the tests.
Recommender System Prototype Review Scenarios: This technical document defines the scenarios for the demonstration of the Recommender system first prototype at the Review meeting at Vienna in March 2007.
Recommender System services: Feedback Collection and Analysis Demo: Presentation of Recommender System Feedback Collection and Analysis service. Presented at the SID 3 in Sankt Augustin.
Review Poster: Editor: This document is a poster proposal for the demonstration of the Recommender system first prototype at the Review meeting in March 2007.
Recommender System User Interface: Scenarios and User interface: Presentation of WP6 scenarios, user interfaces, plans and current development to ORF. Presented at the SID 3 in Sankt Augustin.
WP6 Demos for the Review: Presentation of concepts, which were presented at the Review at Vienna in March 2007. Presented at the SID 3 in Sankt Augustin. Presents also scenarios and user interfaces.
First prototype of the Recommender System: Software Documentation (D6.2): This deliverable serves as an introduction and the user manual of the Recommender System First Prototype, which is a software component developed within the WP6. The goal of this document is to give an introduction to the first prototype of the Recommender System including its requirements and history, and to give an interested reader an explanation on how to use the Recommender System software.
Report on user models and content selection methods (D6.3): This deliverable presents an overview and current development in the fields of user modelling and content selection within WP6, “Personalisation and Feedback”. The report presents a step towards achieving the two of the main goals of the WP6, namely to develop user models of the LIVE Production Support System and to develop the concept of personalised content recommendations within the iTV staging (production) process.
Consumer Feedback Analysis and Presentation: This document is an input to the D4.5: Specifications of Concepts and Professional User Interfaces for Live Staging with Consumer Feedback.
SID4: Production and Consumer Recommendation Systems: This presentation presents consumer and LIVE video production recommender systems. It describes consumer recommendations scenarios and differences between standard production and production with Recommender System. Presented at SID 4 in Salzburg on July 2007.
Requirements for Consumer Profiling Data: This technical document defines the requirements for the Consumer profiling data which are needed within WP6 to build Consumer and Audience profiles (models).
Recommender System Overview (presentation): General presentation of Recommender System services, functionalities and user interfaces.
Recommender System Overview: Document which generally describes Recommender System first prototype services, functionalities and user interfaces.
iTV Workshop: Production Recommendations and Feedback: Presentation of consumer feedback modes, Recommender for production, usage of recommendations in the production workflows and results of evaluation of the recommender system at ORF. Presented at iTVWorkshop.
WP6 Status: User profiles, Feedback Analysis and content recommendations: Presentation of work carried out in WP6 and future work. Work on user modelling, feedback presentation, recommendations and issues and plans within wp6 are presented. Presented on PCC in Ljubljana on October 2007.
VC Profiles and Editor’s search templates: Document which describes VC profiles and editor's search templates. This document is intended to describe the options which are possible in developing the Professional User Profile within the recommender system, and describes the input which is needed from the Editor for the development of content selection process.
Specification of LIVE Recommender system (D6.4): This deliverable presents the updated specification of the Recommender system, which was developed on the basis of the results presented in the mentioned reports. The specification presented in this document is based on the updated requirements and results of the evaluations of the First Prototype. It represents a specification of the Second Prototype of the Recommender system which will be implemented during second phase of the project (until August 2008) and used and evaluated during field trial Olympic Games 2008.
WP6 Personalisation and Feedback: Status and Plans: Presentation of work carried out within WP6 and future plans. Presented at the PCC in Bradford on December 2007.
COMPRESSED-DOMAIN SHOT BOUNDARY DETECTION USING FINITE STATE MACHINE AND CONTENT-BASED RULES: We propose a fast and systematic method for shot boundary detection in compressed domain using content-based rules and FSM (finite state machine). Firstly, several feature indicators are acquired from DC images in MPEG videos including luminance, color, edge, prediction error and inter-frame difference as well as motion. Then, several content-based rules are utilized to detect abrupt cuts. Thirdly, boundaries of gradual transitions are determined by a coarse to fine procedure with a pre-processing module and a FSM. According to the experiments using publicly available sequences from TRECVID, the results have showed that the proposed algorithm outperforms the representative existing algorithms in both precision rate and recall rates.
Subspace Extension to Phase Correlation Approach for Fast Image Registration: A novel extension of phase correlation to subspace correlation is proposed, in which 2-D translation is decomposed into two 1-D motions thus only 1-D Fourier transform is used to estimate the corresponding motion. In each subspace, the first two highest peaks from 1-D correlation are linearly interpolated for subpixel accuracy. Experimental results have shown both the robustness and accuracy of our method.
A Block-Edge-Pattern based Content Descriptor in DCT Domain: In this correspondence, we describe a robust and effective content descriptor based on block edge patterns extracted directly in DCT domain, which is suitable for applications in JPEG or MPEG compressed images and videos. This content descriptor is constructed by a run-length edge-block histogram with three patterns including horizontal edge, vertical edge and no-edge. In comparison with existing descriptors, the proposed features: (i) low-cost computing suitable for real-time implementation and high-speed processing of compressed images or videos; (ii) robust to orientation changes such as rotation, noise, reverse etc. (iii) directly operates in compressed domain. Extensive experiments support that the proposed content descriptor is effective in describing visual content. In comparison with existing techniques, the proposed descriptor achieves superior performances in terms of retrieval precision and recall rates.
Real-time shot cut detection in compressed domain: In this short paper, we propose a fast and simple shot cut detection algorithm, which directly operates in compressed domain and suitable for real-time implementation. The proposed algorithm exploits the existing MPEG techniques by examining the prediction status for each macro-block inside B frames and P frames. As a result, locating both abrupt and dissolved shot cuts is operated by a sequence of comparison tests, and thus no feature extraction or histogram differentiation is needed. Although the description of the algorithm is primarily based on MPEG-1 and MPEG-2 streams, the scheme can be readily extended to other video compression standards such as MPEG-4 and H.264 by following the principle on monitoring: (i) balance between forward prediction and backward prediction; and (ii) boundaries among P, B and I frames. Extensive experiments illustrate that the proposed algorithm outperforms similar existing algorithm, providing a useful technique for fast and on-line video content processing.
Progressive content access to databases of JPEG compressed images: Progressive content access provides a mode that allows a coarse version of an image being viewed at a lower computing cost and then gradually refined by subsequent resolution enhancement if required. This proves extremely useful when millions of compressed images and video sequences need to be browsed manually or processed in pixel domain, saving the cost and removing the necessity of full decompression. In this paper, we propose such a progressive content access algorithm suitable for all DCT-based JPEG and MPEG compressed files. We first develop a theoretical model in approximation of cosine function used in IDCT with various orders. Following that, we then propose a progressive content access algorithm, which comprehends both the successive approximation and the spectral selection. Further analysis and experiments are reported to show that our proposed algorithm saves computational cost in comparison with JPEG full decompression. Extensive experiments also support that the proposed algorithm achieves encouraging PSNR values for reconstructed images even with lower order approximation.
Recognition of JPEG Compressed Face Images Based on AdaBoost: This paper presents an advanced face recognition system based on AdaBoost algorithm in the JPEG compressed domain. First, the dimensionality is reduced by truncating some of the block-based DCT coefficients and the nonuniform illumination variations are alleviated by discarding the DC coefficient of each block. Next, an improved AdaBoost.M2 algorithm which uses Euclidean Distance(ED) to eliminate non-effective weak classifiers is proposed to select most discriminative DCT features from the truncated DCT coefficient vectors. At last, the LDA is used as the final classifier. Experiments on Yale face databases show that the proposed approach is superior to other methods in terms of recognition accuracy, efficiency, and illumination robustness.
Robustness Analysis on Facial Image Description in DCT Domain: In this letter, we report a DCT domain analysis of facial images to reveal that, when certain number of DCT coefficients are removed, the corresponding facial image description by the remaining DCT coefficients becomes robust to lighting changes and scale variations. Such nice properties would be very useful for applications of face recognition, video object tracking, object segmentation and visual content processing.
Statistical Classification of Skin Color Pixels from MPEG Videos: Detection and classification of skin regions plays important roles in many image processing and vision applications. In this paper, we present a statistical approach for fast skin detection in MPEG-compressed videos. Firstly, conditional probabilities of skin and non-skin are extracted from manual marked training images. Then, candidate skin pixels are identified using the Bayesian maximum a posteriori decision rule. An optimal threshold is then obtained by analysis of probability error on the basis of the likelihood ratio histogram of skin and nonskin pixels. Experiments from sequences with varying illuminations have demonstrated that effectiveness of our approach.
Update Knowledge Management and Dissemination Plans (PUDiK Parts A + B): LIVE project results are valuable knowledge that have to be managed in order to be used for dissemination during the project and commercial use after the project. For the purpose of safeguarding the overall strategic impact of the project across all activities and work packages the consortium implements a detailed “Plan for Using and Disseminating Knowledge (PUDiK)”. Work package 2 develops two parts of the PUDiK reflecting two of the strands of innovation-related activities of the project: PART A covering issues of “knowledge management”, and PART B covering “dissemination”. This version is an update of PUDiK A and B for 2007. It presents the results of managing and disseminating the project’s knowledge. Each section also provides a future focus component that outlines the major activities planned for the year 2008 and beyond.
Report on Networking with Adjacent Research Communities: This document takes a look at the latest networking activities of the LIVE project with related research projects and VJ community. Beyond the broad dissemination activities of the LIVE project to the research community the eleven projects plus VJ community listed below have been identified as relevant to the development work of LIVE. These projects have been selected based on the state-of-the-art analysis work performed in each work package, and in many cases builds on the partners’ established expert networks. This list will be updated and expanded according to the input received from the work package leaders.
Knowledge Acquisition from Multimedia Content: Proceedings of the First International Workshop, KAMC 2007 Genova, Italy, December 5, 2007. In recent years significant advances have been made in the area of automatic ex- traction of low-level features from audiovisual content. However, little progress has been achieved in the identification of high-level semantic features or the effective combination of semantic features derived from different modalities. Knowledge acquisition is becoming a key-enabling factor of the above tasks towards more scalable and reliable solutions, and thus its automation is becoming critical. As the deployment of knowledge enhances the robustness of extraction while on the other hand the continuous extraction of semantic information can enrich this knowledge, synergistic approaches that combine multimedia extraction and knowledge evolution in a bootstrapping common framework introduce new opportunities in semantic multimedia applications. Integration with additional sources of information, e.g. by using human annotation tools or real-time event services, may further simplify and disambiguate semantic multimedia information systems. Moreover, adaptation to a particular domain, for example to sports events, such as the Olympic games, is essential in order to reduce the complexity of multimedia analysis. In this context, unified modelling and representation of multimedia and domain-specific knowledge, ontology evolution, and standard and non-standard inference services for multimodal semantic knowledge fusion, form cutting edge technologies. The aim of this workshop is to intensify the exchange of ideas between the different research communities involved which range from multimedia analysis to reasoning with ontologies. The submitted contributions published in these proceedings therefore reflect current research in this area: the topics range from multimedia classification based on textual information, content based shot classification, feature extraction to image classification based on ontologies. The submitted papers cover different application domains, i.e. broadcasted news or legal documents. We would like to thank all members of the program committee for supporting us in the reviewing process, the organizers of the main conference SAMT 2007 to which this workshop was co-located - especially Yannis Avrithis, Michela Spagnuolu and Francesco Robbiano - for their kind support throughout the organizational process.We also would like to thank the authors for their willingness to revise their initial submissions based on the reviewers comments. Finally we would like to thank our invited speakers, Fabio Ciravegna and Alan Smeaton for their willingness to give a talk at our workshop.
D8.4 Implementation and Integration Plan for the second prototype: Based on the implementation of the first prototype version of the LIVE System [LIVE D8.3] and the experiences made during testing and evaluation done by WP10, the system requirements and the related architecture have been revised by WP9. Based on the outcome of this work the second prototype will be implemented, which is intended to be already used in a real live TV production scenario. During the Summer Olympics 2008 in Beijing the ORF plans to conduct a field trial covering up to six inter-linked multi-stream video shows. The LIVE System shall support the video conducting team in this task. This includes technical implementations in terms of software tools developed by the technical work packages WP5-8 as well as concepts and methods invented and tested by the content research and TV production related work packages WP4, WP10 and WP11. The second prototype of the LIVE System is again supposed to demonstrate the results of the research and implementation work so far. But in contrast to the first prototype this one is foremost targeted to the goal of supporting the staging of six inter-linked multi-stream video shows during the Olympic field trial in summer 2008. The second prototype no longer comprises only software tools and methods for the production phase of the staging process, but also deals with the required preparation for this process. This deliverable introduces the second prototype version of the LIVE System as it will be used during the Summer Olympics 2008 taking place in Beijing. It summarises the current status of the planning and specification work of the last 6 months and gives an outlook on the upcoming steps in terms of a time table. The document is therefore divided into two main parts; the first part introduces the current state of the second system prototype, summarising the current state of planning and specification first and depicting the integration task in more detail afterwards. The second part presents the steps, phases and milestones towards implementing and integrating the system in a condensed way.
D9.4 Revised Requirement Analysis: The integrated project “LIVE Staging of Media Events” (LIVE; FP6-27312) aims at the creation of novel intelligent content production methods and tools for interactive digital broadcasters to stage live media events in the area of sports, such as the 2008 Olympic Games. This report provides the revised requirements analysis based on the requirements formulated by users and based on the evaluation of the 1st prototype. The requirements outlined throughout this document give an overall view of the LIVE production support system. Some of them are already known and also stated in [LIVE D9.1]. Due to the limited amount of user tests and evaluation results, the initial requirements were mainly driven by technical issues whereas this document aims to be more users centric in the way that the results of the user tests and evaluation phase have been used to describe user scenarios of the dedicated LIVE users. The LIVE production support system comprises an overall system designed to support not only the real LIVE production of the show but also the entire life cycle of broadcasters including the preparation, production and post-processing of a show. To complete the production life cycle, post-processing of a show has been examined and is supported mainly by providing storage functionality for information created during production for later usage. The requirements analysis given in this document is mainly driven by the user scenarios outlined in chapter 3. These scenarios are mainly concerned with the different phases of the production life cycle. The scenarios are related to the distinct users dealing with the LIVE production support system. Based on the user scenarios, chapter 4 lists requirements for the entire system by concentrating on the tools to provide the required functionality to the mentioned users. As a result, a list of tools is given, which all together comprise the LIVE production support system. These tools are divided into four main groups: The first group covers tools of the so called Management Space covering the pre-production and post-processing as well as all kinds of management tasks. The remaining three groups match with the already known LIVE user spaces called the Annotation Space, the Editor Space and the Consumer Space. This chapter is to be seen as a technical reference suitable to verify the fulfilment of the requirements during the implementation phase. Chapter 5 gives a technical description of the use cases which again is used as a technical reference. The template used when creating the use cases is provided in Appendix A. Finally, chapter 6 provides a conclusion where all the raised issues are again collected and hints with respect to the architecture are given.
D9.5 Revised System Architecture: The integrated project “LIVE Staging of Media Events” (LIVE; FP6-27312) aims at the creation of novel intelligent content production methods and tools for interactive digital broadcasters to stage live media events in the area of sports, such as the 2008 Olympic Games. This report presents the revised system architecture based on the revised requirements analysis given in [LIVE D9.4] and the evaluation of the 1st prototype. The revised system architecture is presented on a component-based level with the respective interfaces. This document does not make assumptions on the implementation techniques. The LIVE production support system comprises an overall system designed to support the entire life cycle of live staging including the preparation, production and post-processing of a show. Chapter 3 presents the observed workflows for all three phases. It picks up the already defined workflows from [LIVE D9.2] and adapts and amends them according to the revised requirements from [LIVE D9.4]. A detailed matching between requirements and tasks from the workflows is presented. Furthermore, a detailed workflow for the preparation phase and a less detailed workflow for the post-processing phase have been added. Finally, chapter 3 provides a short subsumption of necessary changes to the architecture coming from the workflows. After a very short retrospection on the architecture of the first prototype, chapter 4 presents the new system architecture based on the revised workflows. This is accomplished by providing a component-based view on the one hand and more detailed inspections on newly defined components and components which have been subject to major changes on the other. The first part intends to give an overview on the performed adaptations of the architecture for each component. The latter part is meant to serve as a guideline for the developers of the various components and tools on which interfaces will be needed between which components and which data has to be exchanged. Finally, chapter 5 provides a conclusion reflecting the changes to the architecture.
Initial LIVE exploitation plan PUDiK Part C (3.11): This document updates the Initial Exploitation Plan that set out to describe the LIVE platform solution developed by the LIVE consortium and to provide a framework in which the exploitation strategies of the consortium partners will be progressively defined and refined during the project lifetime and beyond.
Extended Specification of the Intelligent Media Framework (D7.5): This report presents the extended specification of the Intelligent Media Framework (IMF), one of the core subsystems acting as the middleware for the LIVE production support system. The framework provides the following services to other LIVE subsystems, such as the Metadata Generation System and the Recommender System: Services to create, annotate and manage the intelligent media assets that make up the show under real-time conditions. These services operate on a metadata level and do not actually store any raw video streams (they rather reference these so called “essences”); Services to access the vocabularies and the terms of the controlled vocabulary constituting the knowledge base of the live staging domain; Services to manage and deliver information about the staged events, e.g. the schedule of the contests and races, the participating athletes, the results, etc; A messaging system to support the real-time aspects of the staging process by offering subscription methods to other subsystems. The Intelligent Media Framework is based on a combination of a classical three-tier architecture with the principles of service oriented architectures (SOA). Moreover, the framework relies on a knowledge model for the LIVE staging domain that on a semantic level integrates information about the event, the content, the users involved in the production process and the concepts of presenting the event (“staging”). The objective of this report is to provide an up to date specification of the knowledge model, the services and the components of the Intelligent Media Framework. A basic specification of the IMF has been presented in [LIVE D7.2]. This documents focuses on those parts of the specification which were updated or extended in comparison to the basic specification. In all other cases D7.2 is just referred. The extended specification presented in this document will form the basis for the implementation of the 2nd prototype of the IMF [LIVE D7.6] which will be used for staging the Olympic Games 2008 in Peking.
European Broadcasters Survey (3.12): This document reports on methodologies, rational and content for a survey of European Broadcasters about interactive TV, their plans for the future and how the LIVE platform could fit into those plans. The survey is being carried out by the LIVE exploitation team and in this version of the document only initial results and conclusions are provided.
First LIVE Pre-commercial marketing strategy (3.13): This document provides a description of the pre-commercial strategy and report the precommercial activity that has been taken in 2007. The document also reports a change on the pre-commercial strategy which was centred in the results of the Workshop activity, which due to technical issues was not possible. The content concentrates on that marketing strategy destined to exploitation activity and therefore, that there is a parallel dissemination strategy in place that (not reflected on this particular report) but that is intrinsically making these efforts also possible.
Subsampling-based image watermarkng in compressed DCT domain: In this paper, a new embedding strategy for watermarking is presented based on DC components of subimages in compressed discrete cosine transform (DCT) domain. These subimages are obtained through subsampling the host image. More robustness has been achieved when watermarks are embedded in perceptually significant DC components. Furthermore, the original image is not required in the extraction process. Experimental results show that the proposed scheme successfully makes the watermark perceptually invisible and robust for a wide range of attacks, including JPEG-loss compression, filtering, scaling, and cropping attacks.
D5.2 Report On Live Human Annotation: This document reports on human annotation within the LIVE project. First it gives an overview about different annotation types that are useful for the LIVE staging of media events. It then summarizes the requirements for manual annotation by collecting results from potential users, e.g. from discussions performed with broadcasters, reporters, editors and video jockeys (VJs). It defines the necessary content metadata needed within the LIVE system, gives an overview over existing tools and describes the tools developed for the LIVE project. Finally, user evaluations of the developed tools that were performed with professional users from the ORF are described at the end of the document.
An efficient face image retrieval through DCT features: This paper proposes a new simple method of DCT feature extraction that utilize to accelerate the speed and decrease storage needed in image retrieving process by the aim of direct content access and extraction from JPEG compressed domain. Our method extracts the average of some DCT block coefficients. This method needs only a vector of six coefficients per block over the whole image blocks In our retrieval system, for simplicity, an image of both query and database are normalized and resized from the original database based on the cantered position of the eyes, the normalized image equally divided into non overlapping 8X8 block pixel Therefore, each of which are associated with a feature vector derived directly from discrete cosine transform DCT. Users can select any query as the main theme of the query image. The retrieval images is the relevance between a query image and any database image, the relevance similarity is ranked according to the closest similar measures computed by the Euclidean distance. The experimental results show that our approach is easy to identify main objects and reduce the influence of background in the image, and thus improve the performance of image retrieval.
Presentation Pamplona: Presentation in Pamplona, Spain - 30.05.2008
D5.4 Report on evaluation of methods: This document reports on the first evaluation of tools developed in the LIVE project for manual, semiautomatic and automatic annotation and extraction of knowledge in work package 5. We start this report with findings on the international TRECVID 2007 evaluation of LIVE tools for automatic shot boundary classification. The compressed domain shot boundary detector developed in the LIVE project showed the third best recognition performance of all 15 participating research groups in this competition. Despite the excellent results, the generalization of the performance from news and documentary data used in TRECVID 2007 to more difficult sports data produced by the LIVE streams of Olympia 2008 remains difficult. Only further evaluations on labelled data stemming from Olympia 2004 and the upcoming Olympia 2008 event will show how suitable the developed technology is for extracting information automatically from sports broadcasts – a domain, for which neither standard international benchmarks nor any international competition exist. The detection of gradual transitions in sports video must still be considered unsolved and need further research. However, the evaluation results of TRECVID show the potential of the developed technology and their maturity. The next section of this document deals with the performance of different face recognition methods which are developed in the LIVE project to identify athletes and other important persons in the video stream automatically. We measure the performance in rather controlled optimal situations, benchmarked on the Bochum gallery, but also on a “worse-case” gallery with rather mixed content. The result is promising but uncontrolled environment and incorrect feature correspondence lead to poor results – especially if more advanced P2D-HMMs face recognition technology is applied. Hence, component face detectors have been developed in the project in order to improve the correspondence search in pose estimation before any identification can be performed. We report in this document on the performance of several face component detectors for eyes, nose and mouth locations developed in the course of the project to improve face pose estimation and recognition. Despite the fact that the performance of individual face component detectors is quite high when evaluated on a test set stemming from the same database, generalization of the facial recognition algorithms to other more uncontrolled galleries remains a challenge. However, as the integration of the face component detectors in the face recognition framework is still lacking, no sound evaluation can be performed. We will report in an upcoming report D 5.7 on the results of our research and how the different algorithms perform on Olympia 2008 sports data during the field trial.
A Block-Edge-Pattern-Based Content Descriptor in DCT Domain: In this correspondence, we describe a robust and effective content descriptor based on block-edge patterns extracted in discrete cosine transform domain, which is suitable for applications in JPEG or MPEG compressed images and videos. This content descriptor is constructed by a run-length edge-block histogram with three patterns including horizontal edge, vertical edge and no edge. In comparison with existing descriptors, the proposed features: 1) low-cost computing suitable for real-time implementation and high-speed processing of compressed videos; 2) robust to orientation changes such as rotation, noise, reverse, etc.; 3) operates in compressed domain. Extensive experiments support that the proposed content descriptor is effective in describing visual content, and achieves superior performances in terms of retrieval precision and recall rates.
Agenda iTV: Agenda iTV of LIVE project
Invitation Workshop iTV 2nd July 2008: Invitation Workshop iTV
LIVE Olympic Trial Press Release Brochure: The LIVE production system will be tested at ORF (Austrian Broadcasting Corporation) during the Beijing Olympic Games. A total of 500 Austrian households will view and interact with the "LIVE Olympic Show". Over the two-week period a total of four interlinked channels will be produced. If successful LIVE could change the way we view live events such as the Olympics, the FIFA World Cup or a political election - on a permanent basis. Beyond the clear advantage of having fuller coverage of the event itself, those irritating moments of not knowing about the details of a sporting event—e.g. details about the contestants, the history behind it or, information on the venue—will be conveniently dispensed with by the power of this latest and pioneering broadcasting information technology. But what might even be more important: For the first time it will be possible to serve the always diverse moods of viewers by simultaneously offering multiple points of view on one and the same live event. As in real life there is always more than one story to be told.
D3.15 Technology Market Watch Update1: This is the update of the Technology market watch report. This report provides an updated vision of the Media Streaming industry, which is used to support the technical developments that are being carried out in the project. Nevertheless, the most relevant use of this report is in the exploitation tasks and especially in the development of the business plan.
LIVE Newsletter Issue 3: Welcome to the third LIVE Newsletter. The LIVE production system will be tested at ORF (Austrian Broadcasting Corporation) during the Beijing Olympic Games. A total of 500 Austrian households will view and interact with the "LIVE Olympic Show". Over the two-week period a total of four interlinked channels will be produced. If successful LIVE could change the way we view live events such as the Olympics, the FIFA World Cup or a political election - on a permanent basis. Beyond the clear advantage of having fuller coverage of the event itself, those irritating moments of not knowing about the details of a sporting event—e.g. details about the contestants, the history behind it or, information on the venue—will be conveniently dispensed with by the...
Bringing 'Intelligence' to iTV: The Intelligent Media Framework - Poster: Poster presentation of the role of the intelligent media framework in the LIVE project. It also provides and overview of the technologies and services of the intelligent media framework.
Second Prototype of the Intelligent Media Framework (D7.6): This document is part of LIVE’s deliverable D7.6 “Second Prototype of the Intelligent Media Framework” which is delivered in two parts: 1. Software: delivered on DVD/CD 2. Documentation: this document The IMF software package consists of the service implementation, the IMF Client packages and the IMF Toolset. The core part of the IMF is delivered as an Enterprise Archive File (EAR) which can be deployed on JEE1 compatible Applications Servers. The accompanying IMF Toolset has been developed as Eclipse Rich Client Platform (RCP) applications which are currently deployed for the Windows Platform. The required communication between clients and the server part is covered by the IMF Client packages. However, access to the core part of the IMF is not limited to the IMF Toolset: The LIVE annotation tools and the LIVE recommender tools are build on top of the IMF client packages. The documentation, provides detailed information about the setup, deployment, installation and configuration of the 2nd prototype of the Intelligent Media Framework. This document serves on one hand as an installation guide for the software delivered on DVD/CD. On the other hand it aims to provide usage instruction of the provided services and how to benefit from the provided client packages.
Face Detection based Neural Networks using Robust Skin Color Segmentation: This paper proposes a robust schema for face detection system via Gaussian mixture model to segment image based on skin color. After skin and non skin face candidates’ selection, features are extracted directly from discrete cosine transform (DCT) coefficients computed from these candidates. Moreover, the back-propagation neural networks are used to train and classify faces based on DCT feature coefficients in Cb and Cr color spaces. This schema utilizes the skin color information, which is the main feature of face detection. DCT feature values of faces, representing the data set of skin/non-skin face candidates obtained from Gaussian mixture model are fed into the back-propagation neural networks to classify whether the original image includes a face or not. Experimental results shows that the proposed schema is reliable for face detection, and pattern features are detected and classified accurately by the backpropagation neural networks.
Demo of Video Conducting the Olympic Games 2008: The iTV Field Trial of the EU-IST Project LIVE: In the EuroITV 2008 the LIVE project team will present an interactive audio-visual demo of the LIVE Video Conducting Concept to the attending research community. Carmen Mac Williams, Roland Westermaier, Torsten Kliemand, In: Proceedings of the EuroITV 2008: July 3 - 4, 2008, Salzburg, Austria.
Fusion of intensity and channel difference for improved colour edge detection: Edge detection, especially from colour images, plays very important roles in many applications for image analysis, segmentation and recognition. In this paper, a new colourgray mapping method for effective colour edge detection is proposed. From any given colour image C, a gray image D is defined as the accumulative differences between each of its two colour channels, and another gray image R is then obtained by weighting of D and gray intensity image G. Fusion of edges extracted from R and G forms the final results. Comparing with edges detected from traditional colour spaces like RGB, YCbCr and HSV, all using same Canny operator, it seems the proposed method can achieve more effective results from different test images.
ROBUST MULTIPLE WATERMARKING IN COLOR IMAGES WITH CORRELATION COEFFICIENT DETECTOR: In this paper, we propose a robust multiple digital watermarking technique for the copyright protection of digital color images. The watermark is a binary image, which is divided into four parts, each encrypted using a secret Key and embedded using the spatial domain into four different regions of size 128×128 of the blue component of the color image. Watermark extraction is based on the comparisons between the original intensity pixel values and the corresponding watermarked intensity pixel values in blocks of size 8x8. The watermark extracted bits are determined using the probabilities of detecting bit '1' or bit '0'. The watermark can be extracted in sixteen parts but only four of these are selected by a correlation coefficient detector and used to reconstruct the extracted watermark. Experimental results show that the proposed scheme successfully makes the watermark perceptually invisible and robust for a wide range of attacks, including JPEG loss compression, median filtering, low pass filtering, rotation, rotation-scaling, rotation-crop, image cropping, image scaling and self similarity attacks.
Knowledge-supported segmentation and semantic contents extraction from MPEG videos for highlight-based annotation, indexing and retrieval: Automatic recognition of highlights from videos is a fundamental and challenging problem for content-based indexing and retrieval applications. In this paper, we propose techniques to solve this problem by using knowledge supported extraction of semantic contents, and compressed-domain processing is employed for efficiency. Firstly, video shots are detected by using know-ledge-supported rules. Then, human objects are detected via statistical skin de-tection. Meanwhile, camera motion like zoom in is identified. Finally, highlights of zooming in human objects are extracted and used for annotation, indexing and retrieval of the whole videos. Results from large data of test videos have demonstrated the accuracy and robustness of the proposed techniques.
Video Conducting the Olympic Games 2008: The iTV Field Trial of the EU-IST Project LIVE: In the upcoming field trial of LIVE a Video Conductor and his team at the public Austrian TV Station ORF will stage a live non linear multi-perspective show around the Olympic Games 2008 with the instant feedback of 500 invited Austrian Telecom IPTV test end users. The aim of the field trial is to improve the public TV service to the Austrian public by dynamically linking multistream videos as the live event of the Olympic Games 2008 and as the viewers demand it. The Video Conductor ensures a quality of drama by linking the multi-stream videos responding to the unfolding sport action and the audience’s mood. Carmen Mac Williams, Richard Wages; In: Proceedings of the 3rd ACM International Conference on Digital Interactive Media in Entertainment and Arts, DIMEA 2008, September 10 - 12, 2008, Athens, Greece
Skin Detection from Different Color Spaces for Model-based Face Detection: Skin and face detection has many important applications in intelligent human-machine interfaces, reliable video surveillance and visual understanding of human activities. In this paper, we propose an efficient and effective method for frontal-view face detection based on skin detection and knowledge-based modeling. Firstly, skin pixels are modeled by using supervised training, and boundary conditions are then extracted for skin segmentation. Faces are further detected by shape filtering and knowledge-based modeling. Skin results from different color spaces are compared. In addition, experimental results have demonstrated our method robust in successful detection of skin and face re-gions even with variant lighting conditions and poses.
University of Bradford at TRECVID 2008 Content Based Copy Detection Task: We present a novel method for spatial-temporal video copy detection based on adaptive masking. Firstly, a dedicated video analysis is implemented for input videos, which ensures the accurate detection of complicated distortions query videos may undergo. Secondly, simple signatures are extracted for the benefit of time and space efficiency, and the frame mask is generated adaptively to reduce video temporal redundancy. Thirdly, a matching process is implemented to find video copies. The proposed video copy detection framework is effective, and robust against spatial and temporal variations.
Bringing “Intelligence” to iTV: The Intelligent Media Framework: This paper gives an overview of a software frame¬work designed for the creation of interactive multi-channel television shows. The “Intelligent Media Framework” forms the middleware of an iTV production support system developed in the context of the European integrated project “LIVE”. The framework is designed according to service oriented architecture (SOA) principles for easy integration into existing iTV and TV production environments. Moreover, the Intelligent Media Frame-work is based on a knowledge model formalising the main aspects identified to make up the domain of real-time staging of media events: the content (media clips and media streams), the events, the staging and the users (professional users and consumers). The framework offers services for the development of tools assisting the production team of multi-channel iTV shows in an intelligent way: The envisaged “intelligence” is based on formal, machine understandable descriptions of the content and the events: This document introduces the knowledge model and provides an overview of the architecture of a media framework designed to support the iTV production process in an intelligent way.
LIVE - a system for consumer-personalised production of TV programmes: This paper presents the concept of viewer feedback in the production of multi-channel TV shows. Within the IST project LIVE; Live Staging of Media Events we are developing a production support system which will have a functionality of content recommendations and will support production of multi-channels programs. The paper outlines a concept of a recommender and feedback system for the multi-channel TV production and presents examples of the feedback tools within the TV production office. The LIVE system enables the Director to track the preferences of the TV viewers in real-time, during the live production of the show, and on the other hand give the viewers the possibility to actively influence the TV content.
Ein Ansatz zur Unterstützung traditioneller Klassifikation durch Social Tagging: Der vorliegende Beitrag stellt einen Ansatz zur Kombination von traditionellen, geschlossenen Klassifikationsverfahren mit offenen, auf Social Tagging basieren-den Klassifikationsverfahren vor. Die Darstellung geht von den grundsätzlichen Anforderungen an die Suche und Navigation in Dokumentenarchiven aus, erörtert die Vor- und Nachteile von geschlossenen und offenen Klassifikationsansätzen und präsentiert schließlich einen kombinierten Lösungsansatz, der im Rahmen ei-nes Prototypen umgesetzt wurde. Der Lösungsansatz sieht vor, dass Dokumente grundsätzlich mit freien Tags klas-sifiziert werden können: Die Klassifikation wird jedoch durch ein kontrolliertes Vokabular unterstützt. Freie Tags werden in einem nachgeordneten, moderierten Prozess in das kontrollierte Vokabular übernommen. Das auf diese Weise wach-sende und laufend gepflegte Vokabular unterstützt die Suche und Navigation im Dokumentenraum.
Recommender System for the Multi-Channel TV Production: This paper presents the concept of content recommendations for the production of multi-channel TV shows. Within the IST FP6 project "LIVE – Live Staging of Media Events" we are developing a production support system which will have a functionality of content recommendations and will support production of multi-channels programs. The paper outlines a concept of a recommender system for the multi-channel TV production and presents basic architecture and workflows within the system. The recommendation of the archive content for a given channel is personalized by taking into account the profile of the target audience.
Hierarchical Modeling and Adaptive Clustering for Real-time Summarization of Rush Videos: In this paper, we provide detailed descriptions of a proposed new algorithm for video summarization, which are also included in our submission to TRECVID’08 on BBC rush summarization. Firstly, rush videos are hierarchically modeled using the formal language technique. Secondly, shot detection are applied to introduce a new concept of V-unit for structuring videos in line with the hierarchical model, and thus junk frames within the model are effectively removed. Thirdly, adaptive clustering is employed to group shots into clusters to determine retakes for redundancy removal. Finally, each most representative shot selected from every cluster is ranked according to its length and sum of activity level for summarization. Competitive results have been achieved to prove the effectiveness and efficiency of our techniques, which are fully implemented in the compressed domain. Our work does not require high-level semantics such as object detection and speech/audio analysis which provides a more flexible and general solution for this topic.
An Analysis of New Feedback Methods for Parallel Multi-Stream Productions: In this work we explore the usage of novel real-time feedback tools in the context of a new iTV production process, developed within the scope of the research project LIVE. The exploration is based on analysis of log-files, observations and interviews captured during a field trial at the Austrian broadcaster ORF. We work out characteristic usage patterns, as well as the broadcaster's and end user's acceptance. In doing so, we give an insight into the possibilities of feedback tools with regard to parallel multi-stream productions.
Shot Boundary Detection in MPEG Videos using Local and Global Indicators: Shot boundary detection (SBD) plays important roles in many video applications. In this paper, we describe a novel method on SBD operating directly in compressed domain. Firstly, several local indicators are extracted from MPEG macroblocks, and AdaBoost is employed for feature selection and fusion. The selected features are then used in classifying candidate cuts into five sub-spaces via pre-filtering and rule-based decision making. Following that, global indicators of frame similarity between boundary frames of cut candidates are examined using phase correlation of DC-images. Gradual transitions like fade, dissolve and combined shot cuts are also identified. Experimental results on the test data from TRECVID’07 have demonstrated the effectiveness and robustness of our proposed methodology.
Extracting Objects and Events from MPEG Sequences for Video Highlights Indexing and Retrieval: Automatic recognition of highlights from videos is a fundamental and challenging problem for content-based indexing and retrieval applications. In this paper, we propose techniques to solve this problem using knowledge supported extraction of semantics, and employing compressed-domain processing for efficiency. Firstly, knowledge-supported rules are utilized for shot detection on the extracted DC-images, and statistical skin detection is applied for human object detection. Secondly, through filtering outliers in motion vectors, improved detection of camera motions like zooming, panning and tilting are achieved. High-level semantics like video highlights are then automatically extracted via low-level analysis in the detection of human objects and camera motion events, and finally these highlights are taken for shot-level annotation, indexing and retrieval. Results from large data of test videos have demonstrated the accuracy and robustness of the proposed techniques.
D7.8 Final Specification of the Intelligent Media Framework: This report presents the final specification of the Intelligent Media Framework (IMF), one of the core subsystems acting as the middleware for the LIVE Production Support System. The framework provides the following services to other LIVE subsystems and to the broadcaster’s environment: • Services to create, annotate and manage the intelligent media assets (IMA) in a realtime production environment. These services operate on a metadata level. They do not store, but rather reference raw video streams (“IMA Service”). • Services to access the vocabularies and the terms of the controlled vocabulary constituting the knowledge base of the LIVE staging domain (“Knowledge Service”). • Services to access and search semantically enriched information across the system (“Semantic Context Service”). • Services to manage and access information about the staged events, e.g. the date and place of the competitions, the participating athletes, the results, etc. (“Event Information Service”). • Services to support the real-time aspects of the staging process by offering propagation and subscription methods to other subsystems (“Real-time Notification Services”). • Additionally, the IMF provides modules for (1) the processing of spatial, temporal and free text annotation of media assets (“MPEG7 Annotation Module”), and (2) the integration of support and planning data for the Olympic Games from the Olympic Sport Information System.
IMF Toolset (D7.9): This document provides an introduction to the technological platform as well as the user guide for a set of applications developed on top of LIVE’s Intelligent Media Framework (IMF) to support the preparation and the production of the LIVE staging process. In the preparation phase the tools allow editing of Intelligent Media Assets (ingest of archival clips into the production archive) and the management of event related information (such as event schedule, participants). To support the LIVE staging in real-time during the production process, the IMF Toolset provides the Staging Console, an application visualising real-time event data but enriched with annotations from the meta data generation system.
Final Implementation of the Intelligent Media Framework (D7.10): This document provides detailed information about the setup, deployment, installation and configuration of the final implementation of the Intelligent Media Framework. The document serves as an installation guide for the software delivered on DVD/CD.
Extracting Semantics and Content Adaptive Summarisation for Effective Video Retrieval: In this paper, we provide a system for semantic video retrieval in which extracted semantic contents are used to generate summarised videos for effective delivery of retrieved results. Firstly, several useful features are extracted in compressed video on the basis of the DC-images and motion vectors. Secondly, shot changes are detected to enable shot-level content indexing and retrieval. Thirdly, several semantics concepts are automatically detected including outdoor/indoor scenes, building, sky and human objects. The results of detected shots and extracted semantic concepts are then used for semantic indexing of video contents. Furthermore, a combined measurement is produced from these semantics for content adaptive video summarisation. According to the network performance, the retrieved video can be delivered at various sizes using our summarisation techniques for efficiency.
[···]
Knowledge Kit of novel iTV Formats (Report on D4.15): This document provides an overview of the results of deliverable D4.15 - 'Knowledge Kit of novel iTV Formats', which consists of three parts - The KnowledgeKit-Wiki, which is a wiki page - The KnowledgeKit-Testbed, which consists of software delivered on CD and the documentation of the software on the web - The report on the KnowledgeKit-Wiki and the KnowledgeKit-Testbed (this document) with gives an overview on the Wiki and Testbed. The document explains the intended use and purpose of the Knowledge Kit. Two user groups are defined and described according to their level of experience, their tasks and goals and how they can benefit from the Knowledge Kit. Then the two components of the Knowledge Kit are described, the KnowledgeKit-Wiki and the KnowledgeKit-Testbed. The Wiki web site contains an expandable repository of terms, methods, definitions and best practices related to iTV. The Testbed is an easy to manage low cost test platform for creating simple mock-ups and design studies.
[···]
Predicting future User Behaviour in interactive live TV (EuroITV 2008 Paper): Recommender systems are a means of personalisation providing their users with personalised recommendations of items that would possibly suit the users needs. They are used in a broad area of contexts where items are somehow linked to users. The creation of recommendations of interactive live TV suffers from several inherent problems, e.g. the impossibility to foresee the contents of the next items or the reactions of the user to the changing programme. This paper proposes an algorithm for building personalised streams within interactive live TV. The development of the algorithm comprises a basic model for users and media items. A first preliminary evaluation of the alogithm is executed and the results discussed. In M. Tscheligi, M.Obrsit, and A. Lugmayr (Eds.): EuroITV 2008, LNCS 4066, pp.117-121, 2008, Springer-Verlag, Berlin
Metadata on Aesthetic Features of AV Material (Technical Document): When it comes to metadata annotation of AV material most of the (scientifically motivated) proposals usually deal with extraction of and annotation with 'information', keyword recognition or even face recognition. Interestingly enough facilitating AV material with these features is not only difficult in terms of algorithm development and costly in terms of algorithmic time consumption, but also does not at all deliver the type of metadata, visual artists are frequently asking for. A future Live Video Conductor must be enabled to compose an outgoing signal, which is enriched by several streams assembled from live feed, temporarily stored (looped) live material and related archive material. Due to its highly performative nature real-time compiling of streams of interrelated AV material clearly is a domain of visual artists like VJs. Hence the VJ scene is regarded as an important source of input and advice. During the past 9 months we asked VJs and other visual artists to put together a 'wish list' of desired AV metadata features via postings on internet platforms, emails and during personal conversations. Among other this international VJ group also included the internationally acclaimed London based 'Addictive TV' and Vienna based 4youreye.
[···]
D8.7 Evaluation of LIVE system integration in other broadcast environments: This document deals with the LIVE System integration in other broadcast environments. It provides an overview on the required facilities and necessary adaptations when bringing all or only some of the LIVE components into an existing broadcast environment. Especially the option to only select some of the usage scenarios supported by the LIVE System is stressed in the report. The report concentrates on the aspects of integration that are independent from a specific broadcast environment. The findings were made during the system integration for the Olympic field trial and will be outlined in chapter 3. Afterwards the usage scenarios supported by LIVE are summarized in chapter 4 as introduction to the following sections dealing with the related requirements and adaptations. Due to the only limited number of connections and dependencies, there are only few requirements for broadcast equipment as presented in chapter 5. A special focus was laid on the consumer system, since the need for adaptations is foreseen to be much higher than for the other fields. But as LIVE already proved by integrating with three different consumer systems the efforts are predictable and reasonable. Chapter 6 concentrates on the practical requirements entailed with a use case of the LIVE System. Here the personnel as well as the technical resources are described and the work spaces with their related work flow are presented. The document is finished with chapter 7 giving a summary on the necessary adaptations.
[···]
[···]
D8.6 Report on the integration of the second system prototype: This document reports on the process of integration, testing and operation of the second prototype version of the LIVE System. It presents the complexity of the system including the implemented internal and external interfaces. In order to verify the development of the required and agreed function set and to ensure a certain level of stability, scalability and performance, extensive system testing was performed. The chosen approach, its realisation and conclusion comprise a major part of the report. In contrast to the first system prototype this version was foreseen to come to operation during the Summer Olympics 2008. A production team at the ORF in Vienna should be supported in their task to produce a multichannel interactive live programme. The operation of the system during the Olympic field trial is summarised from an integration point of view.
D9.6 Report on requirement monitoring: As the final document of WP9 this report lists various revised issues that have been described in separate deliverables in former times. Chapter 3 depicts the relevant actors and roles within the LIVE system. The final usage scenarios that could be observed during the preparation, production and post-processing of the Olympic Trial are described in chapter 4. They were the precondition for the revision of the final requirements presented in chapter 5. The description of the final requirements is oriented towards the presentation of the revised requirements in [LIVE D9.4] and follows the same outline. They again served as a foundation for the revision of the final system architecture of the LIVE production support system. Chapter 6 picks up the already defined workflows from [LIVE D9.5] and adapts and amends them according to the final requirements from chapter 5. This is accomplished by providing a componentbased view on the one hand and more detailed inspections on components which have been subject to major changes on the other. The first part intends to give an overview on the performed adaptations of the architecture for each component. The latter part is meant to serve as a guideline for the developers of the various components and tools on which interfaces will be needed between which components and which data has to be exchanged.
D8.5 Second prototype broadcast gateway services and consumer system component: The document at hand serves as an installation and usage guide to the second prototype ver-sion of the broadcast gateway and the consumer system services, the actual deliverable D8.5. It is intended to allow for installation and using the developed software. Further details on the implementation are not part of this deliverable. After a short introduction on what is included in the delivered software package, the docu-ment is separated into two parts. One is dedicated to the installation and configuration of the components (see chapter 4) and the other one deals with the usage of the components (see chapter 5). The first part of chapter 4 gives an overview on the software and hardware re-quirements to perform the installation of the different components. Later on, in chapter 4, the instructions to install the tools are given. Chapter 5 presents the offered interfaces and roughly describes their usage scenario in the LIVE production support system.
LIVE Staging of the Beijing 2008 Olympic Games - Experiences and Results (D4.10): After having performed the LIVE Field-Trial in August 2008, experiences and results have been gathered, structured and evaluated. This document sums up all relevant experiences and results from various perspectives. The document “explains” the results behind the level of interpretation of figures and numbers – since the performance of the field trial was – as expected and planned – a very complex and (therefore) a very human process – a communication process. Beside the description of the basic sources of this document, the field-trial itself is described as an evolutional and collective learning process. “Highlights” and not expected moments are mentioned for further creative ideas. In addition the basic key variables for content formats are identified. The question about the LIVE staging concept and the task “preparation” (in terms of flexibility) are now defined on the basis of the latest experiences. Statements of the professional users and from responsible persons at ORF should give an outlook for further developments of the “idea LIVE” in the area of the European public broadcasting world.

IST LIVE

Sections

Personal tools

Views

Knowledge Base