Project detail

SAUCE - Smart Asset re-Use in Creative Environments

Duration: 01.01.2018 — 31.12.2020

Funding resources

Evropská unie - Horizon 2020

- whole funder (2018-01-01 - 2020-12-31)

On the project

SAUCE will research, develop, pilot and demonstrate a set of professional tools and techniques for making content smarter, so that it is fully adaptive in a broad, unprecedented manner: adaptive to context (which facilitates re-use), to purpose (among or within industries), to the user (improving the viewing experience), and to the production environment (so that it is future-proof). The approach is based on research into light-field technology; automated classification and tagging using deep learning and semantic labeling to describe and draw inferences; and the development of tools for automated asset transformation, smart animation, storage and retrieval. These new technologies and tools will show that a vast reduction of costs and increases in efficiency are possible, facilitating the production of more content, of higher quality and creativity, for the benefit of the competitiveness of the European creative industries. Specifically, SAUCE will research and develop: - Methods of generating smart world-views by capturing and processing light-fields, augmenting them with semantics and making them usable for media production pipelines. - A framework and tools for automatically classifying, validating and finding smart assets, using deep learning and semantic labeling techniques on 2D and 3D data. - A framework and tools for the automatic transformation and adaptation of smart assets to new contexts, purposes, users and environments, and for the synthesis of new smart assets from existing ones. - Real-time control systems for authoring animated content using smart assets, automatically synthesizing new scenes from existing ones and integrating smart assets into virtual production scenarios. - A storage system for smart assets that combines local and cloud storage so that assets can be delivered irrespective of the user or asset location. SAUCE will also demonstrate and promote its results, for industry approval, adoption and development by third parties.

Description in Czech
Projekt SAUCE bude zkoumat, vyvíjet, ověřovat a demonstrovat profesionální nástroje a techniky vytváření chytřejšího obsahu, který  bude široce přizpůsobitelný: znovupoužitelný v různých kontextech, adaptovatelný pro různé účely použití i napříč obory, přizpůsobitelný uživatelským potřebám (např. různé způsoby sledování a uživatelského zážitku) a prostředí tvorby (s důrazem na možná budoucí užití).

Keywords
Multi media, Computer graphics, Computer games, Computer vision, Film, TV, games, AR/VR, Light fields, VFX, post-production, animation, deep learning, semantic labeling, asset transformation, storage and retrieval.

Default language

English

People responsible

Smrž Pavel, doc. RNDr., Ph.D. - principal person responsible

Units

Results

TROTTNOW, J.; SPIELMANN, S.; HERFET, T.; LANGE, T.; CHELLI, K.; ŠOLONY, M.; SMRŽ, P.; ZEMČÍK, P.; AENCHBACHER, W.; GROGAN, M.; ALAIN, M.; SMOLIC, ALJOSA, S.; CANH, T.; VU-THANH, O.; VAZQUEZ-CORRAL, J.; BERTAHNIO, M. The Potential of Light Fields in Media Productions. In SA'19: SIGGRAPH ASIA 2019 TECHNICAL BRIEFS. TECHNICAL BRIEFS. New York: Association for Computing Machinery, 2019. p. 71-74. ISBN: 978-1-4503-6945-9.
Detail