AI and Music Festival (S+T+ARTS): musical creativity with AI
January 30, 2026
DoblAI: AI for easy and fast dubbing of multimedia content
February 2, 202602/02/2026
The AgroTech research group at UPC, in collaboration with its spin-off Ugiat Technologies, has developed uPlayer, a new multimedia player concept that enables more intuitive video navigation and viewing, intelligently enhancing the user experience, especially on YouTube and other platforms, by integrating as a plugin or advanced player.
Audiovisual content analysis using artificial intelligence makes it possible to automate numerous processes across the multimedia production and management chain. Current computer vision techniques recognise people, places, scenes, objects and logos, while audio analysis enables speech transcription, speaker identification and keyword detection. By combining these results with natural language processing, it becomes possible to generate summaries, classify content and extract useful metadata for indexing, search, automatic documentation, monitoring, advertising optimisation and support for content editing.
uPlayer uses this metadata to improve the viewer’s experience. For example, in a news programme, the system automatically identifies news items, people, sections and relevant concepts, enabling much more intuitive non-linear navigation than the traditional 10-second forward/back system: users can jump between headlines, filter by sections or search for appearances of specific individuals. This experience can be extended to other formats such as entertainment programmes, panel discussions or series.
To make this possible, the provider hosts its content on a video-on-demand server (YouTube, Vimeo or its own server), which is automatically analysed and integrated with a player plugin, through which the user receives the metadata that enriches playback, without the broadcaster having to modify its workflows.
In addition, users can add tags, create navigation points (favourite scenes), generate short clips and share them on social networks, as well as collaborate with other users on databases about specific characters. These metadata can be shared or published as navigation profiles. Creators, such as YouTubers, can also request automatic analysis and customise the results before distributing their content.
uPlayer is typically presented as a browser plugin (for example, Chrome) that integrates with existing video players. The system can be commercialised through analysis subscriptions, offering advanced navigation to users or providing producers with information on consumption and interaction patterns. For certain types of content, such as courses or conferences, it also enables collaborative enrichment by the community.
The AgroTech audiovisual technologies group at UPC has contributed expertise in facial recognition systems and audio and video content analysis. It has also been responsible for carrying out system quality measurements tailored to different types of content such as documentaries, interviews, classes, news programmes and series, proposing analysis strategies according to content type. Direct collaboration has taken place with Ugiat Technologies, which developed and adapted the algorithms and integrated them into the system.
Budget and funding
The project ran for 12 months (2024) and had a total budget of € 20,000.
Related Projects
- Researchers from the Architecture, Energy and Environment research group (AiEM) and the Design and Analysis of Architectural Structures research group of the Department of Architectural Technology (DiCEA), which are part of the Centre for Research and Services for the Local Administration (CRAL) at the Universitat Politècnica de Catalunya - BarcelonaTech (UPC), have developed an innovative system for the structural strengthening of ceramic floor slabs using stress-activated timber, designed to intervene in occupied buildings in a fast, sustainable and replicable manner.
- A team of researchers led by the FLUMEN Research Institute at the Universitat Politècnica de Catalunya - BarcelonaTech (UPC) has participated in the European ICARIA project. Its aim is to develop tools and risk maps that enable public authorities and infrastructure managers to anticipate the impacts of extreme climate events and make adaptation decisions on a more robust technical basis.
- A research team from the Institut de Robòtica i Informàtica Industrial (IRI, CSIC-UPC), together with the Centre de Disseny d'Equips Industrials (CDEI) of the Universitat Politècnica de Catalunya - BarcelonaTech (UPC), are participating in the national CASANDRA project to develop a digital manufacturing solution that will make it possible to establish a bidirectional data flow for continuous digital integration throughout the supply chain across the product life cycle. This integration will be achieved through digital twins and data-based models that are continuously updated thanks to distributed monitoring and control tools.
- The Materials Interfaces and Colloid Engineering group (INTERCOLL) at the Universitat Politècnica de Catalunya - BarcelonaTech (UPC), in collaboration with the Life Cycle Thinking group at the University of the Basque Country (EHU), are taking part in the BIOCHOLESTEROID project to develop new bio-based smart materials with optical response for advanced applications.
