AI and Music Festival (S+T+ARTS): musical creativity with AI
January 30, 2026
DoblAI: AI for easy and fast dubbing of multimedia content
February 2, 202602/02/2026
The AgroTech research group at UPC, in collaboration with its spin-off Ugiat Technologies, has developed uPlayer, a new multimedia player concept that enables more intuitive video navigation and viewing, intelligently enhancing the user experience, especially on YouTube and other platforms, by integrating as a plugin or advanced player.
Audiovisual content analysis using artificial intelligence makes it possible to automate numerous processes across the multimedia production and management chain. Current computer vision techniques recognise people, places, scenes, objects and logos, while audio analysis enables speech transcription, speaker identification and keyword detection. By combining these results with natural language processing, it becomes possible to generate summaries, classify content and extract useful metadata for indexing, search, automatic documentation, monitoring, advertising optimisation and support for content editing.
uPlayer uses this metadata to improve the viewer’s experience. For example, in a news programme, the system automatically identifies news items, people, sections and relevant concepts, enabling much more intuitive non-linear navigation than the traditional 10-second forward/back system: users can jump between headlines, filter by sections or search for appearances of specific individuals. This experience can be extended to other formats such as entertainment programmes, panel discussions or series.
To make this possible, the provider hosts its content on a video-on-demand server (YouTube, Vimeo or its own server), which is automatically analysed and integrated with a player plugin, through which the user receives the metadata that enriches playback, without the broadcaster having to modify its workflows.
In addition, users can add tags, create navigation points (favourite scenes), generate short clips and share them on social networks, as well as collaborate with other users on databases about specific characters. These metadata can be shared or published as navigation profiles. Creators, such as YouTubers, can also request automatic analysis and customise the results before distributing their content.
uPlayer is typically presented as a browser plugin (for example, Chrome) that integrates with existing video players. The system can be commercialised through analysis subscriptions, offering advanced navigation to users or providing producers with information on consumption and interaction patterns. For certain types of content, such as courses or conferences, it also enables collaborative enrichment by the community.
The AgroTech audiovisual technologies group at UPC has contributed expertise in facial recognition systems and audio and video content analysis. It has also been responsible for carrying out system quality measurements tailored to different types of content such as documentaries, interviews, classes, news programmes and series, proposing analysis strategies according to content type. Direct collaboration has taken place with Ugiat Technologies, which developed and adapted the algorithms and integrated them into the system.
Budget and funding
The project ran for 12 months (2024) and had a total budget of € 20,000.
Related Projects
- A team from the Matrix Analysis and Discrete Potential Theory (MAPTHE) research group at the Universitat Politècnica de Catalunya - BarcelonaTech (UPC), and the Department of Mathematics at CUNEF Universidad in Madrid, have participated in the development of MARIA, a prototype of a portable, flexible and radiation-free device designed to improve the early detection of breast cancer. The device can identify tumours through electrical conductivity, with the aim of enabling its future use in primary care settings.
- The Research Group in Smart and Sustainable Resources and Industries (RIIS) at the Universitat Politècnica de Catalunya - BarcelonaTech (UPC) is developing the ZeroCarbonPave project, which aims to assess the feasibility of incorporating biochar as filler and/or as the fine fraction of granular material in bituminous mixtures, with the objective of reducing the carbon footprint associated with the manufacture and laying of road pavements.
- The Center for Industrial Equipment Design (CDEI-UPC) at the Universitat Politècnica de Catalunya - BarcelonaTech (UPC) is participating in a cross-border project aimed at promoting the use of advanced digital technologies in viticulture in regions on both sides of the Pyrenees. The initiative seeks to improve specialist training, technical advice and decision-making in vineyard management.
- The Centre for Industrial Equipment Design (CDEI) at the Universitat Politècnica de Catalunya - BarcelonaTech (UPC), together with the IRI, Institut de Robòtica i Informàtica Industrial (CSIC-UPC), is participating in the development of a pre-commercial prototype of an automatic portable sawmill that integrates computer vision, artificial intelligence and computer numerical control to improve productivity, efficiency and safety in local wood processing for the company Envall Coop. S.L.
