CONVERGE Project Overview

Telecommunications and Computer Vision
Convergence Tools for Research Infrastructures

Although telecommunications and computer vision belong to distinct scientific fields, this is set to change with the creation of this new joint research field resulting from the advent of higher frequency mm-wave wireless communications with line-of-sight operating ranges. This opens the possibility of leveraging computer vision data to predict wireless channel dynamics and help build high-definition 3D maps for localization and sensing applications while, on the other hand, radio-based sensing/imaging has the potential to empower computer vision applications to become more resilient against occlusion and poor luminosity.

The CONVERGE project aims to develop an innovative toolset aligned with the motto “view-to-communicate and communicate-to-view”, consisting of vision-aided large intelligent surfaces, vision-aided fixed and mobile base stations, a vision-radio simulator and 3D environment modeler, and machine learning algorithms for multimodal data including radio signals, video streams, RF sensing, and traffic traces. This toolset will be deployed into 7 RIs mostly aligned with the ESFRI SLICES-RI and improve their competitiveness.

This is the first newsletter of CONVERGE, which from now on will be released every 6 months. We bring you some of the key achievements of the project in its first year, as well as a flavour of some of our plans going forward.

Read More

Kick-Off Meeting in Porto​

Kick-Off Meeting in Porto The project CONVERGE – Telecommunications and Computer Vision Convergence Tools for Research Infrastructures, led by INESC TEC, aims to develop a set of innovative tools to support research infrastructures, over the next three years. In the future, research supported by these tools is expected to play a major role in the healthcare, industry, automotive, telecommunications and media …

Read more
Kick-Off Meeting in Porto​

Face-to-Face Meeting in Sophia Antipolis, France

Face-to-Face Meeting in Sophia Antipolis, France The second in-person consortium meeting for the CONVERGE collaborative research project occurred on October 2nd and 3rd at the Centre Inria d’Université Côte d’Azur in Sophia Antipolis, France. This gathering provided a comprehensive overview of the project's advancements, challenges, and future strategies. Led by Luis Pessoa of INESC TEC, the meeting delved into various …

Read more
Face-to-Face Meeting in Sophia Antipolis, France

Use cases and high-level architecture specification

Use cases and high-level architecture specification Work Package 1 (WP1) has started its activities by identifying a relevant set of use cases addressable by the project, along five vertical markets: telecommunications, automotive, manufacturing, media, and health. For each use case, we describe its context and relevance, identify the different CONVERGE tools that may be used to address the use case …

Read more
Use cases and high-level architecture specification

Super-CLAM Workshop at IEEE ICASSP 2024: Final Program Update Announced

Super-CLAM Workshop at IEEE ICASSP 2024: Final Program Announced The organizing committee of the Super-CLAM Workshop has officially announced the final program for the upcoming session at the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2024. The event will be held in Seoul, Korea, from April 14 to 19. Super-CLAM Workshop, co-organized by the CONVERGE Project and …

Read more
Super-CLAM Workshop at IEEE ICASSP 2024: Final Program Update Announced

Industry panel at IEEE 2023 GLOBECOM

Industry panel at IEEE 2023 GLOBECOM CONVERGE organised an industry panel at IEEE 2023 Global Communications Conference (GLOBECOM), that took place in Kuala Lumpur, Malaysia, from 4th to 8th December 2023. The panel entitled “Convergence of wireless communications and computer vision: a new paradigm created by the CONVERGE project” had the goal of discussing new potential opportunities and challenges that …

Read more
Industry panel at IEEE 2023 GLOBECOM CONVERGE organised an industry panel at IEEE 2023 Global Communications Conference (GLOBECOM), that took place in Kuala Lumpur, Malaysia, from 4th to 8th December 2023. The panel entitled “Convergence of wireless communications and computer vision: a new paradigm created by the CONVERGE project” had the goal of discussing new potential opportunities and challenges that …

Read more
Industry panel at IEEE 2023 GLOBECOM

Innovations in Vision-radio Simulation and 3D Modelling

Innovations in Vision-radio Simulation and 3D Modelling Simulation of the propagation of radio waves in the mmWave range in multiple environmental conditions is becoming of vital importance. CONVERGE aims at facilitating a seamless transition between virtual and real tools by creating a "digital twin" of different experimental chambers. The simulator constructs a geometric 3D model, enriching it with electromagnetic characteristics …

Read more
Innovations in Vision-radio Simulation and 3D Modelling

Disclaimer and Project Information

Views and opinions expressed are however those of the authors only and do not necessarily reflect those of the European Union, SNS JU or UKRI. The European Union, SNS JU or UKRI cannot be held responsible for them.

The CONVERGE project has received funding under the European Union’s Horizon Europe research and innovation programme under Grant Agreement No 101094831, including top-up funding by UK Research and Innovation (UKRI) under the UK government’s Horizon Europe funding guarantee. Views and opinions expressed are however those of the authors only and do not necessarily reflect those of the European Union or UKRI. The European Union or UKRI cannot be held responsible for them.
linkedin twitter youtube