Sony IMX500 sensor participates in a smart city project in Rome

Utilizando el sensor de visión inteligente Sony IMX500 se han puesto en marcha tres proyectos para reducir el tráfico, optimizar el transporte público y aumentar la seguridad de los peatones.

Los sensores de imagen Sony IMX500 con funcionalidad de procesamiento con Inteligencia Artificial forman parte de tres proyectos de ciudad inteligente que está llevando a cabo Envision en la ciudad de Roma. El objetivo es reducir la contaminación y los accidentes relacionados con el transporte de la ciudad en los pasos de peatones.

En las pruebas se busca evaluar y ofrecer un sistema de estacionamiento inteligente utilizando los sensores IMX500 para reducir la contaminación y los atascos de quienes circulan buscando un lugar donde aparcar.

For this, The test aims to evaluate the effectiveness of the system, in which drivers receive alerts through an app on their smartphone before being directed to the nearest free parking space to their destination.

The project also includes a study of smart city systems that will optimize capacity and increase the use of their public transport networks. This will be carried out through the implementation of smart bus shelters, capable of counting the people getting on and off each one, identifying overcrowding to ensure better bus provisioning and cost optimization.

Finally, se activará de forma progresiva un sistema de alertas en los pasos de peatones para alertar a los conductores cuando estén cruzando, utilizando iluminación inteligente de baja latencia en la vía para hacerlos más visibles. El objetivo es reducir los accidentes en los pasos de peatones.

La empresa Envision es la responsable del desarrollo de los dispositivos inteligentes; mientras que el Grupo TTM (Control DP) se ha encargado de instalar el sensor de imagen IMX500 en el dispositivo inteligente; y Citelum ha sido el promotor del proyecto y responsable de la instalación de los dispositivos inteligentes en los semáforos, del servicio de mantenimiento ordinario y extraordinario de los sistemas de semáforos, as well as luminous signaling and traffic regulation and control, en la ciudad de Roma.

IMX500 Sensor

The IMX500 is the first image sensor that integrates AI processing functionality. The configuration used for these tests allows extracting real-time metadata related to the information of a free parking space, the presence of a pedestrian about to cross a street or the number of people getting on/off a bus.

Following privacy requirements, neither images are stored nor do they leave the sensor.

This allows the city to reduce the required bandwidth, scale it using existing networks and reduce energy and communication costs. Besides, respond to citizens' privacy concerns.

Sony Europe is committed to supporting the development and implementation of smart city projects in order to help them solve their problems through a Sensing as a Service model (SeaaS).

Traffic, pedestrian congestion and safety

Traffic caused by drivers searching for parking is seen by the city as a key factor in congestion, and this project aims to quantify the magnitude of the problem.
Leveraging Sony's sensing and imaging technology to address social causes in cities demonstrates how IMX500 sensors can alleviate some of the challenges faced by large cities.

The average distance between pedestrians and vehicles is a metric used to measure pedestrian safety. The project aims to generate a quantitative analysis of this data and prevent pedestrian accidents through the signaling mechanisms installed at crossings.

This is a clear and concrete example that Sony's intelligent vision solutions can fulfill our clients' purposes while respecting people's privacy. We want to achieve more sustainable and livable cities, and through the scalable IMX500 platform we can accelerate this process”, explains Antonio Avitabile, General Director of Corporate Alliances and Investments at Sony.

Implemented Technology

Se han instalado dispositivos inteligentes Genius en el centro de Roma. Se ha comenzado una fase preliminar que capacitará a una red neuronal a identificar los espacios de estacionamiento disponibles, así como la cantidad de personas que esperan en las paradas de autobús, entran o salen de ellos y esperan a cruzar o están cruzando la calle.

Cada dispositivo inteligente Genius consta de dos sensores que miran hacia las calzadas a su alrededor y los espacios de estacionamiento.

Los sensores envían datos en tiempo real elaborados por redes neuronales sobre la ubicación exacta de un espacio libre, la presencia de peatones y la cantidad de personas esperado en las paradas de autobús.

Los datos, con la ubicación exacta de los espacios de estacionamiento disponibles, it is transmitted in real time through the smart device. Next, the data is processed in the sensor integrated into the smart device itself, using neural networks, and sent to the software platform in the cloud of the associated company, Envision.

The coordinates of the exact location of available parking spaces are shown in real time on a map, on the screen of the mobile device used by the driver heading towards the area.

The presence of pedestrians is measured and compared in different locations. The neural network system detects pedestrians at crosswalks and sends light signals to drivers to alert them.

Smart shelters

The data on the length of the line of people waiting and those getting on and off the buses is processed by the smart device's sensor through the neural network and sent to the Envision software platform. It aggregates it and makes it available to the staff managing the public bus network to improve planning and scheduling of the transport network.

The figure of 'crowded' is provided to indicate when the bus is operating over capacity to avoid overcrowding, better manage the transport network and optimize the citizens' travel experience.

The project is being carried out in the city of Rome in collaboration with various startups from the Italian ecosystem and with the support of Sony Europe.