Image sensors with artificial intelligence processing functionality are at the core of three trials being run to help cut the city’s transport-related pollution and accidents at pedestrian crossings.
Rome is using intelligent vision sensors as part of a smart city trial to reduce traffic, optimise public transportation and support pedestrian safety.
Sony Europe IMX500 image sensors with artificial intelligence (AI) processing functionality are at the core of three trials being run by Greentech specialist Envision in the municipality. Set to commence in June 2021, they are intended to cut the city’s transport-related pollution and accidents at pedestrian crossings.
The trial’s primary objective is to evaluate and deliver a smart parking system using IMX500 to reduce pollution and gridlock from those cruising to find a parking space. For this, the trial seeks to evaluate the effectiveness of such a system, with drivers alerted via a smartphone app before being directed to the free parking space closest to the driver’s destination.
In addition to this, the test also includes a study of smart city systems that will optimise capacity and increase use of its public transport network by implementing smart bus shelters, counting those getting on and off each bus – identifying overloading to ensure better provisioning of buses and costs optimisation.
Finally, an alert system at pedestrian crossings will be progressively activated to alert drivers when pedestrians are crossing, using low-latency smart lighting on the road to make them more visible with the aim of reducing the city’s accidents on pedestrian crossings.
The IMX500 claims to be the first image sensor to integrate an AI processing functionality. The configuration used for this trial allows extraction of real-time metadata related to information of a free parking space, the presence of a pedestrian about to cross a street, or the number of people getting on or off buses. No images are stored, nor leave the sensor, in line with privacy requirements.
“We have a vision of achieving more sustainable and liveable cities, and through the IMX500 scalable platform we can substantially accelerate this process”
This allows the city to reduce the bandwidth required, to scale it easily using existing networks, and to cut power and communication costs. And furthermore, this system allows citizens’ privacy concerns to be addressed.
Sony Europe is committed to supporting the development and implementation of smart city projects with a view to help cities to solve their different issues through a sensing-as-a-service (SeaaS) business model.
Traffic caused by those seeking to park is seen by the city as a key contributor to congestion, with the trial seeking to quantify the scale of the problem. Leveraging Sony’s imaging and sensing technology to serve social causes in the cities demonstrates how sensors can alleviate some of the problems faced by busy cities.
The average distance between pedestrians and vehicles is a key metric used to measure pedestrian safety. The trial is aiming to deliver a quantitative analysis of this and prevent pedestrian accidents through signalling mechanisms installed at the crossings.
“This is a clear and concrete example where Sony’s smart vision solution can serve our customer’s purpose while respecting people’s privacy,” said Antonio Avitabile, managing director of corporate alliance and investment, Sony. “We have a vision of achieving more sustainable and liveable cities, and through the IMX500 scalable platform we can substantially accelerate this process.”
A preliminary phase was undertaken to train a neural network to identify available parking spaces as well as the number of people waiting at the bus stops, entering or leaving buses and waiting to cross or crossing the road. This involved installing Genius smart tips in the city centre. Every Genius smart tip consists of two sensors looking over the roads around and the parking spaces. The sensors send real-time data elaborated by neural networks on the exact location of a free space, the pedestrians’ presence and the number of people queuing at bus shelters.
The exact location of the free parking space data is streamed in real time through the smart tip. The data is then immediately processed by the sensor integrated in the smart tip, using neural networks, and sent to the cloud software platform of partner company, Envision. The coordinates of the free parking space’s location are overlaid in real-time on a map that is displayed on a mobile device used by the driver who is heading towards the area.
Pedestrians’ presence is measured and compared across different locations. The neural network system detects pedestrians at the zebra crossing and a lighting signal is sent to the drivers to alert them.
“This is a clear and concrete example where the smart vision solution can serve our customer’s purpose while respecting people’s privacy”
Data of queue length and people getting on and off a bus are processed by the sensor in the smart tip through the neural network and sent to the Envision software platform which aggregates them and make them available to personnel managing the public bus network in order to enhance the planning and scheduling of the bus transportation network. A ‘crowded’ figure of merit is provided to signal when a bus is running at over capacity to avoid overcrowded buses, better manage the transportation network and improve citizens’ journey experience.
The trial is conducted in the City of Rome collaboratively by several start-up companies and partners in the Italian ecosystem and with the support of Sony Europe. Project partners include TTM Group (DP Control), responsible for installing the IMX500 image sensor in the smart tip; Envision which was responsible for the development of the smart tips; public lighting company Citelum, which is responsible for the installation of the smart tips on traffic lights. It manages the maintenance service of traffic light systems, as well as of luminous signs and traffic regulation and control, in Rome.
You might also like: