Voi has launched the ‘world’s first’ large scale pilot of computer vision on e-scooters, installing AI technology that can detect when an e-scooter leaves the road and rides on a pavement, or when the vehicle is parked incorrectly.
The operator is working with Irish micromobility startup Luna, whose technology offers real-time lane segmentation and pedestrian detection for scooters.
Voi e-scooters fitted with the new technology were tested on Stockholm streets in advance of deployment in Northampton later this month, to demonstrate the potential of the technology which will increase the safety of e-scooters by fixing the problem of pavement riding. The technology will also provide tools to identify problem areas and adapt infrastructure for micromobility, by conveying real-time data about how the vehicles are being used.
The ‘smart camera’ hardware and electronics have been honed by Luna and Voi over the last six months, to integrate with the latest Voi vehicles, while the computer vision algorithms have been trained using hours of video footage from Northampton.
The first pilot will begin this month in Northampton in the UK, where Voi has an exclusive licence to operate as part of the Government’s national trial of e-scooters, which started last year and runs until spring 2022.
Voi will initially install cameras on a number of e-scooters in Northampton for a two-phase pilot starting in July. In the first phase, a controlled user group will road test the computer vision technology to collect real-time visual information on the environment the e-scooter is travelling through, as well as detecting pedestrians in the path of the e-scooter.
The technology will also be able to detect the surface that an e-scooter is being ridden on, such as a bike lane, pavement, or roadway, and alert the rider accordingly with an audible alarm if they are riding on the footpath.
In the second phase of the trial later in the summer, about 100 cameras will be installed on the publicly available scooter fleet in Northampton. As well as the audible alert, this phase of the pilot will explore the potential to automatically slow scooters if inappropriate riding is detected on footpaths or in heavily pedestrianised areas.
Data from the pilot will be shared with the council so that it can collect a detailed record of how and where the e-scooters are being ridden, helping Voi to correct bad behaviour and enabling the city to have data-driven insights into e-scooter use and the interactions with other modes of transport and pedestrians.
By 2022, Luna expects to be able to integrate its camera technology directly into the stem or handlebars of the e-scooters for rent.
“With computer vision, e-scooters can be trained to see and recognise situations that are hazardous,” said Fredrik Hjelm, co-founder and CEO of Voi Technology. “This world-first pilot will set new standards of safety for this new form of transport.
“Having helped riders to take more than 60 million rides across Europe, we understand deeply the issues involved in e-scooter safety and are always looking for ways to do better. We are very proud to be the first e-scooter operator to incorporate the computer vision technology at scale for the benefit of our riders, pedestrians and authorities.”
Andrew Fleury, co-founder and CEO, Luna, added: “With this trial, we look forward to demonstrating how computer vision equipped e-scooters can make a verifiable difference to rider compliance and sidewalk riding behaviour in cities.
“We’ve noticed cities across the world requesting technological solutions to challenges like pavement riding and it’s fantastic to be working with such a safety-conscious operator like Voi, in order to develop market-ready solutions. The value of the smart city data that can be generated by vision-equipped scooters is only beginning to be understood by micromobility stakeholders, and we’re excited to be exploring these early use cases with Voi.”
Voi will use the Luna technology to improve compliance not just in terms of riding behaviour, but also in relation to proper parking. The Luna parking algorithm can spot if a scooter is positioned correctly in a ‘virtual dock’ by using a painted scooter logo or corral on the ground, or any other surrounding visual clues that it is trained to detect. Using the camera as a sensor, Luna can also help e-scooters to be parked with a level of accuracy that standard GPS technology cannot match.