01.19.2021
Difficult weather conditions, like rain, wet or frozen road surfaces, are a well-known factor in car accidents. Weather is a problem for both human drivers and autonomous vehicles because of its unpredictability.
Almost any development in autonomous driving wrestles with the one unexpected, random, and complex element that continues to challenge even the most experienced engineers: the weather.
“Why would we develop a system that only works in optimal conditions, in warm, clear, and sunny weather, as that’s not the reality for most of the people?” questions Harri Santamala, the CEO of Sensible 4.
Darkness, rain, and wind are everyday conditions for many. In addition, burning heat or freezing cold are the conditions when the vehicles are probably most needed.
“Our basic concept is that the vehicle must work in everyday conditions without purpose-built infrastructure. We believe this is the way autonomous driving becomes mainstream”, says Santamala.
Different sensors perform in different ways
An autonomous vehicle sees the world through various sensors, typically cameras, laser scanners, i.e. LiDAR sensors, and radars. Harsh weather may be an issue, especially for LiDAR and cameras. Small particles in the air, like raindrops, fog, and falling leaves prevent the light and laser beam from traveling in the air.
“Cameras are good in detecting and classifying objects in the vicinity of the vehicle, but they see poorly in the dark or through rain and fog, and they also have difficulty in accurately assessing distances to objects. LiDAR scanners work regardless of lighting conditions and are able to measure object distance and size down to millimeters, but their performance also suffers from rain and fog”, Santamala explains.
In the dark, cameras mostly have to rely on the vehicle’s lights or streetlights. In daylight, if the sun is to the horizon or the terrain is covered by snow, cameras may be blinded by the brightness or lack of any contrast or shape in the view. Various objects can also look quite different under varying lighting conditions, making it all more difficult for machine vision to operate.
The third sensor type used is a radar which works best when measuring large, moving metallic objects, i.e. determining the position and direction of other vehicles. Radar’s work even in the worst weather and their ability to measure through water and fog is a significant benefit. Interpreting the radar image remains a challenge: an aluminum can on a sidewalk may give out an entirely different and stronger signal than a person standing next to it.
Sensor fusion combines the power of different sensors
As different sensors have their strengths it’s the software’s job to combine the sensor data and utilize it for safe autonomous driving.
“Weather-related challenges can be tackled with sensor fusion and proper placement of sensors”, Santamala says and continues: “Artificial intelligence has advanced rapidly and like interpreting a visual image, AI can also be taught to interpret radar data. I assume radars will play an even larger role in the future of autonomous driving.”
Even though Sensible 4 positioning is based on LiDAR, it’s very robust against the elements.
“Our solution to this problem is an advanced probabilistic model of positioning, which measures the shape of terrain and buildings surrounding the vehicle, and effectively filters out noise and outliers. It works even when over 50% of the measured information is distorted by the weather”, Santamala mentions.
Faster growth and software development with investments
Dawn, the World’s first commercial all-weather Level 4 self-driving software by Sensible 4 will be released in 2022. At the moment the early version of the software is being tested in Norway, in a one-year trial near Oslo and at Gjesdal, near Stavanger. Sensible 4 just completed a two-week test in Finnish Lapland in freezing, snowy conditions. The second closing of A-round funding which is ending soon enables further growth of Sensible.
“We’re preparing our software product for the emerging market of autonomous transportation”, Santamala describes.
For further information, check Sensible 4’s website for material about the weather and autonomous driving: Sensible4.fi
More information
Sensible 4 Ltd is a Finnish self-driving tech company that has solved a major obstacle in autonomous driving, varying weather. The company develops full-stack autonomous driving software that turns any vehicle into self-driving. The unique technology combines software and information from several different sensors, enabling vehicles to operate in all weather conditions, including snowfall and fog. In 2022 it will launch the world’s first commercial all-weather software product, Dawn, for SAE level 4 driverless last-mile shuttles.
The founders of Sensible 4 have been developing autonomous vehicles since the ‘80s. In February 2020, Sensible 4 secured 7 million dollars in series A funding round from Japanese investors and the technology has won multiple awards, including 1st place in the Dubai World Challenge for Self-Driving Transport 2019 competition and the Finnish Engineering Prize in 2020.
Comments are closed.