Validate this! We’ve published new research to help understand and judge the real-world utility of A
May 11, 2022
3 min read
At DeepSea we have a no-bullshit approach to AI. Today we are pleased to publish a new piece of research outlining a pioneering way of verifying the accuracy – and therefore utility – of a ship’s AI-generated model in real-world conditions. This is important – the more accurate the virtual model, the more efficient a ship can be made, and vice-versa.
Artificial Intelligence. It can do many things: understand whalesong, compose film scripts on-demand, and decrease the fuel consumption of a ship at sea. However, “AI” has also quickly become the greatest buzzword of the 21st century – wooing customers, investors and governments alike.
It’s vital that serious researchers working to popularise this exciting approach continue to pursue rigorous methods of proving the real value of what they’re creating. In fact, we believe every end-user looking to employ this sort of service, in shipping or any industry, should demand it.
No-bullshit AI
At DeepSea we have a no-bullshit approach to AI. Today we are pleased to publish a new piece of research outlining a pioneering way of verifying the accuracy – and therefore utility – of a ship’s AI-generated model in real-world conditions. This is important – the more accurate the virtual model, the more efficient a ship can be made, and vice-versa.
The new approach was developed by seven of DeepSea’s thirteen-strong team of research scientists headed up by Dr. Antonis Nikitakis, and presented at the 2022 HullPic Conference in Tullamore, Ireland.
The few models that currently provide an estimation of their accuracy all do so based on testing with data obtained from the same distribution (i.e. representative of similar conditions and containing similar biases) as the data used to train the model. For example, if the model is trained on data from the vessel’s historical behaviour, in a narrow range of well-experienced wind speeds or drafts, it is also tested on data with these speeds and drafts. Thus, the tests performed can’t tell if the model is reproducing the biases in the training data – and whether it will work as well in different, never-seen-before conditions. As anyone familiar with maritime data will know, real ship-at-sea data is actually highly variable. Most model accuracy figures reported in publications and marketing materials thus bear no relation to the actual utility of those models in real use cases.
DeepSea has long researched approaches to solving the technical challenge of boosting models’ ability to understand unseen (“out-of-domain”) conditions. However, before today, there has been no benchmark for evaluating this sort of competence within a vessel model. With this announcement, we are signalling that this rigorous test is a key part of our AI methodology. Moreover, we are releasing the details of the approach for global researchers to utilise themselves, in the hope of catalysing greater transparency across the industry.
“This research is an important step in helping our customers and the wider market to understand the true power, while alleviating the limitations, of an AI-based approach“, said Dr Nikitakis. “Coupled with the daily real-world impact we’re seeing on fuel consumption and CII ratings, we believe this sort of information is key to popularising this incredible technology throughout the industry.
A three-step approach with you in mind
This sort of research constitutes the second phase of DeepSea’s three-step approach to Artificial Intelligence in shipping:
Phase 1: Pioneering research into AI approaches in shipping
Phase 2: Proving the real-world utility of these approaches
Phase 3: Advocating for common and transparent standards throughout the industry
Having, and promoting, such a framework is especially important in the Shipping space, where early adopters are embracing AI for the first time.
Dr. Konstantinos Kyriakopoulos, CTO and co-founder of DeepSea, states: “We designed our AI framework for the direct benefit of the consumer. Once again, with this research I am so pleased we can fight the hype and support our no-bullshit approach to AI with such compelling evidence. It is exactly what DeepSea was founded to do, and every day it makes an increasing impact on our clients’ bottom-lines, and the sustainable future of the planet.”
Read the full paper
The full paper can be read here: On the evaluation of uncertainty of AI models for ship powering and its effect on power estimates for non-ideal conditions.
We’d love to discuss how the DeepSea approach can form part of your company’s sustainability strategy – we look forward to you getting in touch.