© Copyright Acquisition International 2025 - All Rights Reserved.

Article Image - Ethical AI: Why the Insurance Industry Must Stop Racing Towards Automation and Firstly Consider Consumer Impact
Posted 9th March 2023

Ethical AI: Why the Insurance Industry Must Stop Racing Towards Automation and Firstly Consider Consumer Impact

The insurance industry is driven by data, from underwriting to claims to pricing, as well as customer interactions, marketing and products. The exponential growth in the volume of structured and unstructured data available to insurers has meant that the historically slow-to-adapt sector has needed to make faster, more informed decisions and to operate more efficiently.

Mouse Scroll AnimationScroll to keep reading

Let us help promote your business to a wider following.

Ethical AI: Why the Insurance Industry Must Stop Racing Towards Automation and Firstly Consider Consumer Impact
AI Tech

The appeal of bringing in AI as a quick win on existing systems can bring longer term issues 

The insurance industry is driven by data, from underwriting to claims to pricing, as well as customer interactions, marketing and products. The exponential growth in the volume of structured and unstructured data available to insurers has meant that the historically slow-to-adapt sector has needed to make faster, more informed decisions and to operate more efficiently. The challenge so far has been how to harness the potential of all of that data to create a competitive, data-driven advantage and serve customers better. 

Most insurers understand the transformative potential of AI and other big-data technologies and how it is now central to all financial services. However, few have real clarity on how to ensure its ethical use and who is responsible for these processes should things go wrong. 

The Chartered Insurance Institute’s newly-released insurance, tech and data report looks at why and how regulatory requirements such as GDPR and developments across finance, technology and data impact the insurance sector and how this is viewed by consumers and SMEs. The insurance sector has longstanding “trust issues” and the industry has in the past raced towards using tech without first defining how to measure fairness and trust from a consumer perspective. 

Without a coherent strategy of accountability for the governance of data and AI, the insurance sector puts itself and others at financial and reputational risk. In a highly challenging consumer landscape and the ongoing cost-of-living crisis, retailers simply cannot afford to lose customer trust. 

The industry needs to be aware that despite the ream of positive news stories around AI and automation, the hype around customer-facing functions, like first notification of loss (FNOL) and fraud management may not live up to consumer reality. In a tech-enabled, value-led society If a consumer has a negative experience, trust is easily lost.  

For example, in May 2021, AI-powered insurance provider Lemonade, was forced to issue an apology after a series of social media posts described how they used AI to reject claims. Its AI used non-verbal cues (such as eye movements) to decide whether claims were fraudulent. Customers were also not made aware that their biometric data was being collected and used to determine the outcome of their claim or the decision-making process behind this. This resulted in backlash on social media, resulting in Lemonade’s deleting their posts. 

This raises questions around how to ensure AI is used ethically and in ways that enhance rather than diminish trust and customer confidence. It is critical that insurers put in a framework for the ethical use of data and AI to assure customers that the data and algorithms used to make critical decisions are not biased or otherwise untrustworthy. 

Lindsay Lucas, CEO of data and software provider Software Solved, said: “If historical workflows and processes are not addressed then the issues being discussed around AI will be confounded. As we have seen through historical stories about learnt bias within some of the early AI stories (the “Amazon CV selection being one that jumps to mind), whilst it may be tempting to use the wealth of historical data some of these organisations hold, then unless the inherited bias is dealt with first, the AI will unfairly select and determine decisions. Often the appeal of bringing in AI as a quick win on existing systems can bring longer term issues and therefore more savvy insurers should be looking internally at their systems, processes and data quality ahead of layering in any AI.  

“You have to be confident in the quality and accuracy of the data held in order to trust the decisions then being made on that data. Fundamentally the technology can be incredibly useful when used on accurate, current and unbiased data sets, but often the work needed to make systems more robust, deal with technical debt that can lead to poor data processing and cleaning up bad data or being brave enough to ditch it are not popular because of the lack of immediate ROI or fear. These actions are so incredibly important to building tech you can trust and yet they are the behind the curtain activities that only the more forward-thinking companies undertake because they know failure to address it, will result in poor decision making data in future. 

“It is important that AI is fully understood and organisations do not buy in ‘black box’ style technology that doesn’t align to their own decision making processes. Ultimately the AI should be there to augment a team and provide some of the processing or information that would have traditionally been delivered by a human being, but it shouldn’t completely remove the human element. Organisations should still be able to decode an AI decision and validate it for themselves, so when anomalies happen, they can be dealt with in a human way that builds trust – no one wants to be back in the 90’s hearing “computer says no” with no other option provided. 

“The human element is the biggest barrier to the expansion of AI, where AI is being used to enhance information or make life easier for people, they will embrace it, value it and engage. However, if people feel watched, monitored and scrutinised because of the use of AI, they will look for ways to outsmart the systems, which in turn will lead to bad data, poor AI decision making due to incorrectly learnt biases and ultimately disengaged people. I agree that regulation of the use of AI is the natural way to go here if it is going to be embraced as a change for good across the industry. Many companies are already using AI for good, but for those using it more intrusively and failing to be transparent about it just further substantiates the need to regulate in order to build trust in these systems which can be transformational for organisations when used in the right way.” 

Categories: Innovation, News


You Might Also Like
Read Full PostRead - Eye Icon
Rocket Lawyer Boasts $223m Investment in an Innovating Legal Industry
Innovation
22/04/2022Rocket Lawyer Boasts $223m Investment in an Innovating Legal Industry

Like with many industries, customers look to the web in search of ways to spend their money as opposed to the high street. Legal services, it seems, are following the same path. Last year, Rocket Lawyer announced a $223 million investment that was led by Vista

Read Full PostRead - Eye Icon
8 Tips to Advance Your Career Fast
Leadership
23/04/20208 Tips to Advance Your Career Fast

After getting a job, the next thing you should work on is advancing your career. Advancing a career may take different forms, but the goal is to reach a level where you can gain maximum satisfaction from the job.

Read Full PostRead - Eye Icon
Next-Gen Shopping App Introduces Aisle Sat-Nav, Facial Age-Verification, Queue-Less and Till-Less Checkout To The High Street
Innovation
11/03/2020Next-Gen Shopping App Introduces Aisle Sat-Nav, Facial Age-Verification, Queue-Less and Till-Less Checkout To The High Street

Ubamarket is the only tech of its kind to increase purchases and secure more footfall for high street retailers. This is a much-needed solution amidst the decline of the UK retail industry following the rise of e-commerce, which has seen large quantities of cu

Read Full PostRead - Eye Icon
The Benefits Of Adopting Corporate Socially Responsible Philosophies
Corporate Social Responsibility
29/09/2022The Benefits Of Adopting Corporate Socially Responsible Philosophies

Social responsibility is a way to ensure good business practices and do what is suitable for your employees, staff, and customers. More and more businesses understand that their role in society goes beyond their product offerings and can profoundly impact the

Read Full PostRead - Eye Icon
Peace of Mind; Cloud is Key in Scaling Systems to Your Business Needs
Innovation
16/04/2024Peace of Mind; Cloud is Key in Scaling Systems to Your Business Needs

Meeting the demands of the modern-day SMB is one of the challenges facing many business leaders and IT operators today. Traditional, office-based infrastructure was fine up until the point where greater capacity was needed than those servers could deliver, ven

Read Full PostRead - Eye Icon
Hemp Highlighted as Stepping Stone to Carbon-Neutral Future
News
30/11/2021Hemp Highlighted as Stepping Stone to Carbon-Neutral Future

This year’s Q4 report by Canxchange looked at the state and prospects of the global market for hemp products. Canxchange provides industry analyses to professionals in the sector, and in their latest report, they highlighted the role of the industrial use of

Read Full PostRead - Eye Icon
Business Merger vs Consolidation: What’s The Difference?
M&A
24/09/2021Business Merger vs Consolidation: What’s The Difference?

With the continuously evolving economy, business mergers and consolidations are becoming more common. Often, there are also legalities involved in both processes, which makes it important to consult with law experts.

Read Full PostRead - Eye Icon
CEO of the Month: USA
Innovation
29/06/2016CEO of the Month: USA

OCEANWORX is a global sports marketing, media production and distribution founded by international media authority David Jones in the year 2000

Read Full PostRead - Eye Icon
HAYSTACKID Acquisition of FLEX Discovery Transaction
Innovation
29/02/2016HAYSTACKID Acquisition of FLEX Discovery Transaction

HAYSTACKID is an international end-to-end eDiscovery and forensics services and solutions provider.



Our Trusted Brands

Acquisition International is a flagship brand of AI Global Media. AI Global Media is a B2B enterprise and are committed to creating engaging content allowing businesses to market their services to a larger global audience. We have 14 unique brands, each of which serves a specific industry or region. Each brand covers the latest news in its sector and publishes a digital magazine and newsletter which is read by a global audience.

Arrow