Technology
05 minutes

The missing links in the last mile of insurance data

Fixing the “last mile” of insurance data needs two links: engaged brokers and consistent, automated processes with shared standards.
Written by
Angus Black
Published on
September 18, 2025

The insurance industry has made remarkable progress in digitisation and data adoption, yet one stubborn challenge remains: bridging the “last mile” of data.

Angus Black, co-founder of BarnOwl Data Solutions and a veteran of short-term insurance technology, calls this the most critical phase in unlocking reliable, usable, and value-creating data. Drawing from his experience in working with over 30 different insurance management systems and more than 500 brokers, Angus highlights two essential “links” that determine success: the human link and the technology and process link.

The human link and meaningful engagement with brokers - At the heart of the last mile is the broker. For Angus, success begins with engaging meaningfully with these primary data sources. While brokers may not always be the direct customers of data solution providers, they are pivotal to the quality and consistency of the information that enters the system.

Every broker has unique nuances, different ways of working, bespoke products, and varying timelines. Ignoring these differences leads to misunderstandings and poor data capture. As Angus explains, one of the most common frustrations among brokers is the “black hole” syndrome: they send data off into systems but receive no feedback on whether it was valuable, usable, or flawed. When errors are eventually uncovered, they often surface as major catastrophes rather than manageable issues.

To avoid this, Angus stresses the importance of establishing clear feedback loops and rules of engagement from the start. Who is responsible if data is late or flawed? What are the escalation points when things go wrong? And how do you ensure continuous alignment as regulations and compliance requirements evolve? Data that was once considered acceptable may no longer meet current standards, particularly as rating requirements and regulatory frameworks shift.

Improving data quality is not a one-off exercise. It requires ongoing collaboration, transparency, and, where possible, supplementation with external data sources. The human link, therefore, is not just about supplying data but about fostering trust, communication, and accountability between brokers, insurers, and technology providers.

The technology and process link - Alongside human engagement, robust technology and processes are non-negotiable. “Whatever data process you’re building, it needs to be repeatable and consistent,” Angus says. Inconsistency is a recipe for confusion and conflict.

For example, nothing undermines confidence faster than telling a broker their data was fine yesterday but suddenly unacceptable today. This inconsistency not only damages relationships but also destabilises the data pipeline. To counter this, Angus argues for the adoption of shared data standards across the value chain. Something as simple as defining whether gross written premium includes commission, fees, or VAT must be clear, uniform, and universally adopted. Without this, insurers risk different teams working off different interpretations of the same metric.

Automation plays a key role in supporting consistency. Automated validation and immediate feedback ensure that issues are flagged quickly, while brokers still have the data top of mind. The feedback should be detailed and constructive, “this date can’t be valid because it conflicts with another field”, rather than generic statements that leave the broker guessing.

"Whatever data process you’re building, it needs to be repeatable and consistent"

Angus Black
BarnOwl Data Solutions

Normalising and structuring data is the new frontier - Beyond consistency, Angus points to the next frontier in solving the last mile: normalising and conforming data from multiple, disparate sources. Historically, this was achieved through mapping processes, linking fields manually and creating complex translation tables. Today, artificial intelligence offers a more intelligent and scalable alternative.

AI and natural language tools bring contextual understanding into the process. They don’t just match field names; they understand what insurance concepts mean and how they relate. For Angus and his team, this capability is beginning to streamline data integration, reduce manual effort, and create more reliable outputs.

Yet, no matter how advanced the technology becomes, the way data is stored and structured remains fundamental. A logical, accessible data model ensures that information can be easily integrated into analytics platforms, AI tools, and business intelligence dashboards. This is especially important when business users, not just data scientists, are the intended audience. A well-structured model empowers them to self-serve insights, driving faster decision-making and deeper value creation.

Combining the two links for last mile success - The last mile of data is not about technology replacing humans, but about combining the two links, human engagement and technological rigour, into a cohesive chain. For Angus, this balance is critical. Without meaningful collaboration with brokers, the best systems will still fail to capture the right information. Without consistent and automated processes, even the most diligent brokers will see their efforts wasted in poor pipelines.

Follow these relatively basic principles,” Angus concludes, “and you’ll go a long way to solving that last mile problem and getting reliable data into the right hands.”

The last mile challenge in insurance data is not merely a technical hurdle, t’s an industry-wide opportunity. By engaging meaningfully with brokers, creating robust and repeatable processes, adopting common standards, and leveraging AI to normalise and structure information, insurers can finally unlock the full value of their data.

As Angus makes clear, this journey is not about perfection overnight. It is about building resilient systems, fostering trust, and delivering reliable data that powers better decisions across underwriting, claims, compliance, and customer engagement.  

In solving the last mile, insurers not only address one of their most persistent pain points, they lay the foundation for sustainable digital transformation.

Barn Owl Data Solutions

Empower your decisions by streamlining your data Data Acquisition Data Quality Conform & Integrate Reports & Analytics