Connected Claims USAFind us at booth 502, Signia by Hilton Orlando, Nov 3-4Booth 502 · Orlando, Nov 3-4Booth 502 · Connected ClaimsBook a meeting
Blog›Guides
GuidesAugust 6, 2026·19 min read·Pankaj Dhariwal·Updated October 15, 2026

Procurement and AI vendor risk: the seat that cannot say yes sets your deployment date

The third-party risk reviewer, not procurement, sets your AI deployment date. What 29 jurisdictions require, the 16 artifacts carriers request, and the 8 contract clauses that decide the deal.

PD
Pankaj Dhariwal · CEO and Co-founder
August 6, 2026·19 min read·Updated October 15, 2026
The numbers behind this
29NAIC jurisdictions with AI-specific insurance supervisory expectations25 adopted the Model Bulletin plus 4 with their own rules (NAIC map, April 1, 2026)
48%Of breaches now involve a third partyThird-party involvement up 60% year over year (Verizon 2026 DBIR)
45%Of third-party risk teams rank getting vendor documents a top-three daily challengeThe single most common answer (Venminder and Ncontracts, 2025)
6%Of third-party risk programs report to procurement37% report to risk management or a risk committee

What is AI vendor risk assessment in insurance? It is the due diligence a carrier runs before a third-party AI system touches claim data or claim decisions: verifying the vendor's security posture, AI governance, and contract terms against the legal standards the carrier itself is held to. The carrier stays accountable for the vendor's system under NAIC guidance, so the review tests whether that accountability can be defended to an examiner.

The seat that sets the deployment date for AI claims automation at a carrier is not the Claims VP who wants it or the CIO who integrates it. It is the third-party risk reviewer, who cannot approve the purchase and can hold it indefinitely. But that review is not a maze. It is a document request, and the request is finite: roughly sixteen artifacts, eight AI contract clauses, and one data-flow diagram. Treat it as a known list and it closes in weeks. Discover the list one item at a time and it takes two quarters.

Most of the delay is wait state, not scrutiny. A reviewer asks for a document, the vendor takes two weeks to produce it, the document raises a follow-up, and the round trip queues behind an entire vendor portfolio carried by one or two people. The 2025 Venminder and Ncontracts State of Third-Party Risk Management survey, a ninth annual study fielded from November 2024 to January 2025 across financial services, insurance, fintech, healthcare, retail, and IT respondents, found that getting timely, accurate documentation from vendors is the number one daily challenge in third-party risk, placed in the top three by 45% of respondents. Analyzing the documents that do arrive, including SOC reports, financials, and contracts, was named by another 20%. The bottleneck is paper, not judgment.

This is written for the composite seat that runs that review - the third-party risk owner sitting under risk management, information security, or compliance - and for the CIO and compliance officer who sign next to them. It covers who owns the gate, why the AI review got heavier in 2026, what four regulatory documents actually require of a carrier buying third-party AI, the artifact list, the eight contract clauses that decide the deal, and how to compress the calendar without reducing scrutiny. It is the review-side companion to the complete guide to claims automation, which covers what you are actually buying.

The seat that cannot say yes but can say no

Third-party risk management is the carrier function that reviews and approves outside vendors before they touch carrier data or carrier decisions. At most organizations it does not sit in procurement. It sits under risk management, information security, or compliance, and it holds a veto rather than a budget. That is the seat that decides your calendar.

Third-party risk reports to risk management or a risk committee at 37% of organizations, to information security at 11%, to compliance at 10%, to IT at 8%, and to procurement at 6%, per the 2025 Venminder and Ncontracts survey. Executive management, finance, legal, and operations split most of the remainder. The consequence for anyone selling into a carrier is that sending the security packet to the sourcing contact usually means it sits until someone forwards it. The consequence for the carrier is that the person who will decide how long this takes is often not in the commercial thread yet.

Where third-party risk management reports inside the organization (Venminder and Ncontracts, 2025)

Risk management or risk committee37%
Information security11%
Compliance10%
IT8%
Procurement6%
Executive management6%

That person is also thin on capacity. 48% of third-party risk programs run on one or two dedicated full-time employees, up from 43% the prior year, and 22% run on three to five. Programs staffed with six to ten FTEs dropped by 60%, from 10% of respondents to 4%. The portfolios moved the other way: 28% of programs manage 100 to 300 vendors, 18% manage more than a thousand, and only 7% manage fewer than fifty. Every incomplete answer a vendor sends re-enters that queue at the back.

01The reviewer's queue

Every incomplete answer goes to the back of a one- or two-person queue

Most of the delay is wait state, not scrutiny: one missing document restarts a round trip behind the whole vendor portfolio.

One round trip
  1. 1.The reviewer asks for a document
  2. 2.The vendor takes two weeks to produce it
  3. 3.The document raises a follow-up question
  4. 4.The answer re-enters the queue at the back
Who carries the queue
48%of third-party risk programs run on one or two dedicated FTEs
18%of programs manage more than a thousand vendors
45%rank getting timely, accurate vendor documents a top-three challenge

The bottleneck is paper, not judgment.

Source: Venminder and Ncontracts, 2025 State of Third-Party Risk Management survey (ninth annual, fielded November 2024 to January 2025, cross-industry respondents including insurance).

The pressure on the seat is external and documented. 70% of respondents reported feeling pressure to improve their third-party risk program, with 34% of that pressure coming from auditors, regulators, and examiners and 30% from management or the board. At their most recent exam or audit, 29% were told improvements were required, and only 37% came away with no findings at all. A reviewer who slows down on an AI vendor is not being obstructive. They are responding to a finding they have already received or expect to receive next cycle.

Vendor AI now ranks second on the third-party risk concern list, behind cyberattacks at vendors and ahead of pending regulatory changes. That ordering explains most of what happens to an AI purchase inside a carrier in 2026. For the wider map of who else sits in the carrier buying committee and what each seat blocks, see the carrier buying center map for AI claims investigation. This post is the detailed treatment of the one seat that map identifies as a veto without a budget.

Why the AI vendor review got heavier in 2026

Three forces converged on the AI vendor review, and none of them is about any single product. Third-party breach exposure roughly tripled in two years. AI-specific insurance supervisory expectations reached 29 of the 56 NAIC jurisdictions. And vendor AI moved into second place on the third-party risk concern list, behind only cyberattacks at vendors.

The breach number changed the tone of every questionnaire. The Verizon 2026 Data Breach Investigations Report, published May 19, 2026, found that breaches involving a third party now account for 48% of all breaches, with third-party involvement up 60% year over year. The 2025 edition, published April 23, 2025, reported that the share had doubled to 30% across more than 22,000 security incidents and 12,195 confirmed breaches. Two editions ago it was 15%. A reviewer working from that trend line will not accept a vendor security posture on assertion.

Share of breaches involving a third party, by DBIR edition

2024 report15%
2025 report30%
2026 report48%

The regulatory line moved at the same time. The NAIC adopted its Model Bulletin on the Use of Artificial Intelligence Systems by Insurers on December 4, 2023. As of the NAIC Big Data and Artificial Intelligence Working Group implementation map dated April 1, 2026, 25 jurisdictions had adopted the bulletin and four more run insurance-specific AI regulation or guidance of their own: California Bulletin 2022-5, Colorado 3 CCR 702-10, New York Circular Letter No. 7, and Texas Bulletin B-0036-20. That is 29 of 56 jurisdictions with a published AI supervisory expectation, from a standing start two and a half years earlier.

The third force is experience. 49% of organizations experienced a third-party vendor cyber incident in 2024. Among moderate-impact incidents, 66% carried a monetary cost, 50% caused reputation damage, and 33% drew regulatory scrutiny, with 64% recovering in under 60 days. A reviewer who has worked one of those does not need convincing that the questionnaire matters.

None of this is bureaucracy. A carrier that hands a vendor claim files, adjuster notes, medical records, and recorded statements has extended its own regulatory perimeter to that vendor. The review is the mechanism that makes the extension defensible. The productive vendor response is not to argue the review down. It is to arrive with the evidence already assembled.

What regulators put in writing about your vendor

Four documents define the US expectation set for third-party AI in insurance: the NAIC Model Bulletin, New York DFS Circular Letter No. 7 (2024), Colorado Amended Regulation 10-1-1, and the NIST AI Risk Management Framework the bulletin points at. All four converge on one rule. The carrier stays responsible for a system it did not build.

The NAIC Model Bulletin puts three obligations on the carrier

Section 4.0 of the NAIC Model Bulletin on the Use of Artificial Intelligence Systems by Insurers is three paragraphs long and it sets the entire vendor agenda. Section 4.1 covers "due diligence and the methods employed by the Insurer to assess the third party and its data or AI Systems acquired from the third party to ensure that decisions made or supported from such AI Systems that could lead to Adverse Consumer Outcomes will meet the legal standards imposed on the Insurer itself." Section 4.2 asks for contract terms that "provide audit rights and/or entitle the Insurer to receive audit reports by qualified auditing entities" and that "require the third party to cooperate with the Insurer with regard to regulatory inquiries and investigations." Section 4.3 covers the performance of those rights, which means holding the clause is not enough. The carrier has to use it.

The scope answers the question a vendor gets asked next. Section 1.6 says the AI systems program should address use "across the insurance life cycle, including areas such as product development and design, marketing, use, underwriting, rating and pricing, case management, claim administration and payment, and fraud detection." Section 1.8 says it applies to systems used in regulated insurance practices "whether developed by the Insurer or a third-party vendor." Claims investigation AI is squarely inside both. And the bulletin's examination provisions tell a carrier what a department may ask for, including information and documentation relating to the insurer's pre-acquisition and pre-use diligence, monitoring, oversight, and auditing of AI systems developed by a third party. Pre-use diligence is a documentation obligation that attaches before the contract is signed, which is why this review happens when it happens.

Section 1.5 says the program "may adopt, incorporate, or rely upon, in whole or in part, a framework or standards developed by an official third-party standard organization, such as the National Institute of Standards and Technology (NIST) Artificial Intelligence Risk Management Framework, Version 1.0." That is the through-line from a federal framework to a state insurance expectation. NIST released AI RMF 1.0 on January 26, 2023 with four core functions - Govern, Map, Measure, and Manage - and two subcategories written for exactly this situation. GOVERN 6.1 calls for policies and procedures addressing AI risks associated with third-party entities. GOVERN 6.2 calls for contingency processes to handle failures or incidents in third-party data or AI systems deemed high-risk. If a carrier says its AI program follows NIST, those two subcategories are what it owes on your file.

New York and Colorado, read precisely

New York DFS Insurance Circular Letter No. 7 (2024), issued July 11, 2024, is the clearest published articulation of what a US insurance regulator expects a carrier to hold in a vendor contract. It states that insurers retain responsibility for understanding any tools, external consumer data sources, or AI systems developed or deployed by third-party vendors. It requires written standards, policies, procedures, and protocols for acquiring or relying on vendor-developed AI. And it says contract terms should, where feasible, provide audit rights or entitle the insurer to receive audit reports by qualified auditing entities, and require the vendor to cooperate with the insurer on regulatory inquiries. Read the scope line carefully: CL 7 is scoped to underwriting and pricing, not claims. It does not govern claims AI. It matters anyway, because carrier third-party risk teams run one internal AI template across every purchase, and CL 7 is where much of that template came from.

Colorado Amended Regulation 10-1-1, 3 CCR 702-10, is the most granular published list of what a US insurance regulator wants documented about a third-party model. Section 5.A.9 requires a documented, up-to-date inventory with version control of every external consumer data source, algorithm, and predictive model, including a detailed description of each, its clearly stated purpose, and the outputs generated. 5.A.10 requires a documented explanation of any material change to that inventory and the rationale. 5.A.12 requires a documented description of ongoing monitoring of model performance including accounting for model drift. 5.A.13 requires a documented description of the process used for selecting external resources including third-party vendors. 5.A.14 requires documented comprehensive annual reviews of the governance structure. The Colorado Division of Insurance notice of adoption covers the amended version, effective October 15, 2025. The original took effect November 14, 2023.

Two precision points. First, 10-1-1 is an unfair-discrimination regulation. Its trigger is the use of external consumer data and information sources, and its covered lines are individually issued life insurance, private passenger automobile insurance, and health benefit plans. It does not directly regulate commercial property and casualty claims investigation, and any vendor who says otherwise has not read it. Second, and worth its own sentence: Section 5.B keeps responsibility with the insurer for everything in 5.A when third-party vendors are involved, and then adds that insurers may satisfy requests for documentation and information by having third-party vendors provide the requested documents or information directly to the Division on the insurer's behalf. That is an explicit regulatory endorsement of a vendor answering the state directly. For private passenger auto and health benefit plan insurers, the compliance report is due July 1, 2026 and annually after that, so this is live rather than prospective.

Scope lines are the credibility test

New York Circular Letter No. 7 (2024) is scoped to underwriting and pricing, not claims. Colorado 10-1-1 is triggered by external consumer data use and covers life, private passenger auto, and health benefit plans, not commercial property and casualty claims. Neither directly governs a P&C claims investigation system. Both still shape the file, because carrier third-party risk teams run one internal AI template across every purchase and these two documents are where much of that template's content originated. A vendor that states the scope limits before being asked buys more credibility than one that claims broad applicability and gets corrected by a reviewer who has read the text.

The structure of the review is borrowed from banking

The Interagency Guidance on Third-Party Relationships: Risk Management, issued jointly by the Federal Reserve, the FDIC, and the OCC on June 6, 2023, defines five life-cycle stages: planning, due diligence and third-party selection, contract negotiation, ongoing monitoring, and termination. Carriers are state-regulated rather than bank-regulated, so the guidance does not bind them. Most carrier third-party risk programs copy the five stages anyway, because the examiners and consultants who staff them came from the same talent pool. If you know the five stages, you can predict the order of the questions and the document each one is waiting on.

RequirementSourceWhat the carrier must holdWhat the vendor supplies
Due diligence on third-party AI before useNAIC Model Bulletin 4.1Evidence of pre-acquisition assessmentModel documentation, security packet, references
Audit rights or third-party audit reportsNAIC Model Bulletin 4.2(a); NY DFS CL 7 (2024)Contract clause plus the reports themselvesSOC 2 report, pen test summary, contractual audit right
Vendor cooperation with regulatory inquiriesNAIC Model Bulletin 4.2(b); NY DFS CL 7 (2024)Contract clauseNamed regulatory-response contact and a stated response commitment
Exercising the audit right, not just holding itNAIC Model Bulletin 4.3Evidence the review actually happenedAnnual review support, refreshed reports
Written standards for acquiring third-party AINY DFS CL 7 (2024)Internal policyVendor-side inputs the policy calls for
Model inventory with version control and stated outputsColorado 10-1-1 5.A.9Inventory entry per systemModel card, version history, output description
Material-change explanationColorado 10-1-1 5.A.10Change log with rationaleModel change notification clause
Ongoing drift monitoringColorado 10-1-1 5.A.12Monitoring recordsPerformance reporting cadence
Documented vendor selection processColorado 10-1-1 5.A.13Selection memoRFP response, evaluation criteria
Production of documents to the DivisionColorado 10-1-1 5.BResponsibility stays with the insurerVendor may submit directly on the insurer's behalf
Third-party AI policies and incident contingencyNIST AI RMF GOVERN 6.1, 6.2Policy plus contingency planBCP and DR plan, RTO and RPO, incident-notification terms
Full relationship life-cycle managementInteragency Guidance (Fed, FDIC, OCC, 2023)Planning through terminationExit and data-return terms

Read that table as a vendor and one thing stands out. Most of the rows are satisfied by documentation rather than by a control. Hesper's position on the documentation rows is structural rather than procedural: every decision the investigation agent makes is logged with sources, reasoning, and timestamps, because an SIU lead reviewing the file and a state examiner sampling it both need to read the same record. The audit trail is not a compliance feature bolted onto the product. It is the product's output format.

The AI vendor due diligence checklist: 16 artifacts carriers request

The request is finite and knowable: sixteen artifacts across four blocks, which are security, privacy and data, AI governance, and contract terms. The security block stalls young vendors on the age of their evidence. The AI-governance block stalls almost everyone, because those documents have rarely been written for an insurance reviewer before.

The sharpest number in the third-party risk data measures exactly that gap. Between 2024 and 2025, the share of organizations assessing vendor AI by adding usage language to the contract rose from 11% to 40%. Documenting AI risks internally went from 6% to 39%. Verbal communication with the vendor went from 2% to 38%. Sending questionnaires went from 15% to 32%. But collecting vendor documentation moved only from 8% to 14%. Carriers are writing AI clauses roughly three times more often than they are collecting the documentation those clauses point at. That is not indifference. It is that the documents mostly do not exist on the vendor side yet. Organizations not monitoring vendor AI usage at all fell from 37% to 23% over the same period, so the population asking is growing fast.

02How organizations assess vendor AI

Carriers write AI clauses about three times as often as they collect documents

Share of organizations using each method to assess vendor AI, 2025, with the 2024 share under each bar.

Share of organizations, 2025
Add AI usage language to the vendor contract40%Up from 11%
Document AI risks internally39%Up from 6%
Verbal communication with the vendor38%Up from 2%
Send questionnaires32%Up from 15%
Collect vendor documentation14%Up from only 8%

The AI clauses point at documents that mostly do not exist on the vendor side yet.

Source: Venminder and Ncontracts, State of Third-Party Risk Management survey, 2024 and 2025 editions. Cross-industry respondents, including insurance.

Two cadence facts shape what lands in your inbox. 55% of organizations updated their vendor risk questionnaire and due diligence document requirements within the past year, so the list your last carrier used is probably already stale. And 92% complete inherent risk assessments before diligence begins, with 47% tying reassessment frequency to the vendor's risk tier and 33% reassessing annually. The tier assigned in week one determines how heavy the rest of the review is, which is why the data-flow answer belongs at first contact rather than at week six.

ArtifactWho at the carrier asksTypical formWhy AI vendors stall on it
SOC 2 reportInformation securityAuditor report with readable scope and audit cadenceConfirm which trust services criteria were scoped in
Penetration test executive summaryInformation securityThird-party test summary, current yearTest was scoped to the marketing site, not the product
ISO/IEC 27001 certificate or ISMS evidenceInformation securityCertificate plus statement of applicabilityOften absent where SOC 2 exists; most carriers accept either
ISO/IEC 42001 or documented AI management systemRisk and complianceCertificate or a written AIMS descriptionStandard published in 2023; most vendors have neither certificate nor written system
Data processing agreement with privacy annexesLegal and privacySigned DPAVendor paper does not match carrier paper on subprocessors and deletion
Subprocessor list plus change notificationInformation security and privacyPublished list plus a contractual notice periodModel and infrastructure providers change faster than the list is maintained
Model card or model documentationRisk and model governanceWritten description of purpose, inputs, outputs, and limitsMost AI vendors have never authored one for an insurance reviewer
Training-data-use statementRisk and legalWritten commitment, then a contract clauseVendors describe the practice on a call and resist putting it on paper
Human-in-the-loop attestationComplianceWritten description of what the system decides and what a person decidesRequires stating the decision boundary precisely, which many avoid
Model change notification termsRisk and vendor managementContract clause with a notice periodVendors ship continuously and resist a fixed notice window
Data retention and deletion policyPrivacyPolicy with actual retention periods per data classThe policy exists; the schedule does not
BCP and DR plan with RTO and RPOInformation security and operationsPlan document plus last test datePlan is written but never exercised
Cyber insurance certificateRisk and legalCertificate of insurance with limitsLimits sit below the carrier's vendor threshold
Completed SIG or CAIQ questionnaireThird-party riskCompleted workbookAnswered by three people with three vocabularies, generating three follow-up rounds
Audit rights clauseLegalContract clause plus report-delivery commitmentVendor offers reports but not the right; NAIC 4.2(a) accepts either, so say which
Exit, termination assistance, and data-return termsLegal and vendor managementContract clause with format and timelineNobody drafted it, so it is discovered at signature

The security block is the half of the packet with an established grammar. SOC 2 reports against the AICPA trust services criteria - security, availability, processing integrity, confidentiality, and privacy - and the report itself states which criteria were scoped in and what the auditor examined. What a reviewer actually reads is the scope page and the audit cadence: which criteria were covered, when the attestation was issued, and whether the next audit period is scheduled. The depth on that half of the packet, including the seven data-handling controls that sit on top of SOC 2, is in SOC 2 and data handling for AI fraud investigation.

The AI-governance block has no established grammar yet, which is why it stalls. Most AI vendors have never authored a model card for an insurance reviewer, have never written down where the human decision boundary sits, and have never committed in writing to a model-change notice period. ISO/IEC 42001:2023, the first AI management system standard, is becoming the shorthand answer to this block, though certification is still uncommon. Note also that this is not the CIO's review. The third-party risk owner is assessing whether the carrier can defend the relationship; the CIO is assessing whether the system integrates and where the data physically sits. The two run in parallel and ask different questions, and the integration and MSA side is covered in the CIO checklist for an AI claims investigation rollout.

How to verify an AI vendor's claims before you sign

Collecting the sixteen artifacts is necessary and not sufficient, because documents attest and do not demonstrate. Every vendor claim worth relying on maps to an artifact that evidences it and a test that checks it, and the fastest reviews run both columns in parallel: request the paper, then verify the two or three claims the deal actually depends on against the carrier's own data.

Vendor claimArtifact that evidences itHow to test it
A stated accuracy or detection rateBenchmark methodology: dataset size, class mix, how ground truth was establishedRe-run it on a holdout of your own closed claims with outcomes the vendor never sees
SOC 2 complianceThe report itself, not the badgeRead the scope page: which trust services criteria, which product and period, which exceptions the auditor noted
A human stays in the loopWritten decision-boundary attestation: what the system decides, what a person decidesTrace one claim end to end in the proof of concept and record who made each call
No training on carrier dataA contractual commitment plus the data-flow diagramCheck the DPA and subprocessor terms for inference logging and retention language that contradicts the claim
Fully explainable outputA sample investigation record or model cardHand the sample to an SIU lead who has never seen the product and ask them to reconstruct the conclusion without vendor help
Integrates with your core systemAPI documentation and at least one named integration patternRun a sandbox connection during the proof of concept rather than accepting a logo wall

A bounded proof of concept on your own closed claims

Everyone advises testing on your own data and almost nobody writes down how. The protocol below fits on one page, satisfies the NAIC Model Bulletin 4.1 pre-use diligence obligation with evidence rather than assertion, and fits inside the review calendar instead of extending it.

  1. Pull 50 to 200 closed claims with known outcomes, mixing paid-clean, denied-for-cause, and SIU-confirmed files. Seal the determinations before the vendor sees anything.
  2. Give the vendor only the inputs the system would see in production at referral: the claim file as it stood, not the conclusion.
  3. Set acceptance thresholds in writing before the run starts: agreement rate with the sealed determinations, false-referral rate, and completeness of the investigation record. Thresholds set after the results arrive are not thresholds.
  4. Salt the sample: a few claims with documents you know were altered, a confirmed staged loss if you have one, and a few clean claims that merely look suspicious. The misses on salted files tell you more than the hits on easy ones.
  5. Score the output with the vendor out of the room. A record that only makes sense with a sales engineer narrating will not survive an examiner either.
  6. Paper the result: what was tested, the thresholds, the outcome. That memo is the pre-use diligence evidence NAIC 4.1 expects the carrier to hold, so the proof of concept does double duty.

Eight red flags that end the review

Verification also has a floor. Some vendor behaviors are not findings to mitigate but reasons to stop, because each one predicts the relationship the carrier would be signing up for.

  • No SOC 2 report and no audit engagement with a date. A vendor on the way to one has a signed engagement letter; a vendor stalling has a roadmap slide.
  • Trains on customer data by default, with the opt-out buried in a settings page instead of stated in the contract.
  • Refuses to name subprocessors, including which foundation-model and hosting providers sit under the product.
  • No model card or written model documentation of any kind. A system the vendor cannot describe on paper is a system the carrier cannot inventory under a Colorado 10-1-1-style requirement.
  • Overclaims regulatory scope - says the EU AI Act or Colorado 10-1-1 mandates the purchase - to a reviewer who has read both.
  • Will not commit to a model-change notice period in writing. Continuous shipping is a deployment practice, not a reason the carrier should learn about changes from release notes.
  • Certificate of insurance shows limits below the indemnity cap in the vendor's own MSA draft.
  • Questionnaire answers that contradict each other because three authors wrote them. Inconsistency on paper the vendor controls predicts inconsistency everywhere else.

Detection vendors and investigation vendors get reviewed differently

The artifact a product emits determines the review it gets. A score is reviewed as a model, which creates a standing model-governance obligation the carrier carries for as long as the model is in production. A documented investigation record is reviewed as evidence, and the explainability the reviewer is asking for is the deliverable itself rather than a separate document.

Start from the layer map, because it explains the review difference without any marketing in it. Detection is upstream; investigation is downstream. FRISS, Shift Technology, and Verisk sit at the detection layer and output a score or a flag on a claim. Hesper sits at the investigation layer and outputs a documented record of how a conclusion was reached, produced by 15+ investigation phases run in parallel on every flagged claim. Complementary to FRISS, Shift Technology, and Verisk - not a replacement. The modal carrier deployment runs both layers, and the move from fraud detection to fraud resolution is what changes the shape of the review.

A carrier reviewing a scoring model asks about training data, drift, bias testing, and the explainability of a number. That is precisely the list Colorado 10-1-1 formalizes across 5.A.9 through 5.A.12: inventory with version control, stated purpose and outputs, material-change explanation, and drift monitoring. It is a real and ongoing regulatory obligation, not vendor overhead, and it recurs on every model version for the life of the deployment. A detection vendor is not doing anything wrong by creating it. That obligation is the price of occupying that layer.

Review dimensionDetection or scoring vendorInvestigation vendor
Primary outputA score or flag on a claimA documented investigation record
How third-party risk classifies itModel riskModel risk plus evidence handling
Colorado-style inventory obligationRecurring per model versionRecurring, but the output documents itself
Explainability evidenceMust be authored separately from the productIs the product
Regulator-facing artifactRequires translation from score to rationaleAlready reader-ready for an examiner
Re-review triggerEvery material model changeEvery material model change
Where reviews stallBias testing and drift documentationNewness of the vendor, not the artifact

Two concessions belong here. First, incumbency is a genuine procurement advantage and pretending otherwise is not useful. Verisk's ISO ClaimSearch is contributory industry infrastructure most carriers papered years ago, so the third-party risk file already exists and a review is a refresh rather than an origination. A new AI entrant has no such precedent and should expect the longer path. Second, the re-review trigger row above is identical on both sides on purpose. Any material model change re-opens the file for an investigation vendor exactly as it does for a scoring vendor. A comparison table where one side wins every row is marketing, and an experienced reviewer discounts the whole document when they see one.

One further distinction saves argument. Security certifications answer the security half of a third-party risk packet and say nothing about the AI-governance half. A vendor can hold every certification on the list and still have no model documentation, no stated human-review boundary, and no model-change notice commitment. That is the half carriers are newly writing into contracts, and it is the half where the packets are empty.

A detection vendor sells a number and then has to author a separate document explaining how the number was produced. An investigation vendor sells the document. The compliance artifact and the deliverable are the same object, which is why the evidence a third-party risk reviewer asks for already exists before the reviewer asks for it.

Hesper AI product research

The escalation path above the third-party risk owner runs to the chief risk officer, who will ask whether the system belongs in the model inventory at all and what the concentration exposure looks like if it fails. That framing, including where an investigation agent lands inside a model risk taxonomy built for pricing models, is worked through in the chief risk officer's view of AI claims investigation.

The AI addendum: eight clauses that decide the deal

The security packet rarely kills an AI deal in insurance. The contract does. Eight clauses carry the weight: training-data use, model change notification, human-in-the-loop attestation, subprocessor disclosure, retention and deletion, exit and data return, audit rights, and regulatory cooperation. Carriers now pre-draft most of them, so expect redlines rather than blanks.

Expect them because carriers started writing them. The share of organizations adding AI usage language to vendor contracts went from 11% to 40% in a single year in the Venminder and Ncontracts data. A vendor that arrives with the eight already drafted is negotiating from its own paper. A vendor that waits for the carrier's addendum is negotiating from someone else's and has added a full redline cycle to the calendar.

  1. Training-data use. State plainly whether carrier data is used to train or fine-tune any model, and if it is not, say so as a contractual commitment rather than a policy statement. The carrier CIO's stated shutdown triggers are pre-SOC-2 vendors, training-on-customer-data clauses, and vague data-flow diagrams. This clause covers two of the three.
  2. Model change notification. Define what counts as a material change and how much notice the carrier gets. This is the clause that maps to Colorado 5.A.10's material-change explanation requirement, and the carrier cannot satisfy that requirement if it learns about your change from a release note.
  3. Human-in-the-loop attestation. Write down what the system decides and what a person decides. For claims work the boundary is not ambiguous: the agent investigates and produces the record, and the SIU lead or adjuster makes the determination. Put that sentence in the contract, not only in the deck.
  4. Subprocessor list and change notification. Name the model providers, the hosting infrastructure, and any data enrichment sources, then commit to a notice period before the list changes. 58% of organizations review their third parties' own third-party risk, so this list gets read carefully.
  5. Data retention and deletion. Not a policy stating that data is retained no longer than necessary. A schedule with actual periods on it, per data class, with a deletion attestation available on request.
  6. Exit, termination assistance, and data return. Format, timeline, and who bears the cost. This is the clause most often discovered at signature because nobody drafted it, and it is the fifth stage of the interagency life cycle.
  7. Audit rights. NAIC Model Bulletin 4.2(a) asks for audit rights and/or the right to receive audit reports by qualified auditing entities. Offering reports alone is a common vendor position and often an acceptable one. State which you are offering rather than leaving the carrier to discover it in redlines.
  8. Regulatory cooperation. NAIC 4.2(b) calls for the vendor to cooperate with regulatory inquiries and investigations. Colorado 5.B goes further and permits the vendor to provide documents directly to the Division on the insurer's behalf. Offer a named regulatory-response contact and a response commitment before it is asked for. It costs nothing and a compliance officer will remember it.

None of the eight is exotic and each is answerable in a page. The reason they stall deals is that they get answered late, one at a time, by different people at the vendor, each answer arriving after the reviewer has already moved the file to the back of the queue.

03Clause 3 · Human-in-the-loop

Write the decision boundary into the contract, not only the deck

For claims work the boundary is not ambiguous, so the attestation can name both sides of it.

Input
Flagged claim referred for investigation
Claim_file.pdfRecorded_statement.mp3Medical_records.pdf
The agent investigates
Every step logged with sources and reasoning
  1. 01Collect and review the claim documents
  2. 02Cross-reference statements and rebuild the timeline
  3. 03Run 15+ investigation phases in parallel
  4. 04Produce the documented investigation record
Case record
A person determines
SIU lead or adjuster
  • The fraud determination
  • Referral or denial decision
  • Sign-off on the finding
Put that sentence in the contract
Illustrative exampleIllustrative decision-rights map for a claims investigation vendor, drawn from the human-in-the-loop attestation clause in this article.

Clause names are cheap and drafts are rare, so here is the second clause as actual contract text. It is the one that maps to Colorado 10-1-1 5.A.10 and the one carriers have seen a vendor volunteer least often. Redline from it rather than starting from a blank page.

text
Model Change Notification. Vendor shall provide Customer written notice at least thirty (30) days before deploying any Material Model Change to the services used by Customer. A "Material Model Change" means (a) replacement of, or a version change to, any foundation model or scoring model used to process Customer Data; (b) a change to model inputs, decision thresholds, or training data sources reasonably likely to alter outputs on Customer claims; or (c) the addition of any new AI feature that processes Customer Data. Each notice shall describe the change and its expected effect on outputs, and shall include updated model documentation. Customer may require re-validation on a mutually agreed claim sample before the change applies to Customer's production use, and may suspend affected use without penalty while a failed acceptance threshold is being remediated.

What insurance the AI vendor itself should carry, and how to check it

The cyber insurance certificate is the artifact most reviews rubber-stamp, and it is where vendor-side risk actually concentrates. Two policies matter and they answer different failures. Cyber coverage responds to the vendor losing your data. Technology errors and omissions responds to the vendor's product being wrong - a model output that contributes to a wrongful denial lands there, not on the cyber policy, and general liability covers neither. Embroker's 2026 overview of AI vendor risk and insurance maps how AI exposure now spans cyber, Tech E&O, and other liability lines rather than sitting cleanly inside any one policy.

Two developments change how to read the certificate in 2026. First, AI-specific exclusions are beginning to appear in vendors' own E&O policies, which means a vendor can hold a current, valid policy that would not respond to the exact failure the carrier is worried about - the same silent-gap dynamic the market already lived through with silent cyber. Second, the requirement is moving into procurement itself: Armilla's 2026 analysis of enterprise MSAs documents buyers writing AI-specific coverage requirements into master service agreements, with per-claim limits often above $10 million, sized to the enterprise customer's exposure rather than to the vendor's preference. Neither development is visible on a certificate of insurance unless someone asks.

  • Request the certificate of insurance directly from the vendor's broker with the carrier named as certificate holder, so a lapse at renewal generates notice.
  • Check the policy period against the contract term, and for E&O written on a claims-made basis, ask for an extended reporting period that survives termination.
  • Match limits to the indemnity cap in the MSA. A $1 million E&O limit behind a $5 million indemnity obligation means the last $4 million is the vendor's balance sheet, which for an early-stage vendor is the round they have not raised yet.
  • Ask one written question: does any exclusion or endorsement on the E&O or cyber policy limit coverage for claims arising from AI model output? A vendor who has read their own policy answers in a day.
  • Confirm the insurer's financial strength rating, and make 30 days' notice of cancellation or material policy change a contract term rather than a certificate footnote.

Compressing the review from two quarters to a few weeks

The review is sequential by default and parallel by design. Compression comes from removing wait states, not from reducing scrutiny. Map the five life-cycle stages onto a carrier AI purchase, identify what each stage is waiting on, and pre-stage the document that clears it before the stage begins.

Five life-cycle stages, the wait state inside each one, and the document that removes it. Four of the five are waiting on paper that could have been sent at first contact.

Life-cycle stageWhat the carrier is doingThe wait stateThe pre-stage that removes it
PlanningSetting scope, criticality tier, and data classificationWaiting on a data-flow answer to set the tierOne-page data-flow diagram delivered at first contact
Due diligence and selectionCollecting and analyzing the artifact packetWaiting on documents, the number one third-party risk challengeFull indexed packet sent unrequested, mapped to the questions it answers
Contract negotiationRedlining the MSA and the AI addendumWaiting on AI clauses nobody has drafted yetPre-redlined AI addendum carrying the eight clauses
Ongoing monitoringSetting reassessment cadence and evidence requirementsWaiting on a reporting commitmentNamed reporting cadence and model-change notice period already in the contract
TerminationAgreeing exit and data returnWaiting on terms nobody wroteExit clause with format, timeline, and cost drafted up front

Read the wait-state column and the pattern is plain. Four of the five stages are waiting on a document that could have been produced earlier at no cost. The prescription follows directly.

  • Send the complete document packet unrequested at first contact, indexed, with a cover page mapping each artifact to the question it answers.
  • Pre-redline the AI addendum, conceding up front on the clauses that cost you nothing.
  • Name one vendor-side owner for the questionnaire so the answers share a vocabulary. Three authors produce three vocabularies and one follow-up round per author.
  • Give the reviewer a one-page data-flow diagram rather than a narrative. Diagrams set the criticality tier; narratives generate questions.
  • Offer the regulatory-cooperation commitment and a named response contact before anyone asks for it.
  • Never ask a reviewer to accept an assertion that a document could settle. Every unpapered assertion becomes a round trip, and every round trip queues behind an entire portfolio carried by one or two people.

What the carrier waits on while the review runs is the real cost of every avoidable round trip. Manual investigation takes 14+ days per case and one investigator carries 200+ cases. Across US P&C carriers, manual teams fully investigate roughly 25% of flagged claims, and the rest are paid, denied without full work, or queued indefinitely. A manually investigated case is expensive, automated investigation costs a small share of that, and coverage moves from 25% to 100%. Automated investigation returns a reviewable, audit-ready record in minutes, not weeks. Against a fraud loss the Coalition Against Insurance Fraud puts at $308 billion a year in the United States, with fraud present in roughly 10% of property-casualty losses, a review that runs one quarter longer than it needed to is a quarter of that gap left open.

The compression argument is not that the carrier should scrutinize less. It is that scrutiny and calendar are separable. A reviewer who receives a complete, indexed packet on day one spends their time analyzing rather than chasing, which is the 20% problem in the survey data rather than the 45% one. That is a better use of the one or two people carrying the program, and it leaves a better-documented file at the end.

What the EU AI Act does and does not do to a US carrier's file

Less than most vendor decks claim. Annex III point 5(c) of the EU AI Act classifies AI used for risk assessment and pricing in relation to natural persons as high-risk in the case of life and health insurance. It does not name property and casualty claims handling. Point 5(b) expressly carves fraud detection out of the creditworthiness category.

The exact language matters here, because this is a section where a vendor either earns credibility or loses it. Annex III point 5(b) classifies AI systems "intended to be used to evaluate the creditworthiness of natural persons or establish their credit score" as high-risk, "with the exception of AI systems used for the purpose of detecting financial fraud." Point 5(c) covers "AI systems intended to be used for risk assessment and pricing in relation to natural persons in the case of life and health insurance." A US property and casualty carrier running claims investigation AI with no EU exposure sits outside the Act entirely.

The dates a reviewer will have in front of them: the Act entered into force on 1 August 2024; prohibitions and AI literacy obligations applied from 2 February 2025; general-purpose AI model rules, governance provisions, notified bodies, and penalties applied from 2 August 2025, with GPAI models already on the market before that date given until 2 August 2027; Annex III high-risk obligations become applicable on 2 August 2026; and Article 6(1) product-embedded high-risk obligations follow on 2 August 2027.

The honest framing for a vendor is that a carrier with EU operations should still expect the AI Act question in a third-party review this year, and a vendor that has already mapped its system against Annex III answers it in one sentence instead of opening a research project. Overstating the Act is how a vendor loses a reviewer who has read it. ISO/IEC 42001:2023 usually sits on the same page of the questionnaire, and it specifies requirements for establishing, implementing, maintaining, and continually improving an AI management system for organizations that provide or use AI-based products and services. Between the two, the AI-governance block of the packet is answerable today.

When an existing vendor adds AI mid-contract: re-opening a closed file

The hardest version of the AI vendor problem is not the new vendor in diligence. It is the papered one. A claims platform the carrier approved three years ago ships a generative summarization feature in a quarterly release, the feature starts reading claim files the next morning, and no review fires because the vendor already cleared one. Law firms advising on vendor AI programs now flag this scenario by name - Debevoise points out that vendor AI often ships inside software the carrier already has under contract, on release schedules that ignore contract cycles - and most third-party risk files still have no trigger that catches it.

The carrier-side exposure is specific. The NAIC Model Bulletin's diligence obligation attaches to AI systems in use, not to AI systems that existed at signature, and a Colorado-style inventory requirement expects material changes documented when they happen. An incumbent's unreviewed AI feature is therefore a system in production with no pre-use diligence evidence behind it, which is exactly the file an examiner samples. Three contract triggers close the gap, and all three belong in renewals as much as in new deals.

  1. Define material change to include AI. The model change notification clause drafted above does this by covering the addition of any new AI feature that processes carrier data, not only changes to models already disclosed.
  2. Extend subprocessor notification to model providers. A vendor that adds a foundation-model dependency has changed its subprocessor list, and the notice period should fire before the feature reaches production, not after.
  3. Require an annual AI feature attestation: one signed page per year stating what AI the vendor runs against carrier data, reconciled against its release notes. The reconciliation is the control. 55% of organizations updated their vendor due diligence requirements within the past year in the Venminder data, and this is the update that catches embedded AI.

When a trigger fires, the re-review is scoped, not a restart. The security block of the original file usually stands. What re-opens is the AI-governance block - model documentation for the new feature, the training-data position, the human-review boundary - plus the data-flow diagram if the feature changed where data goes. For a carrier running the sixteen-artifact checklist above, that is a four-artifact refresh, which is the difference between a trigger clause that gets exercised and one that gets waived.

Key takeaways

  • The seat that sets the deployment date for AI claims automation is the third-party risk reviewer, and that seat reports to procurement at only 6% of organizations while reporting to risk management or a risk committee at 37%.
  • Third-party involvement in breaches reached 48% in the Verizon 2026 DBIR, up from 30% a year earlier and 15% two editions ago, which is why every vendor review got heavier regardless of what the vendor sells.
  • The NAIC Model Bulletin, adopted in 25 jurisdictions with four more running their own AI rules as of April 2026, requires the carrier to hold pre-use diligence evidence, audit rights, and a vendor commitment to cooperate with regulatory inquiries.
  • Carriers are writing AI clauses into contracts roughly three times faster than they are collecting the AI documentation those clauses point at, so the vendor that arrives with model documentation already written clears the AI-governance block while others open a drafting project.
  • A scoring vendor's explainability evidence has to be authored separately from the product and maintained on every model change, while an investigation vendor's audit trail is the deliverable itself, which is why the two clear a review on different timelines under identical scrutiny.

Frequently asked questions

Request sixteen artifacts across four blocks. Security: SOC 2 Type II report, penetration test executive summary, ISO/IEC 27001 or equivalent ISMS evidence, a BCP and DR plan with stated RTO and RPO, and a cyber insurance certificate. Privacy and data: a data processing agreement, a current subprocessor list with change notification, and a data retention and deletion policy with an actual schedule. AI governance: an ISO/IEC 42001 certificate or a written description of the AI management system, model documentation or a model card, a training-data-use statement, a human-in-the-loop attestation, and model change notification terms. Contract terms: audit rights, regulatory cooperation, and exit and data-return terms. The 2025 Venminder and Ncontracts third-party risk survey found that getting timely, accurate documentation from vendors is the number one daily challenge for these teams, named in the top three by 45% of respondents. Ask for all of it at once rather than in waves.

A current SOC 2 attestation is effectively mandatory for a carrier deal. ISO/IEC 42001 is not yet, but it is becoming the shorthand answer to the AI-governance half of the review. SOC 2 reports against the AICPA trust services criteria of security, availability, processing integrity, confidentiality, and privacy, and a Type II covers whether controls operated effectively over an observation period rather than how they were designed at a single point in time. ISO/IEC 42001:2023 is the first AI management system standard and specifies requirements for establishing and maintaining an AI management system. They answer different questions. SOC 2 says the vendor protects your data. ISO 42001 says the vendor governs its models. A carrier asking about model drift, change control, and human oversight is asking the second question, and a SOC 2 report will not close it.

Section 4.0 of the NAIC Model Bulletin on the Use of Artificial Intelligence Systems by Insurers sets three obligations. Section 4.1 requires due diligence on the third party and its AI systems sufficient to ensure that decisions made or supported by that system meet the legal standards imposed on the insurer itself. Section 4.2 asks insurers to include contract terms that provide audit rights or entitle them to receive audit reports by qualified auditing entities, and that require the vendor to cooperate with regulatory inquiries and investigations. Section 4.3 requires actually exercising those rights rather than merely holding them. The bulletin names claim administration and payment and fraud detection as in-scope uses, and applies whether the system was built by the insurer or by a third-party vendor. As of the NAIC implementation map dated April 1, 2026, 25 jurisdictions had adopted the bulletin.

Eight. First, training-data use, including an explicit commitment not to train on carrier data. Second, model change notification with a defined notice period. Third, a human-in-the-loop attestation describing what the system decides and what a person decides. Fourth, a subprocessor list with change notification rights. Fifth, data retention and deletion with a stated schedule per data class. Sixth, exit and data-return terms specifying format, timeline, and cost. Seventh, audit rights mapped to NAIC Model Bulletin 4.2(a) and New York DFS Circular Letter No. 7 (2024). Eighth, a regulatory-cooperation obligation mapped to NAIC 4.2(b), which Colorado Amended Regulation 10-1-1 Section 5.B extends by allowing the vendor to provide documents directly to the Division on the insurer's behalf. The 2025 Venminder and Ncontracts survey found organizations adding AI usage language to vendor contracts jumped from 11% to 40% in a single year, so expect these pre-drafted on the carrier side.

Long enough that it usually sets the deployment date, and the variable that moves it is round trips rather than scrutiny. Third-party risk teams are thin. The 2025 Venminder and Ncontracts survey found 48% of programs run on one or two dedicated full-time employees while 18% manage more than a thousand vendors. Every incomplete answer you send re-enters that person's queue behind their whole portfolio. The compression levers sit on the vendor side: send the complete document packet unrequested at first contact, pre-redline the AI addendum instead of waiting for the carrier's, assign one owner for the questionnaire so answers share a vocabulary, and give the reviewer a one-page data-flow diagram rather than a narrative. Reviews that stall are almost always waiting on a document, not on a decision.

Usually not procurement. The 2025 Venminder and Ncontracts third-party risk survey found the function reports to risk management or a risk committee at 37% of organizations, to information security at 11%, to compliance at 10%, to IT at 8%, and to procurement at only 6%. That matters for anyone selling into a carrier, because sending the security packet to the sourcing contact often means it sits until someone forwards it to the actual reviewer. It matters for the carrier too. The seat that runs this review typically cannot approve the purchase but can hold it indefinitely, and 70% of respondents reported feeling pressure to improve their program, with 34% of that pressure coming from auditors, regulators, and examiners and 30% from management or the board.

Generally not under the insurance entry, and the fraud carve-out is explicit. Annex III point 5(c) classifies AI used for risk assessment and pricing in relation to natural persons as high-risk in the case of life and health insurance. It does not name property and casualty claims handling. Annex III point 5(b) classifies creditworthiness evaluation as high-risk with the exception of AI systems used for the purpose of detecting financial fraud. Annex III high-risk obligations become applicable on 2 August 2026, and general-purpose AI model rules applied from 2 August 2025. A US carrier with no EU exposure is outside scope entirely. A carrier with EU operations should still expect the question in a vendor review, and a vendor that has already mapped its system against Annex III answers it immediately rather than opening a research project.

The artifact the product emits shapes the review. A detection or scoring vendor outputs a number, so the carrier reviews it as a model and inherits an ongoing model-governance obligation. Colorado's Amended Regulation 10-1-1 spells out what that looks like: a documented inventory with version control, a description of each model's purpose and outputs, an explanation of material changes, and ongoing drift monitoring. An investigation vendor outputs a documented record of how a conclusion was reached, which means the explainability evidence the reviewer is asking for is the deliverable rather than a separate document someone has to author and maintain. Both still trigger re-review on material model changes. The practical difference is that one packet has to be assembled and the other already exists.

Map each claim to an artifact and a test. An accuracy claim is verified by the benchmark methodology plus a re-run on a holdout of your own closed claims with sealed outcomes. A SOC 2 claim is verified by reading the report's scope page rather than the badge. A human-in-the-loop claim is verified by tracing one claim end to end and recording who decided. The structured version is a bounded proof of concept: 50 to 200 closed claims, acceptance thresholds set in writing before the run, a few salted files with known alterations, and scoring done with the vendor out of the room. Paper the result, because that memo is the pre-use diligence evidence the NAIC Model Bulletin Section 4.1 expects the carrier to hold.

Two policies answering different failures: cyber insurance for the vendor losing your data, and technology errors and omissions for the vendor's product being wrong, with limits matched to the indemnity cap in the contract rather than to a generic threshold. Verification is the step most reviews skip. Request the certificate of insurance from the vendor's broker with the carrier named as certificate holder, check the policy period against the contract term, and ask in writing whether any exclusion or endorsement limits coverage for claims arising from AI model output, because AI-specific exclusions are beginning to appear in vendor E&O policies. Enterprise buyers have also started writing AI-specific coverage requirements into MSAs, with per-claim limits often above $10 million.

Treat the feature as a new system riding an old contract. The NAIC Model Bulletin's diligence obligation attaches to AI in use, so an unreviewed feature shipped mid-contract is a production system with no pre-use diligence evidence behind it. Three contract triggers catch the event: a material-change definition that includes adding any AI feature that processes carrier data, subprocessor notification that covers new foundation-model providers, and an annual signed attestation of AI features reconciled against release notes. When a trigger fires, scope the re-review instead of restarting it. The security block of the original file usually stands, and what re-opens is the AI-governance block plus the data-flow diagram if data movement changed.

On the Hesper platform

Hesper AI runs every stage of a claim, from first notice of loss to subrogation recovery, with investigation-grade evidence behind every decision.

The platformFNOL intakeClaims triageFraud investigationSubrogation & recovery

Keep reading

← More articles on the Hesper AI blog

See Hesper AI on your documents

Request a demo and we'll run an analysis on your real document samples.