management
Written by

Ben Glass
Product Marketing Manager
Sharing links



Last updated •
Summarize with AI
TL;DR: Manual file reviews consume significant compliance resource at growing firms, and traditional random sampling leaves material gaps in files that never get reviewed. Under Consumer Duty, that exposure is no longer acceptable. A risk-based model combining automated pre-screening across 100% of files with targeted human review on high-risk cases scales more effectively and costs less per file. Colin's automated compliance checks scan any suitability report before it reaches your compliance desk, catching objective gaps early, standardising quality across advisers, and freeing compliance officers for the judgement calls that genuinely require them.
Traditional random sampling approaches risk missing issues that cluster in specific adviser behaviours, product areas, or client segments, leaving material gaps undetected in files the sample never touched. As client numbers grow at multi-practice and consolidator firms, the compliance function becomes the last sequential bottleneck in the advice chain. Completed files queue for a manual review while advisers move on to three more meetings.
Paraplanners wait while client follow-up stalls. And the compliance team fields queries from advisers who cannot understand why their files are sitting in a backlog. Scaling a UK financial advice firm safely requires shifting from slow, manual file reviews to a risk-based, automated screening process that catches documentation gaps before they reach the compliance desk. This playbook shows you how to build that system.
Why Manual Compliance Checks Break at Scale
Manual file reviews carry a measurable internal cost per file, calculated against compliance officer time, based on salaries of £65,000 to £88,000 for London-based officers with 6-9 years' experience, according to FD Capital's 2026 Salary Guide. Each review consumes compliance officer time that could be allocated to higher-value judgement work, before accounting for overhead or the secondary cost of rework queries when a file is returned to the adviser. As file volumes grow, firms face resourcing decisions: hiring, outsourcing at significant cost per file, or creating a documentation queue that slows the entire firm.
The AdvisoryAI whitepaper: From Paperwork to Peoplework sets out the underlying capacity problem: 43.3% of advisers report that paperwork reduces time available for actual advice delivery, and 71.9% of firms spend between 1 and 7 hours producing a single suitability report. Every hour spent on documentation before the file reaches the compliance desk multiplies total processing time per client. Manual file reviews compound that cost through rework cycles, clarification requests, and the back-and-forth that happens when reviewers identify gaps days after the adviser moved on.
Jigsaw Tree Research, cited in the AdvisoryAI whitepaper, found that AI-enabled workflows cut suitability letter time by 65.48% and annual review time by 59.8%. Documentation time saved upstream directly reduces the rework cycles your compliance team manages downstream.
Standardising Reviewer Decision-Making
A less visible problem in manual compliance review is the subjectivity gap between reviewers. Two compliance officers applying the same firm standards to the same advice file will often reach different verdicts on borderline documentation. For example, one flags a risk discussion as insufficiently detailed. Another passes it. The adviser receives inconsistent feedback across a quarter, cannot identify what the firm's actual standard is, and stops treating compliance feedback as authoritative.
This is a structural problem, not a personnel one. Firms without objective, documented pass/fail criteria will always generate reviewer variance. Under Consumer Duty, that variance matters because the FCA expects firms to evidence consistent client outcomes across their entire book, not outcomes that vary based on which compliance officer happened to review a file that week.
Compliance Risks in Random Sampling
The traditional model of sampling around 15% of files was built for a lower-stakes regulatory environment. Consumer Duty changed that calculation. When a firm reviews only a small percentage of interactions, it becomes difficult to demonstrate that good outcomes occur consistently across all four Consumer Duty outcome areas for the entire client book.
Undetected documentation gaps in unreviewed files create direct exposure during Financial Ombudsman Service inquiries, because regulators now assess complaints against Consumer Duty standards. A file that was never reviewed is a file you cannot defend.
Risk-Based File Review vs Full Audit Models
You cannot sustain a blanket "review everything manually" approach as your firm grows. The compliance function cannot scale linearly with adviser growth without creating cost and headcount problems that erode firm economics. Unguided random sampling is too risky under Consumer Duty. The answer is a risk-based model that routes files objectively based on their risk profile.
Criteria for Risk-Based Sampling
Files that meet objective low-risk criteria can move through an automated compliance screen rather than a full human audit, including standard transactions for experienced clients with documented risk profiles, review meetings with no material change to circumstances, and cases handled by advisers with clean compliance records. Automated screening verifies that required documentation elements are present before a human reviewer engages.
Criteria for Mandatory Full File Reviews
Specific case types must always trigger a 100% manual review regardless of adviser track record or case volume:
Defined benefit pension transfers, which typically require specialist oversight and detailed documentation
Vulnerable client cases, where regulators expect evidence of adapted service delivery
Recommendations involving a move from an existing arrangement
Advisers under active supervision, where heightened oversight is typically required
How to Prioritise High-Risk Files
Assign files at the point of submission using objective risk criteria so the right files move to the right review process from the start:
Transaction type | Risk level | Review action |
|---|---|---|
Standard ISA top-up, experienced client, no change to circumstances | Low | Automated screen only |
Annual review, minor portfolio rebalance, documented ATR confirmed | Low | Automated screen only |
New product recommendation, straightforward fact-find | Medium | Automated screen, then sampled human audit |
High-value investment, first-time recommendation, complex circumstances | High | Automated screen, then mandatory human audit |
Pension transfer (non-DB), multiple product recommendations | High | Automated screen, then mandatory human audit |
Defined benefit pension transfer | High | Mandatory 100% human audit, PTS sign-off typically required |
Vulnerable client, any product | High | Mandatory 100% human audit |
Adviser under active supervision, any case | High | Mandatory 100% human audit |
How to Remove Bias from Your Internal Audit Process
Even a well-designed risk-based sampling model fails if the human review stage introduces the same subjectivity problem it was designed to eliminate. Changing what reviewers are asked to do is where the real improvement comes from.
Instead of asking a compliance officer to assess an advice file cold, run the file through automated pre-screening first. By the time a human reviewer sees the document, it has already passed objective compliance checks. The reviewer's job shifts from identifying objective gaps to evaluating the professional judgement underpinning the recommendation, which is the work that genuinely requires expertise.
Reducing Review Bias with Checklists
Structured pass/fail checklists reduce the surface area for subjective grading. When a reviewer confirms whether specific criteria are present or absent, rather than assessing whether a discussion was "adequate," the scope for personal interpretation narrows. Building a firm-wide checklist that maps directly to Consumer Duty outcomes, COBS 9.4.7R, and your own documentation standards gives reviewers a shared reference point rather than relying on individual professional judgement for every decision.
Reducing Rating Bias with Calibration
Regular calibration sessions, where two or more compliance officers independently review the same advice file and then compare their verdicts, reveal where reviewer standards diverge. Running a calibration session monthly using one file from the low-risk pool and one from the high-risk pool surfaces inconsistencies before they become embedded practice. Calibration also gives compliance managers the data to identify which criteria generate the most reviewer disagreement, so those criteria can be clarified in the firm's documentation standards.
Defining Clear Pass/Fail Criteria
Binary criteria eliminate ambiguity. Replace subjective descriptions with objective questions:
Instead of: "Is the risk discussion adequate?" Use: "Is the client's attitude to risk confirmed in writing, with the specific ATR category documented?"
Instead of: "Is suitability evidenced?" Use: "Does the report include a written explanation of why this recommendation is suitable for this client's specific financial position and objectives?"
Instead of: "Is capacity for loss addressed?" Use: "Does the report document whether the client can sustain the recommended investment risk without material impact on their lifestyle or financial position?"
Binary criteria are what make automated compliance checks viable. Colin applies this principle: every check returns a pass or fail against a specific documented criterion, not a qualitative assessment.
Maintaining Compliance Standards with Automation
Automated compliance screening handles the objective, repeatable layer of file review. Human compliance officers handle the professional judgement layer. The two are sequential stages in a stronger process than either produces alone.
Some compliance teams resist automated pre-screening because they worry that AI will miss nuances that experienced reviewers catch. That concern is legitimate, which is why AdvisoryAI outputs are grounded via retrieval-augmented generation and guard-railed prompts rather than open-ended generation, and why automated pre-screening sits before human review rather than replacing it. Think of it the same way you think about a spell-checker: it catches objective errors before a document goes to the editor, but it cannot tell you whether the argument is sound.
Automating Initial Advice File Screening
An automated compliance capability scans a suitability report or fact-find immediately after drafting, before it enters the compliance queue. Colin, AdvisoryAI's compliance checking capability within Atlas, runs automated checks on suitability reports and fact-finds, covering Consumer Duty outcomes and COBS standards including documentation completeness, client profiling, risk assessment, and recommendation suitability.
Critically, Colin is system-agnostic. It checks any suitability report regardless of where it was created, so your compliance team runs the same 42 objective checks on files produced in any existing workflow without requiring advisers to change their documentation tools.
Colin produces a percentage compliance score with colour-coded pass/fail verdicts per category, so the adviser can see exactly where the document stands before it leaves their desk.
Flagging Common Compliance Issues Automatically
The checks Colin runs catch common documentation gaps that manual reviewers spend time flagging. Each failed check returns specific remediation guidance rather than a generic failure notice.
This specificity shifts the correction burden back to the adviser immediately rather than creating a review queue where the compliance officer has to write their own remediation notes. First-time pass rates improve because advisers fix objective errors before submission rather than after.
Ensuring Compliance Through Human Input
Automated screening does not assess whether a recommendation is professionally sound. It verifies that the documentation required to support that recommendation is present and complete. A compliance officer reviewing a file after Colin has pre-screened it can focus entirely on whether the advice reflects the client's real circumstances, including complex family dynamics, behavioural risk tolerance beyond the ATR questionnaire score, and the long-term sustainability of a drawdown strategy. Automated capabilities free your compliance officers to do more of that professional judgement work by removing the objective checklist layer that precedes it.
Building a Repeatable Compliance File Checking System
The steps below translate the risk-based model into daily practice. Each step can be implemented incrementally, starting with defining your compliance file criteria and adding automation once baseline standards are documented.
File-Checking Process Checklist
Use this checklist to audit your current compliance file review process and identify where automation or workflow changes will deliver the fastest improvement:
Pre-implementation audit
Document your current average file review time (manual baseline in minutes per file)
Calculate internal cost-per-file reviewed (compliance officer hourly rate multiplied by review time)
Identify your mandatory full-audit triggers (DB transfers, vulnerable clients, supervised advisers)
Define your low-risk file criteria (standard top-ups, annual reviews with no material change)
List your current pass/fail criteria for suitability reports (ATR documented, capacity for loss assessed, AML complete)
Draft workflow setup
Configure automated pre-screening to run objective checks before human review
Train advisers to remediate flagged issues before compliance submission
Establish first-time pass rate baseline (percentage of files passing pre-screen without remediation)
Set reviewer calibration schedule (monthly, same file reviewed by two officers independently)
Risk-based routing implementation
Assign risk level to each transaction type using the routing matrix above
Route high-risk files to mandatory 100% human audit queue
Route low-risk files to automated screen plus sampled audit queue
Track reviewer variance (percentage disagreement on same-file calibration tests)
KPI tracking
Measure average review turnaround time (days from submission to sign-off)
Track first-time pass rate month-on-month
Calculate revised cost-per-file after automation (compare to manual baseline)
Monitor adviser rework rate (percentage of files returned for corrections after compliance review)
1. Standardise Your Compliance File Criteria
Define what constitutes a complete, compliant advice file before you assess whether your current files meet that standard. A complete file for a suitability recommendation typically includes:
A completed and signed fact-find with ATR documented in writing
Meeting notes covering the client's objectives, circumstances, and the adviser's recommendation rationale
AML documentation confirming identity verification
The suitability report itself, including an executive summary, recommendation justification, and capacity for loss assessment
Any research documents, provider summaries, or LOA pack outputs that support the recommendation
The AdvisoryAI AI Framework for Advice Firms provides guidance that firms can use as a starting point for their own documentation standards.
2. Improve File-Checking Coverage
Combine automated screening of 100% of files with risk-targeted deep human audits using the routing matrix above. Every file gets an objective compliance check, and human reviewers concentrate their time on cases where professional judgement genuinely adds value.
The FCA's Financial Lives 2024 survey found that just 9% of UK adults received advice on their pensions or investments in the 12 months to May 2024, while 62% of investors said they would welcome more help managing their investments and 68% when reviewing them. Firms that process compliant files faster are better positioned to serve that unmet demand without proportionally increasing compliance cost.
3. Standardise Your File Review Process
A two-stage workflow, draft then final, separates the objective pre-screening phase from the professional judgement phase. In the draft stage, the adviser uses meeting recordings, fact-finds, research documents, LOA pack summaries, ceding information, cashflow modelling outputs, and risk profile assessments to produce an initial suitability report, either manually or using Emma, AdvisoryAI's report generation capability within Atlas, which generates the report from the firm's own templates.
The draft then runs through Colin's 42 automated compliance checks, and the adviser corrects all flagged issues before resubmitting. In the final stage, the compliance officer reviews the pre-screened file and focuses attention on professional judgement rather than objective gap-filling. The guide on how AdvisoryAI workflows save time covers how this pre-remediation step reduces rework rates across the firm. Compliance approval can be enforced as a mandatory gate before a document is finalised, and templates and standard wording can be centrally locked so advisers can't drift from the firm's approved format.
4. Resolve Documentation Delays with AI
The sequential bottleneck begins before the file reaches the compliance desk. Evie, AdvisoryAI's meeting notes capability within Atlas, generates structured meeting notes, action items, and a draft follow-up email directly from the meeting recording via Microsoft Teams, Zoom, or Google Meet, and pushes structured outputs directly into back-office systems (Intelliflo, Plannr, Curo, and Xplan) within minutes, populating specific fields in the fact-find section including personal information, investment details, and employment details, so paraplanners and compliance teams work from complete data rather than waiting days for adviser submissions. The Intelliflo integration automates fact-find field updates directly from meeting output.
5. KPIs for File-Checking Consistency
Track these metrics to measure whether your file-checking process is working and improving. Targets will vary by firm size and current baseline, but the directional improvements below indicate a healthy process:
Metric | What to measure | Direction of travel |
|---|---|---|
Average review turnaround time | Days from file submission to compliance sign-off | Target reduction month-on-month |
First-time pass rate | % of files passing pre-screen without remediation | Target improvement month-on-month |
Reviewer calibration variance | Disagreement rate between two reviewers on same file | Target narrowing over time |
Cost per file reviewed | Total compliance resource cost divided by files reviewed | Track against baseline |
Adviser rework rate | % of files returned to adviser after compliance review | Target reduction month-on-month |
The cost-per-file metric is the most direct business case for leadership. Comparing the internal cost of manual reviews against automated pre-screening demonstrates ROI even before accounting for reduced rework cycles.
Using AI to Improve Compliant File Checks
Automated Checks for Consumer Duty
Colin's 42 checks cover five documented check categories: AML documentation, client profiling completeness, risk assessment adequacy, recommendation suitability, and report quality. These checks map directly to Consumer Duty outcome areas, verifying that documentation meets the FCA's expectations for consistent client outcomes across Products and Services, Price and Value, Consumer Understanding, and Consumer Support. Further guidance on Consumer Duty compliance is available in the AdvisoryAI AI Framework for Advice Firms.
Ensuring Consistent Documentation Standards
Adviser-to-adviser variance in suitability report quality is one of the most common compliance risks in multi-practice firms. When each adviser develops their own documentation style, the compliance team reviews structurally different documents against a single standard, which generates inconsistency by design.
Emma, AdvisoryAI's report generation capability within Atlas, generates suitability reports, annual review reports, LOA pack summaries, and provider summaries using the firm's own templates, not a vendor-imposed format. AdvisoryAI configures Emma to the firm's exact document structure and formatting, with advice tonality and style customised per firm. Finsource Partners reduced LOA pack review time by 80% using Emma. TFP Financial Planning Ltd scaled from one to six suitability reports per day per paraplanner with a 10% editing rate on generated reports.
Atlas, the AI chat and intelligence layer containing Evie, Emma, and Colin as capabilities, also lets advisers query meeting transcripts, suitability reports, and client data in plain English and receive cited answers across the firm's documentation.
Emma builds from your existing, compliance-approved formats, so your established document standards remain intact. Colin extends coverage with system-agnostic compliance checks running objective tests on any suitability report regardless of where it was created, before the file reaches your compliance desk. Colin checks documents at the point of creation, before the file reaches your compliance desk, so gaps are remediated by the adviser rather than discovered at audit. AdvisoryAI publishes pricing transparently, with monthly rolling agreements, a 30-day money-back guarantee, and annual plans with a 10% discount.
Source Traceability and the FCA Defensibility Standard
The concern that AI tools create black-box decisions that compliance officers cannot audit is well-founded under Consumer Duty, where the FCA expects firms to demonstrate how they reached conclusions about client outcomes. A defensible advice file lets a reviewer trace every statement back to its source, and AI assistance needs to support that traceability, not obscure it.
Adaptive Thinking: Making AI Reasoning Auditable
Atlas's Adaptive Thinking feature, released May 2026, addresses this directly. Each reasoning step is visible and expandable as Atlas processes a query, and the full reasoning trail persists across sessions, so a compliance officer can trace exactly how Atlas reached any answer rather than accepting output on trust. Older queries remain auditable, which means the record an FCA file review actually needs: a traceable link between every statement and its source, built into how Atlas works, not added after the fact. Every generated document also carries version history, so a compliance officer can see who changed what and when.
AdvisoryAI's roadmap for Atlas also includes fund and product research capabilities and DFM and model-portfolio comparison. Firms interested in these features should confirm current availability directly with AdvisoryAI.
Extending Coverage with Colin and Atlas
Colin integrates with your existing compliance workflow and checks any suitability report, not just those created within AdvisoryAI. Alan Gurung, AdvisoryAI's CEO, has spoken with Nick Eatock on Intelliflo's channel, covering what the relationship between AI assistance and professional judgement looks like in practice. The full platform including Evie for meeting notes and Emma for suitability reports can reduce documentation time by up to 80%, with a 50% time-saving guarantee, money back if not achieved.
Start a 14-day free trial of AdvisoryAI to automate your compliance file checks. No credit card required. Or request a demo to see how Colin and Atlas integrate with your back office (Intelliflo, Plannr, Curo, and Xplan) and simplify your firm's file-checking process.
FAQs
How Do You Standardise Advice File Reviews Across Multiple Reviewers?
Replace subjective grading with binary pass/fail checklists tied to specific Consumer Duty outcomes and COBS requirements, and run monthly calibration sessions where two reviewers independently assess the same file. Automated pre-screening with Colin standardises the objective layer of every review, so checks apply consistently regardless of which compliance officer handles final sign-off.
How Can We Reduce Compliance File Checking Time Without Increasing Regulatory Risk?
A risk-based sampling model lets you focus human compliance resource on high-risk files (defined benefit transfers, vulnerable clients, supervised advisers) while automated screening covers 100% of files objectively. This hybrid approach reduces the manual review burden at the compliance desk while maintaining full file coverage, which traditional sampling approaches cannot achieve.
What Is a Two-Stage Compliance File Review Workflow?
A two-stage compliance file review workflow separates the pre-screening phase from the professional judgement phase. Advisers run initial report drafts through automated compliance screening to catch objective errors early, remediate all flagged issues, and then submit pre-screened files to the compliance officer for professional judgement sign-off. Objective gaps are corrected before any human reviewer engages, which reduces rework cycles and improves first-time pass rates.
Does Automated Compliance Checking Work on Files Created Outside AdvisoryAI?
Yes. Colin is system-agnostic and checks any suitability report against FCA Consumer Duty and COBS requirements regardless of where the document was originally created, so your existing compliance workflow does not need to change for Colin to add pre-screening value across your current file volume.
How Does Atlas's Adaptive Thinking Support Compliance Defensibility?
Adaptive Thinking, released May 2026, shows each step Atlas takes in real time and stores the full reasoning trail in a collapsible block attached to every response. Compliance officers can read exactly how Atlas reached an answer, and the reasoning persists across sessions so older queries remain auditable, giving firms a verifiable record of AI-assisted file queries rather than just a prompt-and-output log.
Key Terms Glossary
Suitability report: A mandatory UK regulatory document that sets out an adviser's specific investment recommendation and explains why it is suitable for the client's individual circumstances, financial position, and objectives.
Consumer Duty: An FCA regulatory standard introduced in July 2023 requiring UK financial firms to deliver consistently good outcomes for retail customers across four outcome areas: Products and Services, Price and Value, Consumer Understanding, and Consumer Support.
Risk-based sampling: A compliance methodology where the depth and frequency of file reviews vary based on transaction risk profile, client characteristics, and adviser supervision status, rather than applying uniform random selection or blanket coverage to all files.
Colin: AdvisoryAI's system-agnostic compliance checking module that runs 42 automated checks on any suitability report or fact-find against Consumer Duty and COBS standards, returning colour-coded pass/fail verdicts and specific remediation guidance before the file reaches the compliance desk.
Adaptive Thinking: A feature within Atlas, released May 2026, that displays step-by-step reasoning behind every AI-generated response in a collapsible, session-persistent thinking block so compliance officers can verify how Atlas reached an answer and maintain an auditable record of AI-assisted file queries.
ATR: Attitude to risk. The documented assessment of a client's risk tolerance used to inform investment recommendations, typically recorded in the suitability report.

Subscribe to our newsletter
Get an AI summary of AdvisoryAI
For questions or partnerships,
contact us at team@advisoryai.com
For product support, help, contact us at support@advisoryai.com
Solutions
Compare












