management
Written by

Alan Gurung
Co-Founder & CEO
Sharing links



Last updated •
Summarize with AI
TL;DR: Manual spot-checks, commonly covering around 15% of files, can create compliance blind spots in UK advice firms. To evidence the four Consumer Duty outcomes effectively, operations leaders must shift to active, desk-side file auditing. The AdvisoryAI platform includes Colin, a compliance checking capability that automates comprehensive checks on 100% of files before they leave the adviser's desk, and Atlas, the intelligence layer where operations leaders can query book-wide data in plain English. This approach eliminates documentation bottlenecks, gives the board defensible book-wide evidence across all four Consumer Duty outcomes, and frees adviser capacity for client-facing work.
When the board asks for evidence of positive consumer outcomes, most operations directors rely on manual spot-checks covering a fraction of their files. It's industry practice to review around 15% of interactions, which tells a firm something about those interactions and little about the rest. Regulatory expectations now centre on identifying foreseeable harm proactively and acting before it materialises, not documenting it retrospectively in an annual board report.
Evidencing the four Consumer Duty outcomes requires a continuous audit trail from the adviser's desk to the board pack. This guide outlines the exact management information (MI) operations leaders need to collect, how to structure a compliant MI dashboard, and how automated file checking closes the data gap without adding to the adviser admin burden.
What Consumer Duty Outcomes Monitoring Means for Operations Leaders
Consumer Duty outcomes monitoring requires you to own the data infrastructure behind the board's annual Consumer Duty report, ensuring the underlying file evidence is consistent, source-traceable, and audit-ready year-round. Strong firms use MI proactively to identify foreseeable harm before it materialises, while weak firms monitor history and call it compliance. The gap between these two approaches is increasingly a supervisory priority.
The Four Consumer Duty Outcomes
The Consumer Duty requires firms to monitor and evidence four distinct outcomes across the client lifecycle. Each outcome creates specific operational pressures for your advisers and paraplanners, and each demands a corresponding MI metric that you can track and escalate.
Consumer Duty Outcome | Adviser Pain Point (Suitability and Defensibility) | Paraplanner Pain Point (File Consistency) | Operational MI Metric Required |
|---|---|---|---|
Products and Services | Ensuring the client meets target market criteria during annual reviews. | Manually verifying that historical files match current product definitions. | Percentage of active clients with product holdings reviewed against target market criteria. |
Price and Value | Justifying ongoing service fees when client contact is infrequent. | Extracting and comparing fee structures across multiple legacy providers. | Ratio of ongoing fees to documented service touchpoints. |
Consumer Understanding | Evidencing that vulnerable clients understood complex pension transfer risks. | Standardising file notes to prove disclosure documents were read and understood. | Percentage of files with documented, active understanding checks. |
Consumer Support | Tracking client drop-offs during lengthy onboarding processes. | Manually processing LOA packs and chasing providers for missing data. | Average turnaround time for client queries and LOA processing. |
Each row represents a category where manual documentation creates both an adviser capacity drain and a compliance exposure. Colin's automated check framework maps to these four categories.
Why Board-Level MI Matters
Firms subject to Consumer Duty must produce an annual board report assessing the outcomes being delivered to retail customers and identifying any necessary remedial actions, as set out in PRIN 2A.8. The board approves that report, which means the directors signing off need data-driven proof, not qualitative assertions.
If your MI relies on subjective adviser commentary or a handful of manually reviewed files, your board is signing a report that cannot withstand FCA scrutiny and cannot survive due diligence if the firm enters a sale process. The Flower Group modelling in our whitepaper shows that operational efficiency which doubles adviser capacity can increase a two-adviser firm's valuation from £1.26m to £3.77m. Separately, consistent and auditable documentation reduces due-diligence risk, including the holdbacks and price reductions buyers introduce when file quality is inconsistent across the book.
Closing the Consumer Duty Data Gap
Good practice in Consumer Duty monitoring, as documented in the FCA's Outcomes monitoring: good practice and areas for improvement, includes firms that analysed rejected applications to assess target market alignment and triggered escalation when thresholds were breached. The FCA's Delivering good outcomes for customers in vulnerable circumstances guidance also documents good practice where firms monitored vulnerable clients using risk indicators. Firms that fell short relied on periodic manual sampling.
Assumptions about files you did not review are not evidence of outcomes across your whole book. Closing that gap means moving from retrospective sampling to continuous, automated file auditing at the point of document production, before files leave the adviser's desk.
Key Metrics for Proving Consumer Duty Success
Effective outcomes monitoring is built on measurable signals you can track across advisers and practices, not general impressions about advice quality. You need to define which metrics map to each outcome, who owns collection, and what threshold triggers escalation.
Monitoring Product and Service Value
For the Products and Services outcome, the central question is whether products remain suitable for the client's defined target market as their circumstances change. Your MI dashboard needs:
Percentage of active clients with product holdings reviewed against current target market criteria.
Volume of recommendations where a switch from an existing arrangement was made, with transfer justification documented separately from the product recommendation.
Count of files where both attitude to risk (ATR) and capacity for loss are assessed and recorded, not ATR in isolation.
Keeping client product holdings under active, documented review is the minimum standard, and your MI must prove it is happening consistently across every adviser in the firm.
Proving Value for Consumer Duty
The Price and Value outcome requires the most granular file evidence of all four outcomes because it demands a clear, documented link between what the client pays and what service they receive in return. The table below illustrates the difference between poor and robust documentation, and how automated checking captures the gap before it becomes an FCA finding.
Scenario | Poor Outcome Documentation (FCA Risk) | Good Outcome Documentation (FCA Compliant) | How Colin Automates the Check |
|---|---|---|---|
Ongoing service fee justification | "Client agreed to 1% ongoing fee as per standard terms." | "The 1% ongoing fee is justified by the annual cashflow model review and bi-annual portfolio rebalancing, which align with the client's retirement transition timeline." | Colin flags files where ongoing fees are charged but no corresponding service delivery is documented. |
Legacy product replacement | "Recommended transfer to CIP to reduce administrative hassle." | "The transfer from the legacy provider to the CIP reduces ongoing charges from 1.5% to 0.85% inclusive, saving the client £650 annually while granting access to daily rebalancing." | Colin checks whether transfer recommendations document cost comparisons between the existing and proposed arrangement. |
Vulnerable client fee structure | "Standard fee applied. Client appeared satisfied during the meeting." | "Client has mild cognitive impairment. Standard fee structure was reviewed and maintained, but support was adjusted to include a family member in all meetings at no extra cost." | Colin checks whether files with vulnerability indicators include corresponding documentation of fee structure review and support adjustments. |
The practical challenge is that adviser intent and regulatory requirement are not always aligned on paper. Colin's automated checks make the gap visible before the file is submitted.
Measuring Consumer Understanding Effectively
The Consumer Understanding outcome is where manual file checking is most unreliable. A signed declaration that a client received a key information document is not evidence they understood it. The FCA expects firms to document active checks: that the adviser confirmed comprehension, identified any barriers to understanding, and adjusted the communication approach accordingly.
MI metrics for consumer understanding include:
Percentage of files with a documented comprehension check, separate from the signature on disclosure documents.
Percentage of vulnerable client files where communication adjustments are recorded.
Proportion of pension transfer files that document the specific risks the client confirmed understanding of, beyond confirming risks were disclosed.
Jigsaw Tree Research found suitability letter production time fell 65.48%, from 4 hours 45 minutes to 1 hour 38 minutes, with automation. When advisers spend less time on production, they invest more time in the meeting itself, which is where comprehension checks happen and where Evie captures the structured evidence of those checks in the meeting record.
Key Metrics for Support Quality
The Consumer Support outcome covers the firm's responsiveness when clients need help and its readiness to identify and remediate foreseeable harms. The FCA's Delivering good outcomes for customers in vulnerable circumstances guidance identifies clear escalation processes to identify poor outcomes as a defining feature of strong outcomes monitoring.
Track these metrics to evidence Consumer Support:
Average turnaround time from client query receipt to resolution, broken down by query type.
Average LOA processing time per provider, with trend data to identify systemic delays.
Number of foreseeable harm scenarios documented in the firm's Consumer Duty framework, with evidence that each has a corresponding monitoring trigger.
Percentage of client files where a foreseeable harm flag has been recorded and an action taken.
Finsource Partners reduced LOA review time by 80%, which directly compresses the Consumer Support metric on LOA turnaround. Fewer days waiting on provider data means fewer days where clients are without a confirmed advice position.
Standardising Your File Evidence for FCA Audits
Consistent file evidence is the foundation of every credible Consumer Duty MI report. Without it, MI metrics are calculated on incomplete data, board reports rely on assumptions, and FCA file reviews expose exactly the gaps your MI claimed were closed.
What Regulators Seek in Advice Files
Firms must monitor regularly the outcomes retail customers receive from products, communications, and support. Record-keeping obligations sit in SYSC 3 and SYSC 9, as signposted by PRIN 2A.9, and the firms the FCA rates highest are the ones that can show a clear audit trail from management information through to the decisions and improved outcomes it drove, as reflected in the FCA's Outcomes monitoring: good practice and areas for improvement. The board must approve an annual report evidencing that monitoring process.
Colin's checks are built around the evidential elements FCA supervisors focus on in Consumer Duty file reviews, reflecting the general monitoring duty set out in PRIN 2A.9.8R. Those elements include:
A clear transfer justification where the client moves from an existing arrangement, with charges compared on a like-for-like basis.
A documented capacity for loss assessment, separate from the ATR assessment.
Behavioural bias identification for clients making significant investment decisions.
A vulnerability flag where any indicator exists, with evidence of support adjustments made.
An executive summary in the suitability report that a client could read and understand without an adviser present.
AML documentation completed and referenced at the appropriate point in the file.
We built Colin to check these elements automatically. Its automated checks cover AML verification records, client profiling completeness, risk assessment adequacy, recommendation suitability, and report quality.
Common Pitfalls in Client Evidence Files
The most common file deficiencies identified in FCA Consumer Duty supervision are not novel, but they are assessed under a higher standard of evidence:
Missing or incomplete AML documentation at the start of the client relationship.
ATR recorded without a separate capacity for loss assessment.
Vulnerability indicators noted informally in meeting notes but not carried forward into the suitability report or fact-find.
Transfer recommendations where the justification is qualitative ("better service") rather than quantified (charge comparison, projected value difference).
Follow-up actions recorded in meeting notes but not cross-referenced in the suitability report, leaving the compliance trail incomplete.
Colin checks against FCA Consumer Duty requirements, not a generic compliance framework. The output provides a compliance report with specific guidance for every flagged item.
How AI Cuts Time on Consumer Duty File Audits
You can move from manual spot-checks to automated, 100% file auditing without rebuilding your document processes. We designed Colin to work on suitability reports, fact-finds, and file notes, making the transition additive rather than disruptive.
Automating Compliance Checks for Files
Colin, AdvisoryAI's compliance checking capability, runs automated checks on suitability reports and multi-category checks on fact-finds before the finished report leaves the adviser's desk, as detailed on our compliance checker page. The check categories cover AML documentation completeness, client profiling, risk assessment adequacy, recommendation suitability, and report quality. See Colin's compliance checks in action to understand the interface.
The output with a compliance score gives you a firm-wide compliance metric you can track across advisers, practices, and reporting periods. This converts what has historically been a subjective compliance manager judgment into a quantified metric the board can review, and it identifies which advisers need targeted support before their documentation patterns become a firm-wide exposure.
Automating Regulatory Evidence Files
Emma, AdvisoryAI's report generation capability, produces suitability reports, annual review reports, LOA pack summaries, and provider summaries directly from your firm's existing templates, as explained on our suitability reports page. Emma-generated reports include source references, so the audit trail is built into the output rather than reconstructed after the fact.
For operations leaders concerned about template standardisation: Emma works from your own document structures, not a vendor-imposed format. When every report is generated from the same template with the same citation structure, the MI metric for documentation quality becomes measurable across 100% of output rather than inferred from a sample.
Live Monitoring of Regulatory Risks
Atlas is the AdvisoryAI platform's intelligence layer. Once Colin and Emma have generated and checked your documentation, Atlas lets compliance leads ask plain-English questions about the client book and receive cited answers drawn from meeting transcripts, suitability reports, and client data. Rather than waiting for a quarterly dip-sample to identify which advisers have documentation gaps, a compliance lead can query across the entire book at any point.
This shifts compliance monitoring from a periodic audit function to a continuous oversight capability. Our AI Framework for Advice Firms sets out the human-review checkpoints and Consumer Duty mapping that govern every output, which is the material you need when briefing the board on how the platform meets their oversight obligations.
Evidence Logs for FCA Reviews
Atlas was enhanced with Adaptive Thinking features in May 2026 to make reasoning steps visible and persistent. When Atlas answers a query about a client's file, a collapsible thinking block shows the step-by-step process. That reasoning persists with the conversation, so older queries remain auditable.
For FCA supervision purposes, answers Atlas provides include reasoning trails. You can review how Atlas reached a conclusion, and because the reasoning persists with the conversation, it remains available for later review. Atlas does not hide its work.
How to Structure Your Consumer Duty MI Dashboard
An MI dashboard that satisfies the board and the FCA tracks the right metrics for each outcome, uses firm-specific thresholds with documented rationale, and escalates the right breaches automatically.
Setting RAG Thresholds for MI
The FCA has repeatedly flagged unclear threshold rationale as a common gap, expecting firms to explain why a given threshold marks the boundary between good and poor outcomes, as documented in the FCA's Outcomes monitoring: good practice and areas for improvement. Set initial thresholds based on your firm's historical compliance data, define what materially adverse movement looks like for each metric (e.g., a 5% drop in the percentage of files with documented capacity for loss assessments), and document the rationale in your Consumer Duty monitoring policy. Review thresholds annually alongside the board report and adjust based on FCA feedback and operational performance.
Measuring Adviser Documentation Quality
Colin's percentage compliance scores provide the raw material for a documentation quality metric that is consistent, objective, and comparable across advisers and practices. For a firm running 20 advisers across multiple offices, track:
Average compliance score per adviser per quarter.
Number of failed checks per category (AML, vulnerability, capacity for loss) per adviser.
Trend in compliance scores following remediation guidance, to confirm that feedback loops are working.
Defining File Monitoring Schedules
Deploy Colin on all new suitability reports and annual review reports immediately, run it on the previous quarter's files to establish a baseline compliance score, then use Atlas to query book-wide compliance gaps. Produce monthly MI reports with per-adviser compliance scores and trend data. This approach delivers immediate value on new files while building a historical baseline for the board report.
Defining Board-Level Escalation Triggers
Not every compliance gap requires board escalation. Triggers that should reach the board include:
A compliance score for any individual adviser dropping below the firm's defined amber threshold in two consecutive reporting periods.
A material category-level failure (for example, vulnerability documentation) affecting a significant proportion of files in a quarter.
A foreseeable harm pattern identified in MI that has not been remediated within the firm's defined timeframe.
An FCA information request or supervisory contact on Consumer Duty matters.
Any file identified as potentially requiring redress or client remediation.
Strong firms have documented escalation processes where thresholds are breached. Weak firms have thresholds but no consistent mechanism to act on them.
Operationalising Consumer Duty Outcomes Tracking
Standardise Documentation for FCA Compliance
Use this checklist to self-audit your firm's current file-note standards against the four outcomes. A file that passes all items meets the baseline standard for Consumer Duty file evidence.
Products and Services
Client's product holdings documented against the firm's current target market criteria.
Annual suitability review completed and dated within the last 12 months.
Any changes to client circumstances recorded and linked to updated product assessment.
Price and Value
Ongoing service fee justified with reference to specific services delivered in the period.
For product transfers: charges compared on a like-for-like basis with a quantified annual saving or cost documented.
For vulnerable clients: fee structure reviewed with any support adjustments documented.
Consumer Understanding
Active comprehension check recorded, separate from the client signature on disclosure documents.
Vulnerability indicators flagged in the fact-find and carried through into the suitability report.
Communication adjustments documented for clients with financial literacy limitations.
Consumer Support
Client query or complaint response time within the firm's defined SLA.
LOA pack processing time recorded per provider.
Foreseeable harm indicators checked and documented at the fact-find stage.
Colin checks all of the above on every file. For firms not yet using Colin, this checklist functions as a manual pre-submission audit.
Integrating MI into Adviser Workflows
The operational bottleneck most advice firms face is sequential: the paraplanner cannot start until the adviser submits meeting notes. The compliance team cannot review until the paraplanner finishes, which means board MI is always looking at data that is days or weeks old by the time it is assembled.
Evie, AdvisoryAI's meeting documentation capability, removes the first delay. It connects directly with back-office systems including Intelliflo, Plannr, Curo, and Iress Xplan, as detailed in our Intelliflo integration guide, pushing structured meeting notes, fact-find updates, and action items directly into the client file. Timothy James and Partners achieved a 50% reduction in post-meeting documentation time, with structured notes available to the whole team within minutes of the meeting ending rather than waiting on adviser submissions.
Automate Consumer Duty Compliance Checks
Deploy Colin on suitability reports and annual review reports before submission. Set a minimum compliance score threshold below which a file cannot be submitted without compliance manager sign-off, export Colin's compliance reports as part of your monthly MI pack, and feed failed-check data into adviser training cycles so common gaps become structured development points rather than reactive fixes.
Refine MI Metrics for Quarterly Review
Consumer Duty MI is not a static framework. Quarterly reviews should assess which metrics have improved and whether the improvement reflects genuine outcome change or a data collection change, which failed-check categories have not improved despite remediation guidance being issued, and whether Atlas queries are surfacing client segments with previously unidentified outcome risks. The AdvisoryAI whitepaper sets out the Flower Group modelling and research in full, connecting documentation time reduction to firm valuation impact.
Request a demo to see how Colin and Atlas automate Consumer Duty outcomes monitoring across your firm. See how UK advice firms reduced documentation time in our case studies. Alternatively, start a 14-day free trial of the AdvisoryAI platform. No credit card required.
FAQs
How Often Should the Board Review Consumer Duty MI?
Firms must approve the annual Consumer Duty report at board level, as required under PRIN 2A.8. Strong firms review MI on a more frequent basis and use it to trigger remediation throughout the year rather than only at the annual reporting stage. Many operations leaders find value in producing MI for board-level review quarterly, with monthly operational reporting for compliance teams.
What Are the Minimum Sample Sizes the FCA Expects for Consumer Duty Compliance?
A small-percentage sample does not constitute evidence of outcomes across your whole book. Firms relying on small-percentage sampling face challenges justifying why that sample is representative. Automated checking of 100% of files removes this justification burden entirely.
Can We Use Existing Back-Office Data for Consumer Duty MI?
Yes, but only if the data is current and complete. We built Atlas to read client data and documents synced from back-office systems including Intelliflo, Plannr, and Curo, and return cited answers from that data. Data quality in the back office directly determines MI quality, so a data-gap audit alongside MI deployment is the first operational step for most firms.
How Far Back Should Firms Audit Historical Consumer Outcomes?
Firms preparing for a sale, a supervisory visit, or a Consumer Duty board report typically benefit from auditing prior files covering the period since the Consumer Duty's implementation. Colin can check historical files produced in various formats.
Key Terms Glossary
Consumer Duty: The FCA's cross-cutting regulatory framework, effective July 2023, requiring firms to demonstrate that retail customers receive good outcomes across four defined areas: products and services, price and value, consumer understanding, and consumer support. Firms must evidence these outcomes through documented MI and an annual board-approved report.
Management Information (MI): Structured data collected across adviser activity, file quality, and client outcomes that enables operations leaders and compliance teams to monitor performance, identify foreseeable harm, and produce the evidential record required for the Consumer Duty board report and FCA supervision.
Foreseeable Harm: A regulatory concept under Consumer Duty requiring firms to identify and act on risks to client outcomes before harm occurs, rather than documenting it retrospectively. Firms must have monitoring triggers in place and evidence that escalation processes are followed when thresholds are breached.
Capacity for Loss: A risk assessment distinct from attitude to risk (ATR) that evaluates the financial impact a client could sustain if an investment fell in value. The FCA expects both assessments to be documented separately in the client file, and their absence is a common compliance deficiency identified in file reviews.
RAG Thresholds: Red, Amber, Green escalation thresholds set within an MI dashboard to define what constitutes normal, deteriorating, or critical performance against a given metric. Firms must document the rationale for each threshold in their Consumer Duty monitoring policy and review them alongside the annual board report.

Subscribe to our newsletter
Get an AI summary of AdvisoryAI
For questions or partnerships,
contact us at team@advisoryai.com
For product support, help, contact us at support@advisoryai.com
Solutions
Compare












