Fraud Detection & Analytics
You Can Measure Your False Positives Exactly.
You Will Never Know Your False Negatives.
Fraud analytics for banking built around that asymmetry: both errors estimated and reported, a response capability measured in days rather than release cycles, and alert volume set against the capacity to work it.
Every fraud programme runs on an uneven information diet. A wrongly declined payment arrives back as a complaint within hours, attributed, documented and counted. Fraud that got through arrives weeks later, incompletely, and only when a customer or a counterparty notices.
The problem
Five outcomes, and you only get clean feedback from two of them
A fraud decision has five possible outcomes. They are not symmetrical in cost and, more importantly, they are not symmetrical in what the institution learns from them.
The miss rate is unknown and treated as zero
Because nothing in the reporting makes it visible.
Thresholds drift toward under-detection
One error complains and the other stays quiet.
Signals sit in separate systems
Card, payments, digital and servicing each hold part of it.
Alert volume exceeds the capacity to work it
So the real control is which alerts get ignored.
Decay is treated as drift
When the population is actively responding to the control.
Response time is a release cycle
A new pattern needs days, not a quarterly deployment.
The decision is binary
Allow or block, with no step-up between them.
Confirmed outcomes never return as labels
So the model cannot learn from what the investigators found.
Ask what your false negative rate is, and then ask how it was estimated. Most institutions can state their false positive rate to one decimal place and have no answer at all to the second question. If the answer is that the figure is not produced, the programme is being managed on one of its two error rates, and the other one is the one that carries the loss. Producing even a crude estimate with a documented method changes how every threshold conversation runs, and it costs an analyst a week.
Our approach
Build for response time, not just detection accuracy
Fraud is the one analytical problem in banking where the population is actively trying to beat the model. That single fact changes what good engineering looks like.
Accuracy at deployment matters less than how quickly the institution can respond when something new appears, because something new will appear and it will have been designed with your current controls in mind.
Step 1
Establish the fraud risks, channels and actions in scope
Step 2
Define the decision set per channel
Step 3
Establish the cost of each error in each direction
Step 4
Integrate the signals that actually exist
Step 5
Resolve entity and relationship identity
Step 6
Build the feature layer with point-in-time correctness
Step 7
Combine rules and models deliberately
Step 8
Calibrate alert volume to the capacity to work it
Step 9
Validate with your model risk function
Step 10
Close the feedback loop before go-live
Step 11
Deploy with a response path measured in days
Step 12
Monitor precision, estimated recall, displacement and backlog
Find out how long it takes you to respond to a pattern you have never seen before. Not to detect it, to respond to it. From the moment an investigator identifies something new, how long until the control is live, and what has to happen in between: a model retrain, a release, a change approval, a committee. In many institutions the answer is measured in weeks and the detection logic itself could have been changed in an afternoon. That gap is the real exposure, and it is a process question rather than a modelling one.
What we build
Detection, prioritisation and investigation are three different problems
Fraud programmes are usually scoped as detection and then spend most of their operational life on the other two. Prioritisation decides what gets looked at and investigation decides what is concluded, and both are where analytics earns its keep after the first quarter.
Detection and scoring
Transaction fraud analytics across payments, cards, transfers and digital channels, within the latency each channel allows
Behavioural analytics at the account and relationship level, since the same activity means different things for different customers
Anomaly detection designed from the response backwards, with a named action per class of anomaly
Fraud risk scoring combined with rules, so the explainable and the learned each do what they are good at
Model and rule performance measured per segment rather than in aggregate, because aggregate precision hides a channel
Network and relationship analytics
Graph and network analytics, where the unit of investigation is a relationship rather than a transaction
Entity resolution as the dependency it is, drawn from the platform work rather than rebuilt inside the fraud estate
Account and counterparty relationship analysis to support authorised investigation
Indicators that support your financial crime function in identifying accounts used to move funds, under their own governance
Alert prioritisation and workflow
Alert prioritisation by expected loss and workability rather than by score alone
Grouping of related alerts into a single case, since one scheme generating forty alerts is one investigation
Suppression of alert types that have never confirmed, with evidence and with sign-off, rather than by quiet threshold change
Queue design, ageing and routing, which is the part the operation experiences every day
Investigation intelligence and feedback
Investigator-facing context
the relationship, the history, the comparable cases and the reason the alert fired
Outcome capture structured enough to be a label, which is the integration most programmes defer and most need
Case analytics on cause, confirmation rate and time to conclude, by alert type
Loss and recovery analytics connected back to the detection decision that preceded it
Where this gets used
Seven workloads, and they differ on latency, label quality and action
These are usually scoped as one fraud capability. In practice they differ on three things that decide the engineering: how long the decision window is, how good the feedback is, and what the institution is permitted to do when the score is high.
| Workload | Decision window | What makes it hard |
|---|---|---|
| Payment fraud | Immediate on instant rails, longer on others | Irrevocable settlement removes the recovery option |
| Card fraud | Fixed by the network, no flexibility | Volume, latency and a very low tolerable decline rate |
| Account takeover | During the session, before the money moves | The genuine customer and the attacker look alike |
| Digital banking fraud | In session, across several steps | Signals sit in the channel rather than in the ledger |
| Authorised push payment harm | Before the customer sends it | The customer is instructing it, so the control is persuasion |
| Accounts used to move funds | Days to weeks, not seconds | Normal transaction by transaction, visible as a network |
| Investigation support | Hours to days | Context assembly, not scoring, and it is never prioritised |
How it is built
The feedback loop is the integration that decides everything else
Fraud architecture discussions concentrate on the scoring path: streaming, feature serving, latency, the rules engine. That path is the visible half and it is the straightforward half.
The integration that determines whether the system improves is the return path. Investigators reach conclusions every day, and in a great many estates those conclusions never make it back to the thing that raised the alert. The model is then learning from a label set that stopped growing at go-live.
A decision path fast enough for the channel, with feature serving that meets the same latency and does not quietly fall back to a stale value
A rules engine for the known, the mandated and the explainable, changeable under governance without a model release
Model serving for the patterns nobody wrote down, versioned, with training and serving reading the same definitions
Case management as the system of record for the investigation, with the outcome captured in a structured form rather than in a free-text note
A return path from case outcome to label store, which is the integration this section exists to argue for
Entity resolution and the behavioural feature layer consumed from the platform and analytics work rather than duplicated here
And enterprise integration with core banking, cards, payment platforms, digital channels and servicing, on the patterns described on our Banking Data Platform Engineering page
With transaction state preserved through it
posting status, reversals and the original transaction reference, since a reversal counted as a second event distorts both the signal and the loss figure. The full treatment is on our Customer & Transaction Analytics page
Integration boundaries. We build alongside your existing platforms and case management rather than requiring their replacement, which is both the faster route and usually the only one a risk function will approve
Source system protection. Extraction uses approved interfaces and agreed windows, without adding load to systems whose first job is to keep running, as described on our Banking Data Platform Engineering page
Named ownership of production failures. Every pipeline, job and interface has a person accountable for it when it breaks, agreed before go-live rather than discovered during an incident
Deployment pattern chosen on your policy. Cloud, on-premises and hybrid are decided by your residency, resilience, latency and cost position rather than by a preference we brought with us
Check whether your investigators’ conclusions reach your models. Pick a confirmed fraud case from last month and trace it forward: does the disposition exist as structured data, is it linked to the alert and the model version, and would it be included in the next retrain. In a surprising number of estates the answer is that the outcome lives in a case management note and the model has never seen it. That is the cheapest material improvement available in fraud analytics and it is almost never on the roadmap, because it improves next year rather than this quarter.
Governance
Explain the decision without publishing the detection
Which regulations apply, what explanation a customer is owed, when a payment or account may be restricted, and what controls are required are determined by your compliance, legal, conduct and risk functions, based on your operating markets. We do not interpret those requirements and this page does not state which apply to you.
Technology supports a fraud control framework. It does not independently establish one, and no analytics platform makes an institution compliant.
Explainability, held in tension
- The decision explainable to the customer, to a complaints handler and to a reviewer, at the level your conduct function requires
- The detection logic not disclosed, since a published control is a solved control, and the two requirements are reconciled by explaining the outcome rather than the method
- A documented internal explanation for every production model, held in the model file, which is a different artifact to a customer explanation
- Rule logic auditable by inspection, which is part of why the rule estate is worth keeping
False positives as a conduct control
- Decline and block rates monitored by customer group as a conduct measure, not only as a performance measure
- Essential and time-critical payments identified, because the harm from blocking one is not comparable to the harm from blocking a discretionary purchase
- Vulnerability indicators routed to support rather than to friction, consistent with the treatment on our Customer & Transaction Analytics page
- A route for a customer to get through a block quickly, measured, since the control is incomplete without it
Oversight and access
- Human review before a consequential action where your framework requires it, with the override captured as data including its reason
- Model validation by your independent model risk function, with the fraud models tiered under your own policy
- Access to fraud case and alert data scoped to named investigators rather than to the analytics population
- Audit trails over alerts, decisions, overrides, suppressions, threshold changes and access
Data and change
- Privacy and minimisation applied to fraud features, with device, location and behavioural data treated as the sensitive data it is
- Threshold and suppression changes governed, with the justification recorded, because this is the control most easily weakened quietly
- Retention of alerts, cases and evidence per your records policy, which here is frequently longer than analytics teams expect
- Where fraud work touches financial crime, the communication constraints set out on our Customer & Transaction Analytics page apply unchanged
Keeping it effective
Report both error rates, and say which one you estimated
Fraud reporting almost always leads with alert volume and false positive rate, because both are precisely measurable. The measures below include the ones that are not, on the basis that an estimate with a stated method is more use than a blank.
Baselines and targets are agreed with you before anything is deployed. We do not claim a percentage improvement in the abstract, because the number depends on where you are starting from and that is knowable only once we have looked.
More importantly, every measure here can be improved in a way that makes the institution worse off. A smaller queue, a faster conclusion, a higher automation rate and a shorter cycle are all achievable by doing less, and none of them is an improvement if coverage, accuracy, fairness or control effectiveness fell to produce it. Each number is read with the thing it could be trading against.
| Failure | How it presents |
|---|---|
| A threshold was moved under pressure | Alert volume fell and nothing else changed |
| Activity displaced to another channel | One channel improved and the total did not |
| The backlog is absorbing the real decision | Alerts age out rather than being worked |
| The feedback loop stopped | Confirmed outcomes no longer reaching the label store |
| A rule has never confirmed | Firing steadily, contributing nothing, never retired |
| Analyst productivity improved | Faster conclusions, and possibly less evidence each |
| Precision rose and detection fell | A cleaner queue hiding a narrower net |
| Block rates differ by customer group | A conduct exposure invisible in aggregate reporting |
Outcomes
A cleaner queue and an honest number for what you are missing
The outcomes below follow from three choices: estimate both error rates, close the feedback loop, and build a response path measured in days.
Fraud identified earlier, with the detection decision measured against what was recoverable at the time
Fewer unnecessary alerts, achieved by precision and prioritisation rather than by raising a threshold
Investigations that conclude faster because the context arrives with the alert
A stated position on what the programme is missing, with a method behind it
Response time to a new pattern measured in days, which is the measure an adversarial problem is actually judged on
Fewer customers wrongly blocked, tracked by group as a conduct measure
A model that keeps improving, because investigator outcomes return as labels
Ask us what you are missing, not what you are catching.
We will take your alert and outcome data and establish four things: actual precision by type, an estimated miss rate with a stated method, how much of the real decision the backlog is making, and whether investigator conclusions reach your models. You get the findings whether or not we build anything.
Why choose CaliberFocus for Fraud Detection and Analytics?
CaliberFocus builds fraud analytics that estimates the miss rate deliberately, states its uncertainty and can respond to a new pattern in days rather than at the next release. We design the allow, challenge and block decision per channel, calibrate alert volume to the capacity to work it, and close the feedback loop so investigator outcomes return as labels.
- Both error rates reported, with the miss rate estimated and its method stated
- A response path to new patterns measured in days
- Alerts prioritised and grouped so investigators receive context
- Investigator conclusions captured as structured labels for the models
Security & Compliance
