How the composite quality score is computed.

1. What the composite means

The composite quality score is a 0-100% quality-model output. It is a weighted mean of up to four families: per-source completeness, inter-source consistency, ingestion timeliness, and the OIG LEIE byte-level match rate. Only families with a published value are included; a family that cannot be computed against the current schema is dropped and the remaining weights are renormalized (see §3). Inputs can be stored metric rows or documented fallback baselines, so the score is not proof of source-file fidelity, currentness, or ground-truth accuracy (see Limitations).

This document is methodology version v1.2, released 2026-05-26. The formulas and currently published metric fields are exposed in the machine-readable twin at /quality.json; reproducing a value also requires the named source inputs and dates. The methodology release date is not a platform-wide data snapshot.

2. The four sub-metrics

Completeness

For each row in the latest snapshot we count the public-displayable required fields that are non-null and non-empty, divide by the size of the required-field set, and report the median across rows. The required-field set is the public-displayability contract (the columns Fonteum renders), intentionally narrower than the upstream schema. Snapshots over 100k rows are sampled to 10k deterministically (seed = SHA256 of source_id || snapshot_date) so repeated reads return the same sample.

Consistency (not currently published)

Where two independent federal feeds describe the same NPI, do they agree? The intent is a cross-source agreement rate joined on NPI. The two checks originally specified — specialty agreement (NPPES taxonomy vs a PECOS enrollment-specialty field) and active-status agreement (NPPES active flag vs a PECOS enrollment-status field) — are not currently published, because the PECOS provider table holds no enrollment-specialty and no enrollment-status column to join against. Rather than publish a figure we cannot reproduce from the schema, the scorecard reports no consistency rate and the composite renormalizes over the families that are published. A consistency rate will appear here only once it is computed against columns that exist; the page reads any such published rows from source_consistency_metrics.

Match rate

Where both the publisher's SHA-256 and the exact archived OIG LEIE bytes are retained for a named date, equality can test whether those bytes match. A published match-rate metric must identify the compared artifacts and dates; if that reproducible evidence is absent, the family is omitted. Hash equality does not sign individual rows or establish that the publisher's content is correct.

Timeliness

Wall-clock hours between an upstream publication (source_release_date) and Fonteum ingesting it (ingested_at), computed over the trailing 90 days. The per-source timeliness sub-score is clamp01(1 - median_lag_hours / 168): a median lag of zero hours scores 1, and any median lag of a week or longer scores 0. Snapshots without a known release date are excluded from the percentile calculation.

3. Composite formula

The composite is a weighted mean of the four families, clamped to [0, 1]. The weights are pinned at this methodology version; the timeliness ceiling is one week (168 hours).

composite = ( sum of weight_i * score_i ) / ( sum of weight_i )
             over the families actually published this snapshot

  weights:
    0.35  completeness   median(median_field_completeness across sources)
    0.3  consistency    mean(rate across published cross-source checks)
    0.2  timeliness     clamp01(1 - median(median_lag_hours) / 168)
    0.15  match_rate     matched_weeks / total_weeks

// A family with no published, reproducible value is dropped and the
// remaining weights are renormalized to sum to 1 — a missing family is
// never read as a zero. Consistency is currently UNPUBLISHED (see below),
// so the live composite renormalizes over completeness, timeliness and
// match_rate. Result clamped to [0, 1], rounded to 4 decimals for display.

The composite is intentionally a weighted arithmetic mean rather than a product or harmonic mean: each family is a distinct, separately-published guarantee, and a buyer can recompute the headline number from the four family scores published on the same page.

4. Per-source inputs and configured model target

The composite weights apply per metric family, not per source — within completeness and timeliness, each source contributes through the median across sources, so no single source is weighted above another. The table below documents the configured quality-model timing threshold and the sub-metrics each headline source currently feeds; it is not observed publisher or loaded cadence. Consistency is omitted from every row because no consistency check is published at this snapshot (see §2).

5. Versioning policy

Versioning policy: a material change to a formula, weight, or required-field set should publish a new methodology version and retain the prior formula in the changelog. Reproduction requires the named source inputs as well as the applicable code and methodology version. The current published version is v1.2.

v1.2 keeps the v1 composite formula and weights unchanged; it adds the per-source sub-score decomposition surfaced on the scorecard, the configured timing-threshold table, and the downloadable PDF. A future version that changes any weight will publish the prior weights in this changelog.

Correction (2026-06-11): earlier revisions of this scorecard published two cross-source consistency rates (a specialty-agreement and an active-status-agreement figure) joined against PECOS enrollment-specialty and enrollment-status fields. Those columns do not exist in the provider schema, so the rates could not be reproduced and have been withdrawn. The consistency family is now shown as unpublished and the composite renormalizes over the remaining families until a consistency check is computed against columns that exist. The weight reserved for consistency is unchanged.

No DOI is published for this methodology version. The 14-tuple provenance _doi field stays null unless a DOI has actually been issued.

6. Limitations

This scorecard reports a model output from stored metric rows or documented fallbacks; it does not establish Fonteum's accuracy against source files or the source files' accuracy against ground truth. The cited OIG review describes limitations in PECOS and NPPES; available Fonteum provenance metadata helps identify inputs but does not correct or certify the upstream records (see /methodology).

Specifically, this page does not assert:

• That every provider in NPPES is real or currently practicing.
• That the upstream agency's required-field set matches the public-displayability set used here.
• That a cross-source disagreement means one side is wrong — taxonomy and specialty mappings legitimately drift.
• That a 100% OIG LEIE byte match would mean the exclusion data is free of false negatives at the upstream layer.

What it does assert: every computation published here runs as described, against the snapshots described, on the cadence described — and any consumer can replay it against /quality.json. A family that cannot be reproduced is shown as unpublished, never as a placeholder number.

7. References

• NPPES Data Dissemination (NPI files) — https://download.cms.gov/nppes/NPI_Files.html
• CMS Provider data and PECOS enrollment — https://data.cms.gov/provider-data
• CMS Open Payments — https://openpaymentsdata.cms.gov
• OIG LEIE downloadable exclusions — https://oig.hhs.gov/exclusions/exclusions_list.asp
• OIG, Improvements Needed to Ensure Provider Enumeration and Medicare Enrollment Data Are Accurate (OEI-09-18-00410, 2018) — https://oig.hhs.gov/oei/reports/oei-09-18-00410.asp