- Cadence
- Annual (mid-October)
- Cron
- 0 6 15 10 * — Annual: October 15 at 06:00 UTC
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://apps.bea.gov/regional/zip/SAGDP.zip
- Projected fields
- geo_fips, line_code, year, value
Source coverage.
The Fonteum source-puller crons fetch the canonical CSV from each upstream source on a published schedule, attest the on-disk archive with a SHA-256 hash, write a row in source_snapshots, and fan out events to subscribers. This page is the published schedule. For live freshness status (last successful pull, snapshot age) see /freshness.
Live sources
All 48 registered cron/operator-script sources contribute to source_snapshots + snapshot_attestations on refresh, and emit the downstream events that drive the webhook registry, the integrity chain, and the freshness dashboard. 5 sources run as autonomous Inngest puller crons. 43 sources run as operator-triggered scripts under scripts/research/ — the operator workflow registers the snapshot via the post-ingest hook (src/lib/sources/post-ingest-hook.ts) at end-of-script, so the resulting source_snapshots row is indistinguishable from an autonomous puller's. Historical sprint baseline: ten federal sources; the live registry count above is now the maintained number.
- Cadence
- Annual (mid-May)
- Cron
- 0 6 15 5 * — Annual: May 15 at 06:00 UTC
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://www.bls.gov/oes/special.requests/oesm23nat.zip
- Projected fields
- soc_code, area, tot_emp, a_mean
- Cadence
- Daily re-check
- Cron
- Manual: npx tsx scripts/research/cfpb-enforcement-ingest.ts — Manual: npx tsx scripts/research/cfpb-enforcement-ingest.ts
- Methodology
- cfpb-enforcement-actions/v1
- Schema
- v2026.06.0
- Download
- https://www.consumerfinance.gov/enforcement/actions/
- Projected fields
- record_key, title, action_url, forum, court, docket_number, filed_date, status, products, documents
- Cadence
- Daily re-check
- Cron
- Manual: npx tsx scripts/research/cftc-enforcement-ingest.ts — Manual: npx tsx scripts/research/cftc-enforcement-ingest.ts
- Methodology
- cftc-enforcement-actions/v1
- Schema
- v2026.06.0
- Download
- https://www.cftc.gov/LawRegulation/EnforcementActions/index.htm
- Projected fields
- release_number, published_at, action_date, action_title, action_url, respondent_label, source_page_url, document_links
- Cadence
- Quarterly (per facility type, operator-triggered)
- Cron
- Manual: npx tsx scripts/research/care-compare-<facility-type>-<date>.ts — Manual: npx tsx scripts/research/care-compare-<facility-type>-<date>.ts
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://data.cms.gov/provider-data/
- Projected fields
- ccn, facility_type, state
- Cadence
- Annual (operator-triggered ~November)
- Cron
- Manual: npx tsx scripts/research/hcris-ingest.ts — Manual: npx tsx scripts/research/hcris-ingest.ts
- Methodology
- hcris-2552-10/v1
- Schema
- hcris-2552-10-headline/v1
- Download
- https://downloads.cms.gov/FILES/HCRIS/HOSP10FY2024.ZIP
- Projected fields
- ccn, fiscal_year_begin, fiscal_year_end, net_patient_revenue, operating_margin_pct, total_margin_pct
- Cadence
- Annual (operator-triggered, post mid-June release)
- Cron
- Manual: operator ingest of cms-inpatient-utilization (script queued §puller-operator-scripts; resolver returns the live CSV) — Manual: operator ingest of cms-inpatient-utilization (script queued §puller-operator-scripts; resolver returns the live CSV)
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://data.cms.gov/sites/default/files/2024-06/MUP_IHP_R24_P03_V10_D22_FFS_Prov_Svc.csv
- Projected fields
- ccn, ms_drg_code, ms_drg_description, total_discharges, avg_covered_charges, avg_total_payments, avg_medicare_payments
- Cadence
- Quarterly (operator-triggered; CMS posts Q1–Q4)
- Cron
- Manual: npm run seed:ncci:mue (resolver scrapes the live NCCI MUE page for the current quarter) — Manual: npm run seed:ncci:mue (resolver scrapes the live NCCI MUE page for the current quarter)
- Methodology
- ncci-mue/v1
- Schema
- ncci-mue-edits/v1
- Download
- https://www.cms.gov/medicare/coding-billing/national-correct-coding-initiative-ncci-edits/medicare-ncci-medically-unlikely-edits-mues
- Projected fields
- service_type, hcpcs_code, mue_value, mai_code, effective_date
- Cadence
- Quarterly (operator-triggered; CMS posts Q1–Q4)
- Cron
- Manual: npm run seed:ncci:ptp (resolver scrapes the live NCCI PTP page for the current quarter) — Manual: npm run seed:ncci:ptp (resolver scrapes the live NCCI PTP page for the current quarter)
- Methodology
- ncci-ptp/v1
- Schema
- ncci-ptp-edits/v1
- Download
- https://www.cms.gov/medicare/coding-billing/national-correct-coding-initiative-ncci-edits/medicare-ncci-procedure-procedure-ptp-edits
- Projected fields
- service_type, column_1_code, column_2_code, modifier_indicator, effective_date
- Cadence
- Quarterly (per specialty, operator-triggered)
- Cron
- Manual: npx tsx scripts/research/nppes-by-taxonomy-ingest.ts <slug> --refresh — Manual: npx tsx scripts/research/nppes-by-taxonomy-ingest.ts <slug> --refresh
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://npiregistry.cms.hhs.gov/api/?version=2.1
- Projected fields
- npi, specialty, city, state
- Cadence
- Annual (operator-triggered ~July, post-publication)
- Cron
- Manual: operator ingest (script queued §puller-operator-scripts; resolver returns the live bulk CSV) — Manual: operator ingest (script queued §puller-operator-scripts; resolver returns the live bulk CSV)
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://download.cms.gov/openpayments/PGYR2024_P06302025_06292025.zip
- Projected fields
- npi, manufacturer_name, payment_amount, payment_nature_code, payment_date, dispute_status
- Cadence
- Annual (operator-triggered, post mid-June release)
- Cron
- Manual: operator ingest of cms-outpatient-utilization (script queued §puller-operator-scripts; resolver returns the live CSV) — Manual: operator ingest of cms-outpatient-utilization (script queued §puller-operator-scripts; resolver returns the live CSV)
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://data.cms.gov/sites/default/files/2024-06/MUP_OHP_R24_P05_V10_D22_FFS_Prov_Svc.csv
- Projected fields
- ccn, apc_code, apc_description, total_services, total_beneficiaries, avg_total_submitted_charges, avg_medicare_payment_amt
- Cadence
- Weekly (Sunday)
- Cron
- 0 6 * * 0 — Every Sunday at 06:00 UTC
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://data.cms.gov/data-api/v1/dataset/medicare-fee-for-service-public-provider-enrollment/data?format=csv
- Projected fields
- npi
- Cadence
- Quarterly (operator-triggered; CMS publishes Q1–Q4)
- Cron
- Manual: npx tsx scripts/research/cms-pos-ingest.ts — Manual: npx tsx scripts/research/cms-pos-ingest.ts
- Methodology
- cms-pos/v1
- Schema
- cms-pos-facilities/v1
- Download
- https://data.cms.gov/sites/default/files/2026-04/90983850-6dfe-4886-9dfa-1a3890a655b3/POS_File_iQIES_Q1_2026.csv
- Projected fields
- ccn, facility_type, state
- Cadence
- Annual (operator-triggered, post mid-June release)
- Cron
- Manual: operator ingest of cms-provider-utilization (script queued §puller-operator-scripts; resolver returns the live CSV) — Manual: operator ingest of cms-provider-utilization (script queued §puller-operator-scripts; resolver returns the live CSV)
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://data.cms.gov/sites/default/files/2024-06/MUP_PHY_R24_P05_V10_D22_Prov_Svc.csv
- Projected fields
- npi, hcpcs_code, hcpcs_description, place_of_service, service_count, beneficiary_count, beneficiary_unique_count, submitted_charge_amt, allowed_amt, payment_amt, standardized_amt
- Cadence
- Annual (operator-triggered ~July, post-performance-year scoring)
- Cron
- Manual: npx tsx scripts/research/qpp-ingest.ts — Manual: npx tsx scripts/research/qpp-ingest.ts
- Methodology
- cms-qpp-mips/v1
- Schema
- cms-qpp-mips-headline/v1
- Download
- https://data.cms.gov/provider-data/api/1/datastore/query/a174-a962/0?count=true&results=true
- Projected fields
- npi, tin, performance_year, final_score, quality_score, cost_score, ia_score, pi_score, payment_adjustment_pct, participation_type
- Cadence
- Weekly (CPSC publishes recalls continuously; the retrieval API reflects them in real time)
- Cron
- Manual: npx tsx scripts/research/cpsc-ingest.ts — Manual: npx tsx scripts/research/cpsc-ingest.ts
- Methodology
- cpsc/v1
- Schema
- v2026.06.0
- Download
- https://www.saferproducts.gov/RestWebServices/Recall?format=json
- Projected fields
- recall_number, recall_id, title, recall_date, last_publish_date, product_names, manufacturer_names, hazard_names, remedy_names, total_units_affected
- Cadence
- Daily Federal Register API check; DEA Diversion recent-case page used as official supplemental context
- Cron
- Manual: npx tsx scripts/research/dea-registrant-enforcement-ingest.ts --dry-run, then operator live run after migration approval — Manual: npx tsx scripts/research/dea-registrant-enforcement-ingest.ts --dry-run, then operator live run after migration approval
- Methodology
- dea-registrant-enforcement/v1
- Schema
- v2026.06.0
- Download
- https://www.federalregister.gov/api/v1/documents.json?conditions%5Bagencies%5D%5B%5D=drug-enforcement-administration&conditions%5Bterm%5D=%22Decision%20and%20Order%22&conditions%5Btype%5D%5B%5D=NOTICE&fields%5B%5D=abstract&fields%5B%5D=agencies&fields%5B%5D=citation&fields%5B%5D=document_number&fields%5B%5D=html_url&fields%5B%5D=pdf_url&fields%5B%5D=publication_date&fields%5B%5D=title&fields%5B%5D=type&fields%5B%5D=raw_text_url&order=newest&per_page=100
- Projected fields
- record_key, document_number, recipient_name, recipient_type, action_type, publish_date, action_url
- Cadence
- Quarterly
- Cron
- Manual: npm run seed:dol-whd — Manual: npm run seed:dol-whd
- Methodology
- dol-whd/v1
- Schema
- v2026.06.0
- Download
- https://apiprod.dol.gov/v4/get/WHD/enforcement/json
- Projected fields
- record_key, case_id, trade_name, legal_name, city, state, naics_code, findings_start_date, findings_end_date, total_violation_count, total_back_wages, total_employees_due_back_wages, total_civil_money_penalties
- Cadence
- Annual L1 workbook refresh; selected-resolution exports are operator-supplied when EEOC updates the litigation dashboard
- Cron
- Manual: npx tsx scripts/research/eeoc-enforcement-ingest.ts — Manual: npx tsx scripts/research/eeoc-enforcement-ingest.ts
- Methodology
- eeoc-enforcement/v1
- Schema
- v2026.06.0
- Download
- https://www.eeoc.gov/data/enforcement-and-litigation-statistics-0
- Projected fields
- fiscal_year, all_suits_filed, merits_suits_filed, all_resolutions, merits_resolutions, monetary_benefits_millions, employer_name, case_name, court, docket_number, statutes, issues, resolution_type, resolution_date, monetary_relief_usd, individuals_benefited
- Cadence
- Weekly (ECHO data refresh)
- Cron
- Manual: npx tsx scripts/research/epa-echo-ingest.ts --write — Manual: npx tsx scripts/research/epa-echo-ingest.ts --write
- Methodology
- epa-echo-exporter/v1
- Schema
- v2026.06.0
- Download
- https://echo.epa.gov/files/echodownloads/echo_exporter.zip
- Projected fields
- record_key, entity_name, city, state
- Cadence
- Daily (the EU regenerates the FSF export on each restrictive-measure change)
- Cron
- Manual: npx tsx scripts/research/eu-sanctions-ingest.ts — Manual: npx tsx scripts/research/eu-sanctions-ingest.ts
- Methodology
- eu-sanctions/v1
- Schema
- v2026.06.0
- Download
- https://webgate.ec.europa.eu/fsd/fsf/public/files/xmlFullSanctionsList_1_1/content?token=dG9rZW4tMjAxNw
- Projected fields
- record_key, logical_id, eu_reference_number, programme, party_type, primary_name, regulation_title, designation_date
- Cadence
- Daily re-check (aircraft daily; airmen monthly)
- Cron
- Manual: npx tsx scripts/research/faa-ingest.ts — Manual: npx tsx scripts/research/faa-ingest.ts
- Methodology
- faa-registries/v1
- Schema
- v2026.06.0
- Download
- https://registry.faa.gov/database/ReleasableAircraft.zip
- Projected fields
- unique_id, first_middle_name, certificate_type, certificate_level, n_number, serial_number, registrant_name, type_registrant, state, expiration_date
- Cadence
- Weekly (the FCC refreshes the ULS complete-download files every Sunday)
- Cron
- Manual: npx tsx scripts/research/fcc-ingest.ts — Manual: npx tsx scripts/research/fcc-ingest.ts
- Methodology
- fcc-uls/v1
- Schema
- v2026.06.0
- Download
- https://data.fcc.gov/download/pub/uls/complete/l_amat.zip
- Projected fields
- unique_system_identifier, call_sign, license_status, radio_service_code, grant_date, expired_date, cancellation_date, revoked, convicted, adjudged, entity_name, frn, entity_type, applicant_type_code, city, state
- Cadence
- Weekly check (openFDA recalls weekly; FDA Warning Letters page as posted)
- Cron
- Manual: npm run seed:fda:enforcement-actions -- --dry-run, then operator live run after migration approval — Manual: npm run seed:fda:enforcement-actions -- --dry-run, then operator live run after migration approval
- Methodology
- fda-enforcement-actions/v1
- Schema
- v2026.06.0
- Download
- https://www.fda.gov/inspections-compliance-enforcement-and-criminal-investigations/compliance-actions-and-activities/warning-letters
- Projected fields
- action_id, action_type, source_family, firm_name, action_date, posted_date, subject
- Cadence
- Weekly (the FEC refreshes the bulk-download files weekly)
- Cron
- Manual: npx tsx scripts/research/fec-ingest.ts — Manual: npx tsx scripts/research/fec-ingest.ts
- Methodology
- fec/v1
- Schema
- v2026.06.0
- Download
- https://www.fec.gov/files/bulk-downloads/2026/cm26.zip
- Projected fields
- committee_id, committee_name, committee_type, candidate_id, candidate_name, office, election_year, sub_id, contributor_name, transaction_amount, transaction_date
- Cadence
- Manual re-check; FERC updates enforcement action pages as orders issue
- Cron
- Manual: npx tsx scripts/research/ferc-enforcement-ingest.ts — Manual: npx tsx scripts/research/ferc-enforcement-ingest.ts
- Methodology
- ferc-enforcement-orders/v1
- Schema
- v2026.06.0
- Download
- https://www.ferc.gov/alphabetical-list-civil-penalty-actions
- Projected fields
- respondent_label, docket_numbers, ferc_citation, order_date, civil_penalty_usd, disgorgement_usd, compliance_monitoring
- Cadence
- Daily re-check
- Cron
- Manual: npx tsx scripts/research/fincen-enforcement-ingest.ts — Manual: npx tsx scripts/research/fincen-enforcement-ingest.ts
- Methodology
- fincen-enforcement-actions/v1
- Schema
- fincen-enforcement-actions/v1
- Download
- https://www.fincen.gov/news/enforcement-actions
- Projected fields
- record_key, matter_number, action_title, respondent_caption, published_at, action_date, document_url, source_page_url, financial_institution_categories
- Cadence
- Daily for Company Census / Crash / Inspection; enforcement files are fiscal-year attachments
- Cron
- Manual: npx tsx scripts/research/fmcsa-carrier-safety-ingest.ts --write — Manual: npx tsx scripts/research/fmcsa-carrier-safety-ingest.ts --write
- Methodology
- fmcsa-carrier-safety/v1
- Schema
- v2026.06.0
- Download
- https://www.fmcsa.dot.gov/registration/fmcsa-data-dissemination-program
- Projected fields
- dot_number, legal_name, safety_rating, safety_rating_date, crash_id, inspection_id, case_number, penalty_amount
- Cadence
- Daily operator refresh (FTC Legal Library cases/proceedings index)
- Cron
- Manual: npx tsx scripts/research/ftc-enforcement-ingest.ts — Manual: npx tsx scripts/research/ftc-enforcement-ingest.ts
- Methodology
- ftc-enforcement/v1
- Schema
- v2026.06.0
- Download
- https://www.ftc.gov/legal-library/browse/cases-proceedings
- Projected fields
- record_key, title, case_url, summary, mission, type_of_action, case_status, enforcement_type, ftc_matter_number, docket_number, last_updated_date
- Cadence
- Quarterly (1st of Jan / Apr / Jul / Oct)
- Cron
- 0 6 1 1,4,7,10 * — Quarterly: 1st of Jan / Apr / Jul / Oct at 06:00 UTC
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://data.hrsa.gov/DataDownload/DD_Files/BCD_HPSA_FCT_DET_PC.csv
- Projected fields
- hpsa_id, designation_type, designation_status
- Cadence
- Annual (May, post-grant-year reporting)
- Cron
- Manual: npx tsx scripts/research/uds-ingest.ts — Manual: npx tsx scripts/research/uds-ingest.ts
- Methodology
- hrsa-uds/v1
- Schema
- hrsa-uds-awardee/v1
- Download
- https://data.hrsa.gov/DataDownload/StaticDocuments/H80-2024.xlsx
- Projected fields
- bhcmis_id, awardee_name, state, grant_year, total_patients, medicaid_patients, uninsured_patients, total_fte, clinical_fte, grant_amount_usd, total_sites
- Cadence
- Weekly replacement files (Friday afternoon, per MSHA)
- Cron
- Manual: npx tsx scripts/research/msha-ingest.ts — Manual: npx tsx scripts/research/msha-ingest.ts
- Methodology
- msha-mine-safety-enforcement/v1
- Schema
- v2026.06.0
- Download
- https://arlweb.msha.gov/OpenGovernmentData/OGIMSHA.asp
- Projected fields
- mine_id, current_mine_name, current_mine_status, current_operator_id, current_operator_name, state, event_no, inspection_begin_date, inspection_end_date, activity_code, activity, violation_no, violator_id, violator_name, violator_type_code, violation_issue_date, sig_sub, part_section, proposed_penalty, amount_due
- Cadence
- Daily re-check
- Cron
- Manual: npx tsx scripts/research/ncua-enforcement-ingest.ts — Manual: npx tsx scripts/research/ncua-enforcement-ingest.ts
- Methodology
- ncua-enforcement-actions/v1
- Schema
- v2026.06.0
- Download
- https://ncua.gov/sites/default/files/list_csv/administrative-orders.csv
- Projected fields
- record_key, docket_number, year, docket_suffix, institution_name, relationship, city, state, action_url, action_url_redacted, subject_type, person_name_redacted
- Cadence
- Weekly (NHTSA ODI refreshes the recalls/complaints/investigations flat files continuously; re-checked weekly)
- Cron
- Manual: npx tsx scripts/research/nhtsa-ingest.ts — Manual: npx tsx scripts/research/nhtsa-ingest.ts
- Methodology
- nhtsa/v1
- Schema
- v2026.06.0
- Download
- https://static.nhtsa.gov/odi/ffdd/rcl/FLAT_RCL_POST_2010.zip
- Projected fields
- record_id, campaign_number, make, model, model_year, component_name, manufacturer, recall_type_code, complaint_id, odi_number, crash, fire, injured, deaths, action_number, date_opened, date_closed, subject
- Cadence
- Weekly operator refresh (advanced-search export; bounded by date window)
- Cron
- Manual: npx tsx scripts/research/nlrb-labor-cases-ingest.ts — Manual: npx tsx scripts/research/nlrb-labor-cases-ingest.ts
- Methodology
- nlrb-labor-cases/v1
- Schema
- v2026.06.0
- Download
- https://www.nlrb.gov/advanced-search?foia_report_type=cases_and_decisions&case_status=-1&case_type=-1&from_date=&to_date=&items_per_page=100000&page=0&sort_by=date_filed&order_by=desc&search_term=&op=Search&submit=Search&form_id=nlrb_foia_search_form&cases_and_decisions_cboxes%5Ballegations%5D=allegations&cases_and_decisions_cboxes%5Bcase%5D=case&cases_and_decisions_cboxes%5Bcase_type%5D=case_type&cases_and_decisions_cboxes%5Bcity%5D=city&cases_and_decisions_cboxes%5Bclose_method%5D=close_method&cases_and_decisions_cboxes%5Bdate_closed%5D=date_closed&cases_and_decisions_cboxes%5Bdate_filed%5D=date_filed&cases_and_decisions_cboxes%5Bemployees%5D=employees&cases_and_decisions_cboxes%5Bname%5D=name&cases_and_decisions_cboxes%5Bparticipants%5D=participants&cases_and_decisions_cboxes%5Bregion_name%5D=region_name&cases_and_decisions_cboxes%5Bstate%5D=state&cases_and_decisions_cboxes%5Bstatus%5D=status&cases_and_decisions_cboxes%5Bunion%5D=union&cases_and_decisions_cboxes%5Bunit_description%5D=unit_description&cases_and_decisions_cboxes%5Bvoters%5D=voters
- Projected fields
- case_number, case_name, case_type, region_name, city, state, status, date_filed, date_closed, close_method, employees_on_charge_petition, voters, union_name, unit_description, allegations, respondents
- Cadence
- Periodic (updated after NRC Information Digest publication)
- Cron
- Manual: npx tsx scripts/research/nrc-enforcement-ingest.ts --write — Manual: npx tsx scripts/research/nrc-enforcement-ingest.ts --write
- Methodology
- nrc-enforcement-actions/v1
- Schema
- v2026.06.0
- Download
- https://www.nrc.gov/sites/default/files/doc_library/cdn/legacy/reading-rm/doc-collections/datasets/enforcement-actions.xlsx
- Projected fields
- year_of_update, action_number, recipient_name, recipient_type, issue_date, enforcement_action, civil_penalty_amount
- Cadence
- Monthly (Companies Office bulk data files are refreshed monthly after approved access)
- Cron
- Manual: npx tsx scripts/research/nz-companies-register-ingest.ts --limit 1000 --file <approved-bulk-data.zip> — Manual: npx tsx scripts/research/nz-companies-register-ingest.ts --limit 1000 --file <approved-bulk-data.zip>
- Methodology
- nz-companies-register/v1
- Schema
- nz-companies-register/v1
- Download
- https://catalogue.data.govt.nz/dataset/the-companies-office/resource/73109f41-65ba-4163-805a-ada4dd431c75
- Projected fields
- nzbn, company_identifier, entity_name, registration_date, removal_date, entity_type, entity_status
- Cadence
- Daily (OFAC publishes the SLS files daily; intraday on enforcement actions)
- Cron
- Manual: npx tsx scripts/research/ofac-sdn-ingest.ts — Manual: npx tsx scripts/research/ofac-sdn-ingest.ts
- Methodology
- ofac-sdn/v1
- Schema
- v2026.06.0
- Download
- https://sanctionslistservice.ofac.treas.gov/api/download/SDN_ADVANCED.XML
- Projected fields
- record_key, fixed_ref, list_id, list_name, party_type, primary_name, programs, listing_date
- Cadence
- Monthly (1st of month)
- Cron
- 0 6 1 * * — 1st of every month at 06:00 UTC
- Methodology
- v2026.05.0
- Schema
- v2026.05.0
- Download
- https://oig.hhs.gov/exclusions/downloadables/UPDATED.csv
- Projected fields
- npi, exclusion_type, exclusion_date
- Cadence
- Monthly (PHMSA/DOT metadata lists R/P1M)
- Cron
- Manual: npx tsx scripts/research/phmsa-ingest.ts --write — Manual: npx tsx scripts/research/phmsa-ingest.ts --write
- Methodology
- phmsa-pipeline-enforcement/v1
- Schema
- v2026.06.0
- Download
- https://data.transportation.gov/Pipelines-and-Hazmat/Pipeline-Enforcement-Transparency-Portal/m28n-9ah6
- Projected fields
- case_number, operator_id, operator_name, region, pipeline_type, case_type, case_status, opened_date, closed_date, proposed_penalties, assessed_penalties, collected_penalties, data_as_of
- Cadence
- Daily (re-check; SEC EDGAR posts filings continuously intraday)
- Cron
- Manual: npx tsx scripts/research/sec-edgar-ingest.ts — Manual: npx tsx scripts/research/sec-edgar-ingest.ts
- Methodology
- sec-edgar/v1
- Schema
- v2026.06.0
- Download
- https://www.sec.gov/files/company_tickers.json
- Projected fields
- cik, entity_name, ticker, sic_code, state, accession_number, form_type, filing_date, report_date
- Cadence
- Daily (SEC enforcement releases post throughout the month)
- Cron
- Manual: npx tsx scripts/research/sec-enforcement-ingest.ts — Manual: npx tsx scripts/research/sec-enforcement-ingest.ts
- Methodology
- sec-enforcement/v1
- Schema
- v2026.06.0
- Download
- https://www.sec.gov/enforcement-litigation/litigation-releases
- Projected fields
- release_category, release_number, release_numbers, aaer_number, published_at, publish_date, respondents, action_url, source_page_url
- Cadence
- Daily (the IAPD compilation feeds regenerate on each business day)
- Cron
- Manual: npx tsx scripts/research/sec-iapd-ingest.ts — Manual: npx tsx scripts/research/sec-iapd-ingest.ts
- Methodology
- sec-iapd/v1
- Schema
- v2026.06.0
- Download
- https://reports.adviserinfo.sec.gov/reports/CompilationReports/CompilationReports.manifest.json
- Projected fields
- crd, sec_number, firm_legal_name, firm_type, registration_status, individual_crd, individual_name, current_employer
- Cadence
- Daily (OFSI republishes the consolidated list on each designation change)
- Cron
- Manual: npx tsx scripts/research/uk-sanctions-ingest.ts — Manual: npx tsx scripts/research/uk-sanctions-ingest.ts
- Methodology
- uk-sanctions/v1
- Schema
- v2026.06.0
- Download
- https://ofsistorage.blob.core.windows.net/publishlive/2022format/ConList.xml
- Projected fields
- record_key, group_id, regime, party_type, primary_name, uk_sanctions_list_ref, listing_type, designation_date
- Cadence
- Daily (the UN regenerates the consolidated export on each committee listing change)
- Cron
- Manual: npx tsx scripts/research/un-sanctions-ingest.ts — Manual: npx tsx scripts/research/un-sanctions-ingest.ts
- Methodology
- un-sanctions/v1
- Schema
- v2026.06.0
- Download
- https://scsanctions.un.org/resources/xml/en/consolidated.xml
- Projected fields
- record_key, un_data_id, reference_number, committee, party_type, primary_name, listed_on
- Cadence
- Monthly archive refresh
- Cron
- Manual: npx tsx scripts/research/usaspending-award-transactions-ingest.ts --write --limit 500 — Manual: npx tsx scripts/research/usaspending-award-transactions-ingest.ts --write --limit 500
- Methodology
- usaspending-award-transactions/v1
- Schema
- v2026.06.0
- Download
- https://www.usaspending.gov/download_center/award_data_archive
- Projected fields
- award_unique_key, transaction_unique_key, recipient_uei, recipient_name, award_category, award_type_code, award_type_description, awarding_agency_name, funding_agency_name, federal_action_obligation, total_obligation, action_date, last_modified_date, assistance_listing_number, naics_code, product_or_service_code
- Cadence
- Weekly (USPTO grants patents weekly on Tuesdays; PTAB + TSDR update continuously)
- Cron
- Manual: npx tsx scripts/research/uspto-ingest.ts — Manual: npx tsx scripts/research/uspto-ingest.ts
- Methodology
- uspto/v1
- Schema
- v2026.06.0
- Download
- https://api.uspto.gov/api/v1/patent/applications/search
- Projected fields
- patent_number, invention_title, patent_type, grant_date, serial_number, registration_number, mark_text, proceeding_number, proceeding_type, respondent_patent_number, petitioner_party_name
- /freshness — live snapshot age + status band per source.
- /methodology/changelog — methodology version-bump log; one citeable URL per bump.
- /trust/integrity — public SHA-256 attestation index per snapshot.
- /developer/webhooks — subscribe to
provider.exclusion_added+provider.enrollment_status_changedevents.