Skip to content

fix(data): prevent truncated global catalogs and add evidence-based stream checks - #142

Merged
SamoTech merged 19 commits into
mainfrom
fix/stream-source-health-and-catalog-guard
Nov 19, 2026
Merged

SamoTech merged 19 commits into
mainfrom
fix/stream-source-health-and-catalog-guard

Conversation

@SamoTech

Copy link
Copy Markdown
Owner

Scope

Implements worldwide radio sources maintenance (ROADMAP P2-3/G-07 plus catalog reliability safeguards). No new unverified upstream and no mobile UI/sitemap changes.

  • Baseline report at docs/RADIO_SOURCES_AUDIT_2026-11-19.md: 60,732 total, historic 1,185 checked / 1,071 alive (not verified audio), 26 official + 106 Arabic curated.
  • Quarantine a new station snapshot if it drops >20% versus previous; reject invalid canonical URLs, duplicates or excluded-country rows before replacing previous catalog.
  • Add Python stdlib-only, safe incremental stream quality evidence sampler: 48 URLs on each daily update, curated + previous failure prioritization + rotated global sample, 2KiB reads, timeout, DNS+redirect blocking, one playlist hop, audio signatures, conservative HLS status, evidence score, 3-failure threshold.
  • Report in data/stream_quality.json; legacy UI stream_checks.json, IDs, favorites and player unchanged.
  • New regression tests for safety, redirects, codecs, invalid content, thresholds and catalog rollback.
  • README and ROADMAP updated in same PR.

Risk / release

New evidence is sampled, not an estimate of global playability. HLS manifests are not full media decode. No station deleted. Python network timeout bounded. Existing scheduled workflow deploy should produce quality report on next station refresh; verify CI before squash merge.

@SamoTech
SamoTech merged commit 07cbfd5 into main Nov 19, 2026
2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant