Skip to content

Implement Model Evaluation Metrics & Explicit Train/Test Split - #9

Merged
BLMgithub merged 6 commits into
mainfrom
feat/model-tuning
Jun 21, 2026
Merged

Implement Model Evaluation Metrics & Explicit Train/Test Split#9
BLMgithub merged 6 commits into
mainfrom
feat/model-tuning

Conversation

@BLMgithub

Copy link
Copy Markdown
Owner

Restructured the ML pipeline to separate training and holdout datasets, added model evaluation metrics, feature weights, and next-week predictions.

Implemented

  • Model Evaluation: Added predictions_evaluation.sqlx and evaluation_metrics.sqlx to compute and publish forecast accuracy.
  • Train/Test Dataset: Refactored ml_training_data.sqlx and ml_holdout_data.sqlx to enforce explicit temporal holdout boundaries.
  • Feature Weights: Added feature_weights.sqlx to show per-feature contributions from the trained BQML model.
  • Next-Week Prediction: Added predictions_nextweek.sqlx and ml_weekly_data.sqlx for next-week revenue forecasts.

Impact

  • Reliability: Enforced explicit train/holdout split for reproducible out-of-sample validation.
  • Observability: Added 3 views (evaluation_metrics, feature_weights, predictions_nextweek) for Dashboard.

@BLMgithub
BLMgithub merged commit ecb81d3 into main Jun 21, 2026
3 checks passed
@BLMgithub
BLMgithub deleted the feat/model-tuning branch June 21, 2026 13:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant