Skip to content

Add CSB 311 dashboard (minimal changes) - #79

Open
bhuelsman wants to merge 7 commits into
mainfrom
csb-dashboard-minimal
Open

Add CSB 311 dashboard (minimal changes)#79
bhuelsman wants to merge 7 commits into
mainfrom
csb-dashboard-minimal

Conversation

@bhuelsman

@bhuelsman bhuelsman commented Dec 8, 2025

Copy link
Copy Markdown
Contributor

"Closing this PR as requested. Created new PR #69 with minimal changes that only add CSB functionality without modifying existing code structure."

  • Added /csb-dashboard route (frontend page)
  • Added /csb API endpoint (JSON data)
  • Added csb.htm dashboard file
  • Added csb_full_pipeline.py for data ingestion
  • Added link to index page

How to Run

Run docker containers

1. Load CSB and JSON Data (one-time setup)

cd src/write_service/consumers
python3 csb_full_pipeline.py
python3 json_consumer.py

Output: ✓ Pipeline complete! Active records: 92

2. Start Backend

FROM PROJECT ROOT

python3 -m src.read_service.app 

Server runs on: http://localhost:5001

If there are issues, likely with docker, change app.py to run on 5003 and run app again and go to: http://localhost:5003

3. Access the Application

For Non-Technical Users:

For Developers:

Dashboard Capabilities

  • Real-time filtering: Search across service names, descriptions, and neighborhoods
  • Ward filtering: View requests by specific ward (01-14)
  • Service type filtering: Filter by service categories (sidewalk repair, tree inspection, etc.)
  • Statistics: Live counts of total requests, service types, and wards
  • Data attribution: Links to original St. Louis Open Data source

Data Pipeline Features

  • Single command: One script handles download → process → store
  • Automatic cleanup: Uses temp directories, no CSV files in codebase
  • Incremental updates: Marks old data inactive, adds new data
  • Error handling: Robust parsing of various date formats
  • Batch processing: Efficient bulk inserts (1000 records at a time)

- Added /csb-dashboard route (frontend page)
- Added /csb API endpoint (JSON data)
- Added csb.htm dashboard file
- Added csb_full_pipeline.py for data ingestion
- Added link to index page
@bhuelsman
bhuelsman requested a review from premkiran2 December 8, 2025 16:30
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant