Skip to content

Ingestion using Cron job with Bash #2

Description

@jonathan-kee

Inspiration
https://medium.com/@walkable-llc/scheduled-backups-with-rsync-e06725246df4

How do I make sure Postgres can pickup on new csv files? Do I need a server for that?

Example of how it should look like:

  1. market_depth_raw_20260726.csv
  2. market_depth_raw_20260727.csv
  3. market_depth_raw_20260728csv

Try to use Airflow for this

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

Status
In Progress

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions