blockchainlab-feeds

Public data feeds for blockchainlab.com (Blockchain Lab). Contains only public X post IDs, links, author handles, short trimmed summaries and engagement counts, plus public hackathon listings. No secrets, no private data.

Feed	Path	Raw URL
X intel (24h, clustered)	feeds/x-intel/latest.json, feeds/x-intel/YYYY-MM-DD.json	https://raw.githubusercontent.com/Blockchains/blockchainlab-feeds/main/feeds/x-intel/latest.json
Mentions of Blockchain Lab	feeds/mentions/latest.json	https://raw.githubusercontent.com/Blockchains/blockchainlab-feeds/main/feeds/mentions/latest.json
Hackathons / grants / bounties	feeds/hackathons/latest.json	https://raw.githubusercontent.com/Blockchains/blockchainlab-feeds/main/feeds/hackathons/latest.json
Briefing drafts (review before publishing)	feeds/briefings-drafts/*.md
Events (hackathons + summits)	feeds/events/latest.json	https://raw.githubusercontent.com/Blockchains/blockchainlab-feeds/main/feeds/events/latest.json
Run status	feeds/status/last-run.json

Topics: Ethereum, Bitcoin, Hedera, L2s, DeFi, Regulation, AI x crypto (+ Other). Watchlist: watchlist.json.

Pipeline

The X source is an MCP connector, so it cannot run from cron. A daily routine agent:

1. python3 scripts/fetch_plan.py --date $(date +%F) → list of MCP calls (server user-X).
2. Runs each call via the connector and saves {"name","tool","args","fetched_at","response"} to /workspace/pulse-port/x-intel/raw/<date>/<name>.json (errors saved too).
3. bash scripts/run_daily.sh <date> → build_feeds.py (clusters, mentions, hackathons from Devpost + ETHGlobal, 0-3 briefing drafts, digest HTML/text outside the repo) → gitleaks → commit → push.

Schema notes: unknown counts are null (e.g. when X is unavailable), never 0. x_status is ok or unavailable. Summaries are trimmed from the post's own text; nothing is invented.

Live: the feeds are served as raw JSON (table above) and power blockchains.github.io/events and the Open Data API.

Usage

python3 scripts/fetch_plan.py --date 2026-10-04                       # list the X MCP calls to make
python3 scripts/build_feeds.py --date 2026-10-04 \
  --raw-dir /workspace/pulse-port/x-intel/raw --digest-dir /tmp/digest  # build feeds locally (no push)

Example: curl -s https://raw.githubusercontent.com/Blockchains/blockchainlab-feeds/main/feeds/hackathons/latest.json

Use as a building block

For AI agents and builders: read AGENTS.md (setup, commands, structure, rules), llms.txt (doc map) and the machine-readable blocks.json (schema). How all Blockchains blocks fit together: Build with Blocks · org catalogue: https://blockchains.github.io/blocks.json.

What it exports

Export	Type	Install / access
feeds/hackathons/latest.json	http	items[]: title, url, dates, prize, location, organizer, themes, state, source, verified
feeds/events/latest.json	http	https://raw.githubusercontent.com/Blockchains/blockchainlab-feeds/main/feeds/events/latest.json
feeds/x-intel/latest.json	http	https://raw.githubusercontent.com/Blockchains/blockchainlab-feeds/main/feeds/x-intel/latest.json
scripts/build_feeds.py	cli	python3 scripts/build_feeds.py --date YYYY-MM-DD --raw-dir DIR --digest-dir DIR

Minimal example (live raw URL, checked 2026-10-04)

curl -s https://raw.githubusercontent.com/Blockchains/blockchainlab-feeds/main/feeds/hackathons/latest.json | jq '.items[] | {title, dates, prize, url}'

Inputs → outputs

• In: raw X MCP responses (JSON files) saved by a routine agent; Devpost / ETHGlobal (public pages)
• Out: latest.json per feed (JSON) generated_at, count, items[], errors; unknown counts are null

Composes with

• Blockchains/blockchainlab-api: republishes hackathons and events as API datasets
• Blockchains/blockchains.github.io: powers /events
• Blockchains/hackathons: human tracker of the same events

Versioning & stability: beta. Feed fields are additive; null means unknown (never 0). Prefer the API's hackathons/events datasets for a schema-validated copy.

Configuration

Setting	Default	Purpose
RAW (run_daily.sh) / --raw-dir	/workspace/pulse-port/x-intel/raw	Saved raw X MCP responses
OUT (run_daily.sh) / --digest-dir	/workspace/pulse-port/x-intel	Digest HTML/text and alerts (not committed)
watchlist.json	—	Accounts and topics to track

run_daily.sh runs gitleaks before committing and pushing.

Licence

No licence file has been added yet. Feeds contain only public post IDs, links and short excerpts; rights in the underlying posts stay with their authors.

Contributing

Issues and pull requests are welcome. Please read the contributing guide, code of conduct and security policy first.

---

Built by Blockchain Lab — blockchainlab.com