agentic-browsing

An agentic browser harness: an AI side panel & orb in your own logged-in Chrome, Edge, Arc, Brave or even Firefox run by the agent you already use (Claude Code, Codex, Antigravity). Free, open source, no API key. Also an MCP server.

Readability-inspired heuristic algorithm stripping navigation, footers, ads, and sidebars from web content

HTML table matrix parser extracting column headers and cell rows into structured JSON list of dicts

Readability-inspired heuristic algorithm stripping navigation, footers, ads, and sidebars from web content

RFC 9309 robots.txt parser with path permissions, Disallow/Allow rules, and crawl delay compliance

URL normalizer sorting query parameters, stripping tracking UTM tokens, and deduplicating visited URLs

Pure Python semantic HTML-to-markdown converter preserving headers, links, lists, and formatting without dependencies

HTML table matrix parser extracting column headers and cell rows into structured JSON list of dicts

URL normalizer sorting query parameters, stripping tracking UTM tokens, and deduplicating visited URLs

RFC 9309 robots.txt parser with path permissions, Disallow/Allow rules, and crawl delay compliance

Pure Python semantic HTML-to-markdown converter preserving headers, links, lists, and formatting without dependencies

MCP server for the llms.txt Generator: create, validate and audit llms.txt files - including Google's Lighthouse Agentic Browsing check. Streamable HTTP, no API key.

DGO is a free business operating system for the AI era (basically a free Dots, Muse, and all the others popping up), giving you one fully local, private, and portable place to manage your business and digital life, and the ability to use any accessible computer to scale your business infrastructure.

Turn ordinary HTML forms into declarative WebMCP tool surfaces.

Stable CLI + nav-snapshot bridge for fluid web QA and lawful assisted browsing on login-walled sites. Accessibility JSON snapshots, stale-ref invalidation, qa runner with evidence.

Validate and generate llms.txt, llms-full.txt, llms-ctx, and per-page .md for AI search, GEO/AEO, and Google Lighthouse Agentic Browsing. A Claude skill for the llmstxt.org and Mintlify specs.