From 585c2e13252994b9e692a61c11a7a9fc0d9621d1 Mon Sep 17 00:00:00 2001 From: Timothy Allard Date: Sun, 2 Aug 2026 10:42:00 -0600 Subject: [PATCH] Add Mydentify AI Crawler Access Checker --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 400705b..578baf4 100644 --- a/README.md +++ b/README.md @@ -200,6 +200,7 @@ A curated list of awesome tools for marketing, development, productivity, and mo * [Lucebox](https://www.lucebox.com/): The computer for local AI. * [Magic Potion](https://www.magicpotion.app/): Visual drag-and-drop tool for building and testing AI prompts easily. * [Miruni](https://www.miruni.io): Streamlines website feedback and tasks for developers and agencies via live collaboration. +* [Mydentify AI Crawler Access Checker](https://mydentify.com/tools/ai-crawler-access-checker): Free check of robots.txt, page-level noindex directives, and common AI crawler rules, with results and limitations. * [Mocha](https://getmocha.com/): Build websites easily from ideas without needing any coding experience. * [Narrow AI](https://www.getnarrow.ai/): Automated Prompt Engineering and Optimization. * [NativeBridge](https://nativebridge.io/): Run native mobile apps in any browser instantly with a single link.