gh-79638: Treat an unreachable robots.txt as "disallow all" (GH-138555)#149541

serhiy-storchaka wants to merge 1 commit intopython:mainpython/cpython:mainfrom

serhiy-storchaka:robotparser-unreachable2serhiy-storchaka/cpython:robotparser-unreachable2Copy head branch name to clipboard