pythonbytesize.com
robots.txt

Robots Exclusion Standard data for pythonbytesize.com

Resource Scan

Scan Details

Site Domain pythonbytesize.com
Base Domain pythonbytesize.com
Scan Status Ok
Last Scan7/1/2025, 6:22:13 PM
Next Scan 7/8/2025, 6:22:13 PM

Last Scan

Scanned7/1/2025, 6:22:13 PM
URL https://pythonbytesize.com/robots.txt
Redirect https://www.pythonbytesize.com/robots.txt
Redirect Domain www.pythonbytesize.com
Redirect Base pythonbytesize.com
Domain IPs 199.34.228.47
Redirect IPs 199.34.228.47
Response IP 199.34.228.47
Found Yes
Hash a011be432a6693d6644349b0b7c07917e923936dd4ac505b59ed11bd65237f04
SimHash 2b56d8fa6f93

Groups

nerdybot

Rule Path
Disallow /

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /ajax/
Disallow /apps/
Disallow /http%3A//www.johnphilipjones.com/donate.html
Disallow /http%3A//www.johnphilipjones.com/index.html
Disallow /http%3A//MathsEasyAspie.com

Other Records

Field Value
sitemap https://www.pythonbytesize.com/sitemap.xml