mrbrownslearningspace.com
robots.txt

Robots Exclusion Standard data for mrbrownslearningspace.com

Resource Scan

Scan Details

Site Domain mrbrownslearningspace.com
Base Domain mrbrownslearningspace.com
Scan Status Ok
Last Scan2025-09-17T01:12:02+00:00
Next Scan 2025-10-17T01:12:02+00:00

Last Scan

Scanned2025-09-17T01:12:02+00:00
URL https://mrbrownslearningspace.com/robots.txt
Domain IPs 104.21.4.176, 172.67.132.80, 2606:4700:3031::6815:4b0, 2606:4700:3032::ac43:8450
Response IP 104.21.4.176
Found Yes
Hash 944e2386c781315bf1d183637a1b71b4fb97f7585766b3fe0309d76af72dad75
SimHash 0e347830e677

Groups

*

Rule Path
Disallow /search
Disallow /admin
Disallow /search?*
Disallow /search?search=
Disallow /*.pdf$
Disallow /?
Disallow /*?
Disallow /*?page=
Disallow /cgi-bin*
Allow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://mrbrownslearningspace.com/sitemap.xml