mysite.com
robots.txt

Robots Exclusion Standard data for mysite.com

Resource Scan

Scan Details

Site Domain mysite.com
Base Domain mysite.com
Scan Status Ok
Last Scan2024-11-06T09:55:32+00:00
Next Scan 2024-11-13T09:55:32+00:00

Last Scan

Scanned2024-11-06T09:55:32+00:00
URL http://mysite.com/robots.txt
Domain IPs 64.136.20.67
Response IP 64.136.20.67
Found Yes
Hash 35d1c181a0c3eccfb0bf15b9061b10f7d4640a7b70e52e8319c0d2b7f31fce07
SimHash 3fe4e7c16497

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /cgi/

Comments

  • Default /robots.txt File for all Community Architect Partner pages