andrewsigal.com
robots.txt

Robots Exclusion Standard data for andrewsigal.com

Resource Scan

Scan Details

Site Domain andrewsigal.com
Base Domain andrewsigal.com
Scan Status Ok
Last Scan2025-07-17T03:03:52+00:00
Next Scan 2025-07-24T03:03:52+00:00

Last Scan

Scanned2025-07-17T03:03:52+00:00
URL http://andrewsigal.com/robots.txt
Redirect https://www.sigal.org/robots.txt
Redirect Domain www.sigal.org
Redirect Base sigal.org
Domain IPs 2001:8d8:100f:f000::200, 217.160.0.30
Redirect IPs 74.208.216.158
Response IP 74.208.216.158
Found Yes
Hash a2f7ecbb17c92df60ebd6dd6a5bd9c6be4dee7c7197a681c9950ca25e6373e7b
SimHash f842e8a42d90

Groups

*

Rule Path
Disallow /awstats
Disallow /anonymous
Disallow /cgi-bin
Disallow /graphics
Disallow /Img
Disallow /Old
Disallow /private
Disallow /public
Disallow /stats
Disallow /ThaiCooking