cgi-web.net
robots.txt

Robots Exclusion Standard data for cgi-web.net

Resource Scan

Scan Details

Site Domain cgi-web.net
Base Domain cgi-web.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-17T21:23:05+00:00
Next Scan 2025-11-15T21:23:05+00:00

Last Successful Scan

Scanned2023-01-04T16:05:19+00:00
URL https://www.cgi-web.net/robots.txt
Response IP 209.99.64.18
Found Yes
Hash a8b8c6e2e69586a9c4c800bd145c5e016345f7f9355d06e4f5853e24e6421791
SimHash 8c506f486bd2

Groups

*

Rule Path
Disallow /content/*

Comments

  • robots.txt for all our sites