asug.com
robots.txt

Robots Exclusion Standard data for asug.com

Resource Scan

Scan Details

Site Domain asug.com
Base Domain asug.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-01-02T07:14:05+00:00
Next Scan 2026-04-02T07:14:05+00:00

Last Successful Scan

Scanned2025-06-07T01:55:31+00:00
URL https://asug.com/robots.txt
Redirect https://www.asug.com/robots.txt
Redirect Domain www.asug.com
Redirect Base asug.com
Domain IPs 34.193.6.61, 34.201.253.12
Redirect IPs 34.193.6.61, 34.201.253.12
Response IP 34.193.6.61
Found Yes
Hash 0d30d98df1bb63ec00d06174928baf0be92308e10bc74492f2f9cfc84772a060
SimHash 4d104356df83

Groups

*

Rule Path
Disallow /craft/
Disallow /api/

Comments

  • Don't allow web crawlers to index Craft