critterculture.com
robots.txt
Robots Exclusion Standard data for critterculture.com
Resource Scan
Scan Details
Site Domain | critterculture.com |
Base Domain | critterculture.com |
Scan Status | Ok |
Last Scan | 2024-10-28T21:26:11+00:00 |
Next Scan | 2024-11-04T21:26:11+00:00 |
Last Scan
Scanned | 2024-10-28T21:26:11+00:00 |
URL | https://critterculture.com/robots.txt |
Domain IPs | 104.18.20.228, 104.18.21.228, 2606:4700::6812:14e4, 2606:4700::6812:15e4 |
Response IP | 104.18.20.228 |
Found | Yes |
Hash | 23b86a884d8bef38de793a0ded13ea51fc9ac56991bc58fff0b153dc913ddd53 |
SimHash | 281d9410cd93 |
Groups
*
Rule | Path |
---|---|
Disallow | /cdn-cgi/* |
Disallow | /wp/* |
Disallow | /app/plugins/* |
Disallow | /wp-json* |
Other Records
Field | Value |
---|---|
sitemap | https://critterculture.com/sitemap-index.xml |