cricum.com
robots.txt
Robots Exclusion Standard data for cricum.com
Resource Scan
Scan Details
Site Domain | cricum.com |
Base Domain | cricum.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-12T11:31:03+00:00 |
Next Scan | 2024-11-26T11:31:03+00:00 |
Last Successful Scan
Scanned | 2024-10-27T23:55:02+00:00 |
URL | https://cricum.com/robots.txt |
Domain IPs | 13.33.88.55, 13.33.88.75, 13.33.88.76, 13.33.88.97 |
Response IP | 13.33.88.97 |
Found | Yes |
Hash | 97f0ce403df38c12e2616975ccf2fee7da5052a1c2e26a214d560ddb6c492f8b |
SimHash | 6848da62edf3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /site_join |
Disallow | /site_join_agree |
Disallow | /login |
Disallow | /logout.cm |
Disallow | /shop_cart |
Disallow | /?mode* |
Other Records
Field | Value |
---|---|
sitemap | https://cricum.com/sitemap.xml |