cref.it
robots.txt

Robots Exclusion Standard data for cref.it

Resource Scan

Scan Details

Site Domain cref.it
Base Domain cref.it
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-26T12:25:21+00:00
Next Scan 2025-11-25T12:25:21+00:00

Last Successful Scan

Scanned2025-09-03T07:03:51+00:00
URL https://cref.it/robots.txt
Redirect https://www.cref.it/robots.txt
Redirect Domain www.cref.it
Redirect Base cref.it
Domain IPs 66.71.160.90
Redirect IPs 66.71.160.90
Response IP 66.71.160.90
Found Yes
Hash 026a570c23b8a928eca67de02d27c084cebd3fb91a1ef8aec82428dc15b8fab3
SimHash 61019c404bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.cref.it/wp-sitemap.xml