clusterdev.it
robots.txt

Robots Exclusion Standard data for clusterdev.it

Resource Scan

Scan Details

Site Domain clusterdev.it
Base Domain clusterdev.it
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-18T17:28:49+00:00
Next Scan 2025-12-17T17:28:49+00:00

Last Successful Scan

Scanned2025-08-20T10:48:53+00:00
URL https://clusterdev.it/robots.txt
Redirect https://www.clusterdev.it/robots.txt
Redirect Domain www.clusterdev.it
Redirect Base clusterdev.it
Domain IPs 89.46.110.19
Redirect IPs 89.46.110.19
Response IP 89.46.110.19
Found Yes
Hash 4599062a0ad6d3c33209a4fd7ecac904e98f8ae9243c5a1b7b7160f87f60b649
SimHash 4101cc400993

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.clusterdev.it/wp-sitemap.xml