spidersbot.com
robots.txt

Robots Exclusion Standard data for spidersbot.com

Resource Scan

Scan Details

Site Domain spidersbot.com
Base Domain spidersbot.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-10-15T04:46:11+00:00
Next Scan 2025-10-29T04:46:11+00:00

Last Successful Scan

Scanned2025-09-07T04:28:55+00:00
URL https://spidersbot.com/robots.txt
Domain IPs 68.178.229.108
Response IP 68.178.229.108
Found Yes
Hash 71d3ca61f48dc4ee5bd18abe5c7439b0ab96a70ee5a1f933dc5abd1c3a8277a5
SimHash 61008c40cbb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://spidersbot.com/wp-sitemap.xml