spiderx.live
robots.txt

Robots Exclusion Standard data for spiderx.live

Resource Scan

Scan Details

Site Domain spiderx.live
Base Domain spiderx.live
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-02-07T13:02:19+00:00
Next Scan 2025-04-08T13:02:19+00:00

Last Successful Scan

Scanned2024-12-10T12:35:02+00:00
URL https://spiderx.live/robots.txt
Domain IPs 192.64.117.32
Response IP 192.64.117.32
Found Yes
Hash be396317e7c36e001dce09655b3119c63b6f265ffd7f120a834ce08e38a802e4
SimHash 690118404bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://spiderx.live/wp-sitemap.xml