sysopt.earthweb.com
robots.txt

Robots Exclusion Standard data for sysopt.earthweb.com

Resource Scan

Scan Details

Site Domain sysopt.earthweb.com
Base Domain earthweb.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-13T14:34:50+00:00
Next Scan 2024-06-11T14:34:50+00:00

Last Successful Scan

Scanned2023-10-23T13:00:54+00:00
URL https://sysopt.earthweb.com/robots.txt
Redirect https://earthweb.com/robots.txt
Redirect Domain earthweb.com
Redirect Base earthweb.com
Domain IPs 172.66.40.216, 172.66.43.40, 2606:4700:3108::ac42:28d8, 2606:4700:3108::ac42:2b28
Redirect IPs 162.159.136.54, 162.159.137.54, 2606:4700:7::a29f:8836, 2606:4700:7::a29f:8936
Response IP 162.159.137.54
Found Yes
Hash 2271a1defff3c1821c682ea37a274d6923d592f040a3869e509fb7ad23ae7465
SimHash 49008c404fb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://earthweb.com/sitemap_index.xml