herbexaminer.com
robots.txt

Robots Exclusion Standard data for herbexaminer.com

Resource Scan

Scan Details

Site Domain herbexaminer.com
Base Domain herbexaminer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-07T23:32:50+00:00
Next Scan 2026-03-07T23:32:50+00:00

Last Successful Scan

Scanned2025-02-17T07:11:50+00:00
URL http://herbexaminer.com/robots.txt
Redirect http://www.herbexaminer.com/robots.txt
Redirect Domain www.herbexaminer.com
Redirect Base herbexaminer.com
Domain IPs 2406:da18:9d0:143f:2124:4e9c:36a9:d9de, 52.221.42.138
Redirect IPs 104.21.59.143, 172.67.179.74, 2606:4700:3030::6815:3b8f, 2606:4700:3031::ac43:b34a
Response IP 172.67.179.74
Found Yes
Hash 8dab68ff259111742efe2cfdbe46a0fa23ebd1e1cbd0d23b69a115b2b26c53eb
SimHash 410048000bb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.herbexaminer.com/sitemap.xml