jhrefs.com
robots.txt

Robots Exclusion Standard data for jhrefs.com

Resource Scan

Scan Details

Site Domain jhrefs.com
Base Domain jhrefs.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-02-18T13:32:27+00:00
Next Scan 2025-05-19T13:32:27+00:00

Last Successful Scan

Scanned2023-11-12T13:06:39+00:00
URL https://jhrefs.com/robots.txt
Domain IPs 104.21.44.91, 172.67.198.59, 2606:4700:3033::ac43:c63b, 2606:4700:3036::6815:2c5b
Response IP 104.21.44.91
Found Yes
Hash 5306d0f73edcf38a3085dae8ecc45a32d38fa774c2b7f864e53fcc85ba58b9b9
SimHash 4900c8000d92

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://jhrefs.com/sitemap_index.xml