gisthawkers.com
robots.txt

Robots Exclusion Standard data for gisthawkers.com

Resource Scan

Scan Details

Site Domain gisthawkers.com
Base Domain gisthawkers.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-06T13:56:04+00:00
Next Scan 2024-10-13T13:56:04+00:00

Last Successful Scan

Scanned2024-04-20T13:44:00+00:00
URL https://gisthawkers.com/robots.txt
Domain IPs 104.21.91.6, 172.67.163.252, 2606:4700:3033::ac43:a3fc, 2606:4700:3034::6815:5b06
Response IP 104.21.91.6
Found Yes
Hash 011417ed8efb8034758466c0734ce804bf6eb3bdb4a2de34fa19e45fd0967c9c
SimHash 69208800cbb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap http://gisthawkers.com/sitemap_index.xml
sitemap https://gisthawkers.com/post-sitemap.xml