datahawk.co
robots.txt

Robots Exclusion Standard data for datahawk.co

Resource Scan

Scan Details

Site Domain datahawk.co
Base Domain datahawk.co
Scan Status Ok
Last Scan2025-08-16T04:27:15+00:00
Next Scan 2025-09-15T04:27:15+00:00

Last Scan

Scanned2025-08-16T04:27:15+00:00
URL https://datahawk.co/robots.txt
Domain IPs 104.21.8.209, 172.67.130.164, 2606:4700:3035::ac43:82a4, 2606:4700:3037::6815:8d1
Response IP 172.67.130.164
Found Yes
Hash cfa8cbcf5fbd3aa57a89f9004ad163f48cc089f3dd5b5cd165db0573d8a28665
SimHash 4c7448c4e8ba

Groups

*

Rule Path
Disallow /wp-content/uploads/2025/07/ROI-Whitepaper-Layout.pdf

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://datahawk.co/sitemap_index.xml

Comments

  • Block specific PDF from all crawlers
  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK