Log In Sign Up

headstartphuket.com
robots.txt

Robots Exclusion Standard data for headstartphuket.com

Resource Scan

Scan Details

Site Domain headstartphuket.com
Base Domain headstartphuket.com
Scan Status Ok
Last Scan2025-07-27T01:12:28+00:00
Next Scan 2025-08-26T01:12:28+00:00

Last Scan

Scanned2025-07-27T01:12:28+00:00
URL https://headstartphuket.com/robots.txt
Domain IPs 104.21.9.241, 172.67.131.20, 2606:4700:3031::ac43:8314, 2606:4700:3037::6815:9f1
Response IP 104.21.9.241
Found Yes
Hash a240080815087b5a9032d9e316b4d75abec0b613696a6a42c45dc516472cb3c1
SimHash aa840d856570

Groups

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://headstartphuket.com/sitemap.xml
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-agent: *
  • Disallow: /
Back to top