gonzher.com
robots.txt

Robots Exclusion Standard data for gonzher.com

Resource Scan

Scan Details

Site Domain gonzher.com
Base Domain gonzher.com
Scan Status Ok
Last Scan2025-08-23T23:00:42+00:00
Next Scan 2025-09-22T23:00:42+00:00

Last Scan

Scanned2025-08-23T23:00:42+00:00
URL https://gonzher.com/robots.txt
Redirect https://www.gonzher.com/robots.txt
Redirect Domain www.gonzher.com
Redirect Base gonzher.com
Domain IPs 216.198.79.1, 64.29.17.65
Redirect IPs 216.198.79.1, 216.198.79.65
Response IP 216.198.79.1
Found Yes
Hash bc98115d29243565159ebae811ba8fa61e1c67b9f3ae2ec11a47e6b5dadbeaca
SimHash 419c08d3e3b6

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.gonzher.com/sitemap.xml

Comments

  • Sitemap
  • Crawl-delay
  • Specific bots
  • Disallow certain paths if needed
  • Disallow: /admin/
  • Disallow: /private/