Log In Sign Up

hostgator.cl
robots.txt

Robots Exclusion Standard data for hostgator.cl

Resource Scan

Scan Details

Site Domain hostgator.cl
Base Domain hostgator.cl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-03-06T04:37:37+00:00
Next Scan 2026-06-04T04:37:37+00:00

Last Successful Scan

Scanned2025-07-16T12:50:53+00:00
URL https://hostgator.cl/robots.txt
Redirect https://www.hostgator.cl/robots.txt
Redirect Domain www.hostgator.cl
Redirect Base hostgator.cl
Domain IPs 104.21.71.112, 172.67.144.126, 2606:4700:3033::6815:4770, 2606:4700:3035::ac43:907e
Redirect IPs 104.21.71.112, 172.67.144.126, 2606:4700:3033::6815:4770, 2606:4700:3035::ac43:907e
Response IP 104.21.71.112
Found Yes
Hash 99caf702725498fca97fa31c3c4d6fbfef2191d3d80f07c7d390caf36196748b
SimHash 69149946c612

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

siteauditbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

gptbot

Rule Path
Allow /

applebot

Rule Path
Allow /

bytespider

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

oai-searchbot

Rule Path
Allow /

ccbot

Rule Path
Allow /

amazonbot

Rule Path
Allow /

claudebot

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

nicecrawler

Rule Path
Allow /

*

Rule Path
Disallow /sac-registro

*

Rule Path
Disallow /*?itm*

*

Rule Path
Disallow /*?*

*

Rule Path
Disallow /busca?*
Back to top

Other Records

Field Value
sitemap https://www.hostgator.cl/sitemap.xml
Back to top

Comments

  • *
  • Googlebot
  • Googlebot-Image
  • Mediapartners-Google
  • Adsbot-Google
  • SiteAuditBot
  • ChatGPT-User
  • GPTBot
  • Applebot
  • Bytespider
  • PerplexityBot
  • OAI-SearchBot
  • CCBot
  • Amazonbot
  • ClaudeBot
  • archive.org_bot
  • Nicecrawler
  • *
  • *
  • *
  • *
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top