travellocal.com
robots.txt

Robots Exclusion Standard data for travellocal.com

Resource Scan

Scan Details

Site Domain travellocal.com
Base Domain travellocal.com
Scan Status Ok
Last Scan2024-10-18T18:32:21+00:00
Next Scan 2024-11-17T18:32:21+00:00

Last Scan

Scanned2024-10-18T18:32:21+00:00
URL https://travellocal.com/robots.txt
Redirect https://www.travellocal.com:443/robots.txt
Redirect Domain www.travellocal.com
Redirect Base travellocal.com
Domain IPs 34.250.56.136, 54.229.86.31, 63.32.163.71
Redirect IPs 76.76.21.142, 76.76.21.93
Response IP 76.76.21.123
Found Yes
Hash 278ed20a42f6a7c82f582862aaab8bdc18e2d01abfd48d613745668089c5f594
SimHash 4f449c54e4a0

Groups

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /*/customer
Disallow /*/agency-area
Disallow /*/admin
Disallow /*/admin-extensions
Disallow /*/update-request-details-and-create-internal-message
Disallow /*/send-internal-message
Disallow /*/image-selector/load-photos
Disallow /*/ajax/departure-request-message
Disallow /*/trip-boxes/0
Disallow /*trip%3D
Disallow /*startPlanningUrl%3D

Other Records

Field Value
sitemap https://www.travellocal.com/sitemap.xml
sitemap https://www.travellocal.com/server-sitemap.xml?locale=en
sitemap https://www.travellocal.com/server-sitemap.xml?locale=en-gb
sitemap https://www.travellocal.com/server-sitemap.xml?locale=de
sitemap https://www.travellocal.com/en/sitemap.xml

Comments

  • ClaudeBot
  • anthropic-ai
  • Claude-Web
  • GPTBot
  • Google-Extended
  • *
  • Host
  • Sitemaps

Warnings

  • `host` is not a known field.