travelplan.es
robots.txt

Robots Exclusion Standard data for travelplan.es

Resource Scan

Scan Details

Site Domain travelplan.es
Base Domain travelplan.es
Scan Status Ok
Last Scan2025-05-28T05:00:51+00:00
Next Scan 2025-06-27T05:00:51+00:00

Last Scan

Scanned2025-05-28T05:00:51+00:00
URL https://travelplan.es/robots.txt
Domain IPs 52.17.185.124, 54.220.58.189, 54.246.188.156
Response IP 52.17.185.124
Found Yes
Hash 61c427069ca93b4f2a63e39bef0f2c66a93b9915ebf86fcf6c5cf014ac53dbe4
SimHash 6258c8e0eeb3

Groups

*

Rule Path
Allow /*.css
Allow /*.js
Disallow /circuitos/
Disallow /combinados/
Disallow /commons/assets-content/logged
Disallow /ofertas/
Disallow /offers/
Disallow /packages/
Disallow /paginas/

shopwiki
adnettrack
searchtone2.0
leiacrawler
whatsup_gold/5.01
mindcrawler
yandex

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Warnings

  • 2 invalid lines.