shop.flixbus.cz
robots.txt

Robots Exclusion Standard data for shop.flixbus.cz

Resource Scan

Scan Details

Site Domain shop.flixbus.cz
Base Domain flixbus.cz
Scan Status Ok
Last Scan2024-09-14T00:35:49+00:00
Next Scan 2024-09-28T00:35:49+00:00

Last Scan

Scanned2024-09-14T00:35:49+00:00
URL https://shop.flixbus.cz/robots.txt
Domain IPs 52.222.144.112, 52.222.144.24, 52.222.144.37, 52.222.144.60
Response IP 3.164.206.103
Found Yes
Hash a7b0c8159404667d2c0f9c8fa2e37f766d6d4b7ddb94d58d4861423a0ef669fe
SimHash 4004c4428233

Groups

bytespider

Rule Path
Disallow /

*

Rule Path
Allow /$
Disallow /

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449
  • Explicitly target tiktok bots