mobytrip.com
robots.txt

Robots Exclusion Standard data for mobytrip.com

Resource Scan

Scan Details

Site Domain mobytrip.com
Base Domain mobytrip.com
Scan Status Ok
Last Scan2024-11-19T06:00:08+00:00
Next Scan 2024-11-20T06:00:08+00:00

Last Scan

Scanned2024-11-19T06:00:08+00:00
URL https://mobytrip.com/robots.txt
Domain IPs 104.26.14.101, 104.26.15.101, 172.67.73.198, 2606:4700:20::681a:e65, 2606:4700:20::681a:f65, 2606:4700:20::ac43:49c6
Response IP 172.67.73.198
Found Yes
Hash 0ba3901adcd097298937be2e5530d49992c1883d940437185453c69b3475efdd
SimHash 4096dcd2f394

Groups

mediapartners-google
adsbot-google
adsbot-google-mobile
adidxbot
bingpreview
yandexdirect
yadirectfetcher
baiduspider-ads
seznambot
naverbot
sln24857
googlebot
googlebot-image
google-hoteladsverifier/2.0
google-hoteladsverifier
google-hoteladsverifier
hoteladsverifier

Rule Path
Disallow

Other Records

Field Value
crawl-delay 1

semrushbot
dataforseobot
ahrefsbot

Rule Path
Disallow /

google page speed insights

Rule Path
Disallow

Other Records

Field Value
crawl-delay 3

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://mobytrip.com/sitemap.xml

Comments

  • search engines
  • serp bots
  • tools