savana.travel
robots.txt

Robots Exclusion Standard data for savana.travel

Archived Snapshots

Resource Scan

Scan Details

Site Domain	savana.travel
Base Domain	savana.travel
Scan Status	Ok
Last Scan	2024-09-21T16:17:02+00:00
Next Scan	2024-10-21T16:17:02+00:00

Last Scan

Scanned	2024-09-21T16:17:02+00:00
URL	https://savana.travel/robots.txt
Domain IPs	185.24.221.2
Response IP	185.24.221.2
Found	Yes
Hash	2e936c8e0b0ce23677baa8f52588ae10138afe70f85ede125aa6bbc40c98b639
SimHash	16554d036d99

Groups

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mauibot

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.com

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

webmeup-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

webmeup crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandex robot

Rule	Path
Disallow	/

Rule

Path

Disallow

yandex

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

adsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot/2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

Rule	Path
Disallow	/

Rule

Path

Disallow

zoombot

Rule	Path
Disallow	/

Rule

Path

Disallow

zoominfobot

Rule	Path
Disallow	/

Rule

Path

Disallow

zumbot

Rule	Path
Disallow	/

Rule

Path

Disallow

newspaper robot

Rule	Path
Disallow	/

Rule

Path

Disallow

newspaper

Rule	Path
Disallow	/

Rule

Path

Disallow

crawl.sogou.com

Rule	Path
Disallow	/

Rule

Path

Disallow

sogouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider

Rule	Path
Disallow	/

Rule

Path

Disallow

netestate

Rule	Path
Disallow	/

Rule

Path

Disallow

netestate ne crawler (+http://www.website-datenbank.de/)

Rule	Path
Disallow	/

Rule

Path

Disallow

seekport crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

coccocbot

Rule	Path
Disallow	/

Rule

Path

Disallow

clark-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

clark-crawler2

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

indeedbot

Rule	Path
Disallow	/

Rule

Path

Disallow

komodiabot

Rule	Path
Disallow	/

Rule

Path

Disallow

komodiabot/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

savana.travelrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

mj12bot

semrushbot

semrushbot-sa

ahrefsbot

dotbot

dotbot

mauibot

petalbot

megaindex.ru/2.0

megaindex.ru

megaindex.ru

megaindex.com

blexbot

webmeup-crawler

webmeup crawler

yandexbot

yandex robot

yandex

barkrowler

adsbot

mail.ru_bot

mail.ru_bot/2.0

mail.ru

mail.ru_bot/2.0; +http://go.mail.ru/help/robots

zoombot

zoominfobot

zumbot

newspaper robot

newspaper

crawl.sogou.com

sogouspider

sogou web spider

sogou spider

netestate

netestate ne crawler (+http://www.website-datenbank.de/)

seekport crawler

seokicks

seokicks-robot

coccocbot

clark-crawler

clark-crawler2

seznambot

scrapy

nutch

indeedbot

komodiabot

komodiabot/1.0

savana.travel
robots.txt