Log In Sign Up

car-2rent.com
robots.txt

Robots Exclusion Standard data for car-2rent.com

Resource Scan

Scan Details

Site Domain car-2rent.com
Base Domain car-2rent.com
Scan Status Ok
Last Scan2024-09-20T19:29:38+00:00
Next Scan 2024-09-27T19:29:38+00:00

Last Scan

Scanned2024-09-20T19:29:38+00:00
URL https://car-2rent.com/robots.txt
Redirect https://www.car-2rent.com/robots.txt
Redirect Domain www.car-2rent.com
Redirect Base car-2rent.com
Domain IPs 217.160.0.99
Redirect IPs 2001:8d8:100f:f000::2e6, 217.160.0.99
Response IP 217.160.0.99
Found Yes
Hash 8ddda06d1481b31a82ca21b58d05b2ae5243398c95e49d9b83fe07d0d5288a6a
SimHash 3a1763005e16

Groups

seekport crawler

Rule Path
Disallow /

cocon.se crawler

Rule Path
Disallow /*?

googlebot

Rule Path
Disallow /*?

googlebot-image

Rule Path
Disallow /*?

googlebot-mobile

Rule Path
Disallow /*?

mediapartners-google

Rule Path
Disallow /*?

msnbot

Rule Path
Disallow /*?

msnbot-media

Rule Path
Disallow /*?

slurp

Rule Path
Disallow /*?

bingbot

Rule Path
Disallow /*?

teoma

Rule Path
Disallow /*?

yandex

Rule Path
Disallow /*?

scoutjet

Rule Path
Disallow /*?

rogerbot

Rule Path
Disallow /*?

baiduspider

Rule Path
Disallow /*?

rotbozilla

Rule Path
Disallow /*?

scoutjet

Rule Path
Disallow /*?

petalbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

ng/2.0

Rule Path
Disallow /

crystalsemantics

Rule Path
Disallow /

f-six

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

scrapybot

Rule Path
Disallow /

vocusbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

ezooms.bot

Rule Path
Disallow /

skimlinks.com

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

wikiwix-bot

Rule Path
Disallow /

crystalsemantics

Rule Path
Disallow /

semantissimo

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

lemonsources

Rule Path
Disallow /

discobot

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

netseer

Rule Path
Disallow /

ltbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

language-tools.com

Rule Path
Disallow /

trec-kba-bot

Rule Path
Disallow /

checkprivacy.or.kr

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

socialradarbot

Rule Path
Disallow /

havij

Rule Path
Disallow /

proximic

Rule Path
Disallow /

mireobot

Rule Path
Disallow /

brandwatch

Rule Path
Disallow /

seoprofiler

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

bot clicker

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ec2linkfinder

Rule Path
Disallow /

admedia

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

grepnetstat.com

Rule Path
Disallow /

genieo

Rule Path
Disallow /

nerdbynature

Rule Path
Disallow /

genieo

Rule Path
Disallow /

sindup

Rule Path
Disallow /

netseer

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

netseer.com

Rule Path
Disallow /

nagios

Rule Path
Disallow /

linkdex.com

Rule Path
Disallow /

ning/1.0

Rule Path
Disallow /

feedretriever

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

argus presse

Rule Path
Disallow /

ibm ica crawler

Rule Path
Disallow /

nutch agent

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

genieo

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

ip-web-crawler.com

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

linkscrawler

Rule Path
Disallow /

compspybot

Rule Path
Disallow /

netestate

Rule Path
Disallow /

mynutchtest

Rule Path
Disallow /

admantx

Rule Path
Disallow /

genieo.com

Rule Path
Disallow /

mixdata.com

Rule Path
Disallow /

www.wise-guys.nl

Rule Path
Disallow /

www.wesee.com

Rule Path
Disallow /

wesee

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

www.200please.com

Rule Path
Disallow /

ubermetrics-technologies

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

wasalive

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

infohelfer

Rule Path
Disallow /

acoon

Rule Path
Disallow /

webnl

Rule Path
Disallow /

proximic

Rule Path
Disallow /

psbot

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

nutch

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

postpost

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

r6_feedfetcher

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

attentio

Rule Path
Disallow /

admantx

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.car-2rent.com/sitemap/www-sitemap-city.xml
sitemap https://www.car-2rent.com/sitemap/www-agency-sitemap-city.xml
sitemap https://www.car-2rent.com/sitemap/sitemap-city-agency-en-airport.xml
sitemap https://www.car-2rent.com/sitemap/sitemap-city-en-airport.xml
sitemap https://www.car-2rent.com/sitemap/sitemap-country-agency-en.xml
sitemap https://www.car-2rent.com/sitemap/sitemap-country-en.xml
sitemap https://www.car-2rent.com/travel/page-sitemap1.xml
sitemap https://www.car-2rent.com/travel/page-sitemap2.xml
Back to top

Comments

  • Google
  • Google image
  • Google Mobile
  • Google Partenaire
  • Bing
  • Yahoo
  • Bing
  • Ask
  • Yandex (Russian search engine)
  • Blekko.com Search Engine
  • RogerBot Search Engine
  • Baidu Search Engine
  • Robozilla Search Engine
  • Blekko Search Engine
  • Sans interet
  • Bannis
Back to top