autocadre.com
robots.txt

Robots Exclusion Standard data for autocadre.com

Resource Scan

Scan Details

Site Domain autocadre.com
Base Domain autocadre.com
Scan Status Ok
Last Scan2024-09-22T01:32:32+00:00
Next Scan 2024-09-29T01:32:32+00:00

Last Scan

Scanned2024-09-22T01:32:32+00:00
URL https://autocadre.com/robots.txt
Redirect https://www.autocadre.com/robots.txt
Redirect Domain www.autocadre.com
Redirect Base autocadre.com
Domain IPs 51.159.4.155
Redirect IPs 51.159.4.155
Response IP 51.159.4.155
Found Yes
Hash 2e55b14d234adf8f9ac88fcd5578e5d66656aeac50131f4e56a8d7a9cf077efb
SimHash 633ef223cfcb

Groups

mediapartners-google

Rule Path
Disallow

googlebot

Rule Path
Allow /*/*pratique-detail
Allow /*pratique-detail
Allow /recherche.htm?search=
Allow /*forum
Disallow /*?
Disallow /*%
Disallow /scripts/
Disallow /m/
Disallow /mobile/
Disallow /*%26sa%3D
Disallow */purge/*
Disallow */sites_pros/*
Disallow *proIdSitePro*
Disallow /pneu-automobile.html
Disallow /*actualites-marque/peugeot_j_9
Disallow /*actualites-marque/iveco_35_10
Disallow /*actualites-marque/mazda_b_2500
Disallow /*actualites-marque/voiture-occasion/auto-occasion
Disallow /*actualites-marque/ford_c_maxii
Disallow /*actualites-marque/-toutes-marques
Disallow /*actualites-marque/skoda_yeti_n1
Disallow /*actualites-marque/mitsubishi_pick_up
Disallow /*actualites-marque/bmw_320da_tou
Disallow /*actualites-marque/ferrari_360_modena
Disallow /*actualites-marque/ford_rimor_xgo
Disallow /*actualites-marque/bmw_318d_e90
Disallow /*actualites-marque/ford_rimor_xgo
Disallow /*actualites-marque/toyota_hi_lux
Disallow /*actualites-marque/jeep_grand_chirokie
Disallow /*actualites-marque/renault_lux_privi
Disallow /*actualites-marque/renault_renault_1
Disallow /*actualites-marque/peugeot_hdi_ludospa
Disallow /*actualites-marque/porsche_356_replica
Disallow /*actualites-marque/peugeot_206_sw
Disallow /*actualites-marque/jaguar_jaguar-x_type
Disallow /*actualites-marque/renault_renault_tw2
Disallow /*actualites-marque/marque-
Disallow /*actualites-marque/chrysler_new_yorker
Disallow /*actualites-marque/caterham_westfield_megabusa
Disallow /*actualites-marque/opel_design_ed
Disallow /*actualites-marque/toyota_urban_cruiser
Disallow /*actualites-marque/autobianchi_autres_modeles
Disallow /actualites-marque/marque.html
Disallow /*jeep-cherokee-jamboree_
Disallow /*volkswagen-caddy-tpmr_

bingbot

Rule Path
Allow /*/*pratique-detail
Allow /*pratique-detail
Allow /recherche.htm?search=
Disallow /*?
Disallow /*%
Disallow /scripts/
Disallow /m/
Disallow /mobile/
Disallow */purge/*
Disallow /pneu-automobile.html

Other Records

Field Value
crawl-delay 200

yahoo! slurp

Rule Path
Allow /*/*pratique-detail
Allow /*pratique-detail
Allow /recherche.htm?search=
Disallow /*?
Disallow /*%
Disallow /scripts/
Disallow /m/
Disallow /mobile/
Disallow */purge/*
Disallow /pneu-automobile.html

orangebot

Rule Path
Allow /*/*pratique-detail
Allow /*pratique-detail
Allow /recherche.htm?search=
Disallow /*?
Disallow /*%
Disallow /scripts/
Disallow /m/
Disallow /mobile/
Disallow */purge/*
Disallow /pneu-automobile.html

ahrefsbot

Rule Path
Allow /*/*pratique-detail
Allow /*pratique-detail
Allow /recherche.htm?search=
Disallow /*?
Disallow /*%
Disallow /scripts/
Disallow /m/
Disallow /mobile/
Disallow */purge/*
Disallow /pneu-automobile.html

Other Records

Field Value
crawl-delay 200

exabot

Rule Path
Disallow */purge/*

Other Records

Field Value
crawl-delay 200

apocalxexplorerbot
asterias
backdoorbot/1.0
bizinformation
black hole
blowfish/1.0
botalot
builtbottough
bullseye/1.0
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
disco pump 3.1
dittospyder
dotbot
emailcollector
emailsiphon
emailwolf
erocrawler
extractorpro
flamingo_searchengine
foobot
harvest/1.5
hloader
httplib
httrack
httrack 3.0
humanlinks
igentia
infonavirobot
jennybot
kenjin spider
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lwp-trivial
lwp-trivial/1.34
mata hari
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
mlbot
moget
moget/2.1
ms search 4.0 robot
ms search 5.0 robot
naverbot
netants
netattache
netattache light 1.1
netmechanic
nicerspro
offline explorer
openfind
openfind data gathere
propowerbot/2.14
prowebwalker
psbot
quepasacreep
queryn metasearch
repomonkey
repomonkey bait & tackle/v1.01
rma
sightupbot
sitebot
sitesnagger
sogou web spider
sosospider
spankbot
spanner
speedy
suggybot
superbot
superbot/2.6
suzuran
szukacz/1.4
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
true_robot/1.0
turingos
turnitinbot
urlpouls
urly warning
vci
vci webviewer vci webviewer win32
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webcopy
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webstripper/2.02
webzip
webzip/4.0
wget
wget/1.5.3
wget/1.6
wikiofeedbot
wikiwix-bot-3.0
winhttrack
www-collector-e
xenu's
xenu's link sleuth 1.1c
yacy
yrspider
zeus
baiduspider
zyborg
blexbot
sirdatabot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

Comments

  • User-agent: SirdataBot
  • Disallow:
  • Crawl-delay: 50
  • Crawl-delay: 200