autocadre.com
robots.txt
Robots Exclusion Standard data for autocadre.com
Resource Scan
Scan Details
Site Domain | autocadre.com |
Base Domain | autocadre.com |
Scan Status | Ok |
Last Scan | 2024-09-22T01:32:32+00:00 |
Next Scan | 2024-09-29T01:32:32+00:00 |
Last Scan
Scanned | 2024-09-22T01:32:32+00:00 |
URL | https://autocadre.com/robots.txt |
Redirect | https://www.autocadre.com/robots.txt |
Redirect Domain | www.autocadre.com |
Redirect Base | autocadre.com |
Domain IPs | 51.159.4.155 |
Redirect IPs | 51.159.4.155 |
Response IP | 51.159.4.155 |
Found | Yes |
Hash | 2e55b14d234adf8f9ac88fcd5578e5d66656aeac50131f4e56a8d7a9cf077efb |
SimHash | 633ef223cfcb |
Groups
googlebot
Rule | Path |
---|---|
Allow | /*/*pratique-detail |
Allow | /*pratique-detail |
Allow | /recherche.htm?search= |
Allow | /*forum |
Disallow | /*? |
Disallow | /*% |
Disallow | /scripts/ |
Disallow | /m/ |
Disallow | /mobile/ |
Disallow | /*%26sa%3D |
Disallow | */purge/* |
Disallow | */sites_pros/* |
Disallow | *proIdSitePro* |
Disallow | /pneu-automobile.html |
Disallow | /*actualites-marque/peugeot_j_9 |
Disallow | /*actualites-marque/iveco_35_10 |
Disallow | /*actualites-marque/mazda_b_2500 |
Disallow | /*actualites-marque/voiture-occasion/auto-occasion |
Disallow | /*actualites-marque/ford_c_maxii |
Disallow | /*actualites-marque/-toutes-marques |
Disallow | /*actualites-marque/skoda_yeti_n1 |
Disallow | /*actualites-marque/mitsubishi_pick_up |
Disallow | /*actualites-marque/bmw_320da_tou |
Disallow | /*actualites-marque/ferrari_360_modena |
Disallow | /*actualites-marque/ford_rimor_xgo |
Disallow | /*actualites-marque/bmw_318d_e90 |
Disallow | /*actualites-marque/ford_rimor_xgo |
Disallow | /*actualites-marque/toyota_hi_lux |
Disallow | /*actualites-marque/jeep_grand_chirokie |
Disallow | /*actualites-marque/renault_lux_privi |
Disallow | /*actualites-marque/renault_renault_1 |
Disallow | /*actualites-marque/peugeot_hdi_ludospa |
Disallow | /*actualites-marque/porsche_356_replica |
Disallow | /*actualites-marque/peugeot_206_sw |
Disallow | /*actualites-marque/jaguar_jaguar-x_type |
Disallow | /*actualites-marque/renault_renault_tw2 |
Disallow | /*actualites-marque/marque- |
Disallow | /*actualites-marque/chrysler_new_yorker |
Disallow | /*actualites-marque/caterham_westfield_megabusa |
Disallow | /*actualites-marque/opel_design_ed |
Disallow | /*actualites-marque/toyota_urban_cruiser |
Disallow | /*actualites-marque/autobianchi_autres_modeles |
Disallow | /actualites-marque/marque.html |
Disallow | /*jeep-cherokee-jamboree_ |
Disallow | /*volkswagen-caddy-tpmr_ |
bingbot
Rule | Path |
---|---|
Allow | /*/*pratique-detail |
Allow | /*pratique-detail |
Allow | /recherche.htm?search= |
Disallow | /*? |
Disallow | /*% |
Disallow | /scripts/ |
Disallow | /m/ |
Disallow | /mobile/ |
Disallow | */purge/* |
Disallow | /pneu-automobile.html |
Other Records
Field | Value |
---|---|
crawl-delay | 200 |
yahoo! slurp
Rule | Path |
---|---|
Allow | /*/*pratique-detail |
Allow | /*pratique-detail |
Allow | /recherche.htm?search= |
Disallow | /*? |
Disallow | /*% |
Disallow | /scripts/ |
Disallow | /m/ |
Disallow | /mobile/ |
Disallow | */purge/* |
Disallow | /pneu-automobile.html |
orangebot
Rule | Path |
---|---|
Allow | /*/*pratique-detail |
Allow | /*pratique-detail |
Allow | /recherche.htm?search= |
Disallow | /*? |
Disallow | /*% |
Disallow | /scripts/ |
Disallow | /m/ |
Disallow | /mobile/ |
Disallow | */purge/* |
Disallow | /pneu-automobile.html |
ahrefsbot
Rule | Path |
---|---|
Allow | /*/*pratique-detail |
Allow | /*pratique-detail |
Allow | /recherche.htm?search= |
Disallow | /*? |
Disallow | /*% |
Disallow | /scripts/ |
Disallow | /m/ |
Disallow | /mobile/ |
Disallow | */purge/* |
Disallow | /pneu-automobile.html |
Other Records
Field | Value |
---|---|
crawl-delay | 200 |
apocalxexplorerbot
asterias
backdoorbot/1.0
bizinformation
black hole
blowfish/1.0
botalot
builtbottough
bullseye/1.0
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
disco pump 3.1
dittospyder
dotbot
emailcollector
emailsiphon
emailwolf
erocrawler
extractorpro
flamingo_searchengine
foobot
harvest/1.5
hloader
httplib
httrack
httrack 3.0
humanlinks
igentia
infonavirobot
jennybot
kenjin spider
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lwp-trivial
lwp-trivial/1.34
mata hari
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
mlbot
moget
moget/2.1
ms search 4.0 robot
ms search 5.0 robot
naverbot
netants
netattache
netattache light 1.1
netmechanic
nicerspro
offline explorer
openfind
openfind data gathere
propowerbot/2.14
prowebwalker
psbot
quepasacreep
queryn metasearch
repomonkey
repomonkey bait & tackle/v1.01
rma
sightupbot
sitebot
sitesnagger
sogou web spider
sosospider
spankbot
spanner
speedy
suggybot
superbot
superbot/2.6
suzuran
szukacz/1.4
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
true_robot/1.0
turingos
turnitinbot
urlpouls
urly warning
vci
vci webviewer vci webviewer win32
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webcopy
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webstripper/2.02
webzip
webzip/4.0
wget
wget/1.5.3
wget/1.6
wikiofeedbot
wikiwix-bot-3.0
winhttrack
www-collector-e
xenu's
xenu's link sleuth 1.1c
yacy
yrspider
zeus
baiduspider
zyborg
blexbot
sirdatabot
Rule | Path |
---|---|
Disallow | / |
Comments