Log In Sign Up

cbi76.fr
robots.txt

Robots Exclusion Standard data for cbi76.fr

Resource Scan

Scan Details

Site Domain cbi76.fr
Base Domain cbi76.fr
Scan Status Ok
Last Scan2024-05-18T23:07:05+00:00
Next Scan 2024-06-17T23:07:05+00:00

Last Scan

Scanned2024-05-18T23:07:05+00:00
URL https://cbi76.fr/robots.txt
Domain IPs 213.186.33.17
Response IP 213.186.33.17
Found Yes
Hash 8e891ec5704b339feb9eac2481eca3c97aaa1d058653d06a0cb50f440c16cb45
SimHash 045f4b40c4c3

Groups

*

Rule Path
Disallow /account
Disallow /contact
Disallow /politique-retour
Disallow /mentions-legales
Disallow /politique-confidentialite
Disallow /conditions-generales-utilisation
Disallow /conditions-generales-ventes
Disallow /etiquette-produit/aastra
Disallow /etiquette-produit/flatron
Disallow /etiquette-produit/nvidia
Disallow /etiquette-produit
Disallow /user/cbi/
Disallow /login

adequat

Rule Path
Disallow /

admantx bot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

corporama

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotmic dotbot

Rule Path
Disallow /

ellisphere

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

fetch

Rule Path
Disallow /

grapeshot bot

Rule Path
Disallow /

houzzbot

Rule Path
Disallow /

infoseek

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

leadbox

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

linko

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

opinion-tracker

Rule Path
Disallow /

proxem

Rule Path
Disallow /

proximic bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spotter

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

verticalsearch

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

winello

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

archive.org_bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

mj12bot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

ahrefsbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

soso spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

sogou spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://www.cbi76.fr/sitemap_index.xml
Back to top

Comments

  • START YOAST BLOCK
  • ---------------------------
  • Bloquage Robots indesirables
  • Ralentissement de robots moins utiles
  • ---------------------------
  • END YOAST BLOCK
Back to top