Log In Sign Up

cote-du-22.com
robots.txt

Robots Exclusion Standard data for cote-du-22.com

Resource Scan

Scan Details

Site Domain cote-du-22.com
Base Domain cote-du-22.com
Scan Status Ok
Last Scan2024-09-25T23:37:24+00:00
Next Scan 2024-10-02T23:37:24+00:00

Last Scan

Scanned2024-09-25T23:37:24+00:00
URL https://cote-du-22.com/robots.txt
Domain IPs 104.21.65.179, 172.67.165.73, 2606:4700:3030::6815:41b3, 2606:4700:3031::ac43:a549
Response IP 172.67.165.73
Found Yes
Hash 880d0d8c141b93ee0ca74d2afac9bcf599a86c1baf09b5d029dd3da315962d0f
SimHash b95553826e46

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-login.php
Disallow /wp-includes
Disallow /wp-content/plugins
Disallow */trackback
Disallow /*.php$
Disallow /*/feed
Disallow /*/comments
Disallow /*.pdf$
Disallow /?s=
Allow /wp-content/uploads

googlebot

Rule Path
Disallow /*.inc$
Disallow /*.gz$

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

mozilla/5.0

Rule Path
Disallow /

msie 5

Rule Path
Disallow /

phantomjs

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /zoominfobot

msie 6

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

adequat

Rule Path
Disallow /

admantx bot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

corporama

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotmic dotbot

Rule Path
Disallow /

ellisphere

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

fetch

Rule Path
Disallow /

grapeshot bot

Rule Path
Disallow /

houzzbot

Rule Path
Disallow /

infoseek

Rule Path
Disallow /

jetbot

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

leadbox

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

linko

Rule Path
Disallow /

mail.ru bot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

opinion-tracker

Rule Path
Disallow /

proxem

Rule Path
Disallow /

proximic bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

spotter

Rule Path
Disallow /

sputnikbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

verticalsearch

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

wget

Rule Path
Disallow /

winello

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sitecheckerbotcrawler

Rule Path
Disallow /

sitecheckerbotcrawler/1.0

Rule Path
Disallow /

slurp

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou web spider/4.0

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mnsbot

Rule Path
Disallow /

nimbostratus-bot/v1.3.2

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

qwarrycrawler

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

scrapy/1.5.1

Rule Path
Disallow /

scrapy/1.5.1 (+https://scrapy.org)

Rule Path
Disallow /

scrapy/1.5.2

Rule Path
Disallow /

scrapy/1.5.2 (+https://scrapy.org)

Rule Path
Disallow /

semanticscholarbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

grapeshotcrawler/2.0

Rule Path
Disallow /

grapeshotcrawler/2.0; +http://www.grapeshot.co.uk/crawler.php

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

criteobot/0.1 (+https://www.criteo.com/criteo-crawler/)

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /
Back to top

Comments

  • On autorise l'indexation des images
  • Google Image
  • Mediapartners
  • Barkrowler
  • Semrush
  • Semrush
  • Semrush
  • Semrush
  • Semrush
  • Semrush
  • Semrush
  • Semrush
  • BLEXBot
  • Ahref
  • Semrush
  • BLEXBot
  • Ahref
  • Semrush
  • Mozilla
  • MSI
  • Phantom
  • Zoom
  • MSI
Back to top