Log In Sign Up

belleslettres.eu
robots.txt

Robots Exclusion Standard data for belleslettres.eu

Resource Scan

Scan Details

Site Domain belleslettres.eu
Base Domain belleslettres.eu
Scan Status Ok
Last Scan2024-11-04T22:35:54+00:00
Next Scan 2024-12-04T22:35:54+00:00

Last Scan

Scanned2024-11-04T22:35:54+00:00
URL https://belleslettres.eu/robots.txt
Redirect https://www.belleslettres.eu/robots.txt
Redirect Domain www.belleslettres.eu
Redirect Base belleslettres.eu
Domain IPs 2a00:1169:103:f600::, 92.205.53.55
Redirect IPs 2a00:1169:103:f600::, 92.205.53.55
Response IP 92.205.53.55
Found Yes
Hash cd49992e7eadf8b725d1c30da873c5e5f954777cc56a8fc1cac2e8d63d053cd1
SimHash 365d80424b36

Groups

*

Rule Path
Allow /
Disallow /img/elements/
Disallow /error/

googlebot

Rule Path
Allow /
Disallow /img/elements/

googlebot-mobile

Rule Path
Allow /
Disallow /img/elements/

googlebot-image

Rule Path
Allow /
Disallow /img/elements/

bingbot

Rule Path
Disallow /

msnbot

Rule Path
Allow /
Disallow /index.php
Disallow /

backlink-check.de

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

bot-pge.chlooe.com/1.0.0

Rule Path
Disallow /

cms crawler

Rule Path
Disallow /

euripbot/2.0

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

lb-spider

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

magpie-crawler/1.1

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

openbot

Rule Path
Disallow /

pagesinventory.com

Rule Path
Disallow /

psbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

scopia crawler

Rule Path
Disallow /

scopia crawler 1.2

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

searchpreview

Rule Path
Disallow /

semager

Rule Path
Disallow /

seodat

Rule Path
Disallow /

seoengbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

true_robot

Rule Path
Disallow /

uptimebot/1.0

Rule Path
Disallow /

url control

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

wer-liefert-was crawler

Rule Path
Disallow /

wevikabot

Rule Path
Disallow /

xovi

Rule Path
Disallow /

yandexmedia/3.0

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.belleslettres.eu/sitemap.php
sitemap https://www.belleslettres.eu/video.php
Back to top

Warnings

  • 1 invalid line.
Back to top