www2.rdv-libertins.fr
robots.txt

Robots Exclusion Standard data for www2.rdv-libertins.fr

Resource Scan

Scan Details

Site Domain www2.rdv-libertins.fr
Base Domain rdv-libertins.fr
Scan Status Ok
Last Scan2025-11-28T15:31:25+00:00
Next Scan 2025-12-28T15:31:25+00:00

Last Scan

Scanned2025-11-28T15:31:25+00:00
URL https://www2.rdv-libertins.fr/robots.txt
Domain IPs 51.91.247.111
Response IP 51.91.247.111
Found Yes
Hash 29a11f19379f4c4d51a3bec9d3f267fa39377487b64e9c36c820f9aafd494f1b
SimHash 500cd550c790

Groups

mj12bot

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

yandexcalendar

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

yowser

Rule Path
Disallow /

test-bot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www2.rdv-libertins.fr/sitemap.xml

Comments

  • Robots à exclure
  • Général