douceur-dantan.fr
robots.txt

Robots Exclusion Standard data for douceur-dantan.fr

Resource Scan

Scan Details

Site Domain douceur-dantan.fr
Base Domain douceur-dantan.fr
Scan Status Ok
Last Scan2025-10-01T08:31:12+00:00
Next Scan 2025-10-08T08:31:12+00:00

Last Scan

Scanned2025-10-01T08:31:12+00:00
URL https://douceur-dantan.fr/robots.txt
Domain IPs 104.21.14.171, 172.67.160.22, 2606:4700:3033::ac43:a016, 2606:4700:3034::6815:eab
Response IP 172.67.160.22
Found Yes
Hash f7b10a0d55d41733f52639ef4eb05803fc6f6594edc87f492e52db9ba02b3c56
SimHash 5b6e4c82eab9

Groups

ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

amazonbot
bytespider
ccbot
cohere-ai
facebookbot
omgilibot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.douceur-dantan.fr/wp-sitemap.xml
sitemap https://www.douceur-dantan.fr/sitemap-news.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.