dwitcher.fr
robots.txt

Robots Exclusion Standard data for dwitcher.fr

Resource Scan

Scan Details

Site Domain dwitcher.fr
Base Domain dwitcher.fr
Scan Status Ok
Last Scan2025-10-28T14:07:42+00:00
Next Scan 2025-11-04T14:07:42+00:00

Last Scan

Scanned2025-10-28T14:07:42+00:00
URL https://dwitcher.fr/robots.txt
Domain IPs 104.21.83.117, 172.67.175.143, 2606:4700:3032::ac43:af8f, 2606:4700:3037::6815:5375
Response IP 104.21.83.117
Found Yes
Hash f66ae9b402ed9561528bc5ebf60767b6986e3911db6ac146357b4ecf5f6492cf
SimHash 5b2e4c024eb8

Groups

ahrefsbot
aspiegelbot
blexbot
barkrowler
dotbot
mj12bot
mauibot
nimbostratus-bot
petalbot
semrushbot
seznambot
sogou
serpstatbot
trendiction
textbulkerbot

Rule Path
Disallow /wp-admin/

Other Records

Field Value
crawl-delay 180

amazonbot
bytespider
ccbot
cohere-ai
facebookbot
omgilibot

Rule Path
Disallow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.dwitcher.fr/wp-sitemap.xml
sitemap https://www.dwitcher.fr/sitemap-news.xml

Comments

  • START YOAST BLOCK
  • ---------------------------
  • ---------------------------
  • END YOAST BLOCK

Warnings

  • 1 invalid line.