deblan.io
robots.txt

Robots Exclusion Standard data for deblan.io

Resource Scan

Scan Details

Site Domain deblan.io
Base Domain deblan.io
Scan Status Ok
Last Scan2025-10-25T13:41:32+00:00
Next Scan 2025-11-08T13:41:32+00:00

Last Scan

Scanned2025-10-25T13:41:32+00:00
URL https://deblan.io/robots.txt
Redirect https://www.deblan.fr/robots.txt
Redirect Domain www.deblan.fr
Redirect Base deblan.fr
Domain IPs 2a01:cb10:9365:1400:feaa:14ff:fec1:c4d4, 90.100.102.191
Redirect IPs 90.100.102.191
Response IP 90.100.102.191
Found Yes
Hash 2c715fa64a89de8ff6326dd7f1d2bd3a301e01fa93f52bb104c7891e47c4b343
SimHash 220059402133

Groups

*

Rule Path
Allow /
Disallow /generate-captcha/

anthropic-ai
bytespider 🆕
ccbot
chatgpt-user
cohere-ai
facebookbot
google-extended
gptbot
omgilibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.deblan.fr/sitemap.xml

Comments

  • AI crawlers