Log In Sign Up

stangl.eu
robots.txt

Robots Exclusion Standard data for stangl.eu

Resource Scan

Scan Details

Site Domain stangl.eu
Base Domain stangl.eu
Scan Status Ok
Last Scan2024-11-15T17:44:12+00:00
Next Scan 2024-11-22T17:44:12+00:00

Last Scan

Scanned2024-11-15T17:44:12+00:00
URL https://stangl.eu/robots.txt
Domain IPs 81.19.159.41
Response IP 81.19.159.41
Found Yes
Hash 285fb259acbbf3491ef10b41b4b678c851f14fdc60aef2c3caf2c99a67ab2b18
SimHash 1a3cdc20dc50

Groups

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /
Back to top

Comments

  • Block bad bots
  • Block OpenAI
  • Block Google Bard AI
  • Block Common Crawl
Back to top