Log In Sign Up

tennet.eu
robots.txt

Robots Exclusion Standard data for tennet.eu

Resource Scan

Scan Details

Site Domain tennet.eu
Base Domain tennet.eu
Scan Status Ok
Last Scan2025-10-15T02:42:48+00:00
Next Scan 2025-10-16T02:42:48+00:00

Last Scan

Scanned2025-10-15T02:42:48+00:00
URL https://tennet.eu/robots.txt
Redirect https://www.tennet.eu/robots.txt
Redirect Domain www.tennet.eu
Redirect Base tennet.eu
Domain IPs 104.20.37.222, 172.66.164.90, 2606:4700:10::6814:25de, 2606:4700:10::ac42:a45a
Redirect IPs 104.20.37.222, 172.66.164.90, 2606:4700:10::6814:25de, 2606:4700:10::ac42:a45a
Response IP 104.20.37.222
Found Yes
Hash 42a2fdfb564ec34755a5bf1f29a10bcbfbb1a1efaa7b6b96d187757595c77419
SimHash 701a4950c007

Groups

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Back to top

Other Records

Field Value
sitemap https://www.tennet.eu/sitemap.xml
Back to top

Comments

  • https://www.cyberciti.biz/web-developer/block-openai-bard-bing-ai-crawler-bots-using-robots-txt-file/
  • original
Back to top