Log In Sign Up

essen.t-online.de
robots.txt

Robots Exclusion Standard data for essen.t-online.de

Resource Scan

Scan Details

Site Domain essen.t-online.de
Base Domain t-online.de
Scan Status Ok
Last Scan2025-12-15T22:36:37+00:00
Next Scan 2025-12-22T22:36:37+00:00

Last Scan

Scanned2025-12-15T22:36:37+00:00
URL https://essen.t-online.de/robots.txt
Domain IPs 13.226.2.101, 13.226.2.66, 13.226.2.85, 13.226.2.87, 2600:9000:2912:2000:10:dddb:a2c0:93a1, 2600:9000:2912:3800:10:dddb:a2c0:93a1, 2600:9000:2912:4800:10:dddb:a2c0:93a1, 2600:9000:2912:6c00:10:dddb:a2c0:93a1, 2600:9000:2912:8c00:10:dddb:a2c0:93a1, 2600:9000:2912:9a00:10:dddb:a2c0:93a1, 2600:9000:2912:aa00:10:dddb:a2c0:93a1, 2600:9000:2912:ec00:10:dddb:a2c0:93a1
Response IP 13.226.2.85
Found Yes
Hash 42b9b584d1a85bf36fd9c6a8cd5644977bc2720fa08909d9a949aefc6740bea0
SimHash a0300512e9f7

Groups

*

Rule Path
Disallow /native/
Disallow /auth/
Disallow /?artid
Disallow /preisvergleich/
Disallow /spiele/weihnachtsspiele/
Disallow /studiopreview_
Disallow /vid_1/
Disallow /%2Cei%3D
Disallow /%2ClinkId%3D
Disallow /%2Cpt%3DpictureEnlarge
Disallow /%2Cpt%3Dprint
Disallow /%2Cpt%3Dself
Disallow /%2Ctid%3Dprint
Disallow /%2Cvv%3DP5
Disallow /%2Cvv%3Denlarge
Disallow */tid_external_content_proxy/
Disallow /-/id_62530634/tid_tsr_iframe_loginbox/index
Disallow /-/id_62530634/tid_tsr_iframe_loginbox_buzz/index
Disallow /gtm.js
Disallow /metatag/
Disallow /ki-ratgeber/
Disallow /api/greenplayer/

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

applebot-extended
bytespider
ccbot
google-extended
meta-externalagent
meta-externalagent

Rule Path
Disallow /
Back to top

Comments

  • this robots.txt is only for essen.t-online.de
  • Legal notice: t-online.de expressly reserves the right to use its content for commercial text and data mining (ยง 44 b UrhG).
  • The use of robots or other automated means to access t-online.de or collect or mine data without
  • the express permission of t-online.de is strictly prohibited.
  • t-online.de may, in its discretion, permit certain automated access to certain t-online.de pages,
  • If you would like to apply for permission to crawl t-online.de, collect or use data, please email t-online@stroeer.de
Back to top