top-themen.t-online.de
robots.txt

Robots Exclusion Standard data for top-themen.t-online.de

Resource Scan

Scan Details

Site Domain top-themen.t-online.de
Base Domain t-online.de
Scan Status Ok
Last Scan2024-09-26T15:59:58+00:00
Next Scan 2024-10-03T15:59:58+00:00

Last Scan

Scanned2024-09-26T15:59:58+00:00
URL https://top-themen.t-online.de/robots.txt
Redirect https://www.t-online.de/robots.txt
Redirect Domain www.t-online.de
Redirect Base t-online.de
Domain IPs 34.246.241.220, 52.209.116.123, 54.217.253.146
Redirect IPs 13.226.2.115, 13.226.2.51, 13.226.2.53, 13.226.2.86, 2600:9000:23d0:2800:f:f903:2f40:93a1, 2600:9000:23d0:4000:f:f903:2f40:93a1, 2600:9000:23d0:7800:f:f903:2f40:93a1, 2600:9000:23d0:8600:f:f903:2f40:93a1, 2600:9000:23d0:9000:f:f903:2f40:93a1, 2600:9000:23d0:c000:f:f903:2f40:93a1, 2600:9000:23d0:d400:f:f903:2f40:93a1, 2600:9000:23d0:e00:f:f903:2f40:93a1
Response IP 52.85.49.18
Found Yes
Hash bd18094ba62ce03fa47a1dbe5d5e6a475d0e88dfb0a4e7759c9d1a8d425e1845
SimHash 483862b6abf3

Groups

*

Rule Path
Disallow /native/
Disallow /auth/
Disallow /?artid
Disallow /preisvergleich/
Disallow /studiopreview_
Disallow /vid_1/
Disallow /%2Cei%3D
Disallow /%2ClinkId%3D
Disallow /%2Cpt%3DpictureEnlarge
Disallow /%2Cpt%3Dprint
Disallow /%2Cpt%3Dself
Disallow /%2Ctid%3Dprint
Disallow /%2Cvv%3DP5
Disallow /%2Cvv%3Denlarge
Disallow */tid_external_content_proxy/
Disallow /-/id_62530634/tid_tsr_iframe_loginbox/index
Disallow /-/id_62530634/tid_tsr_iframe_loginbox_buzz/index
Disallow /gtm.js
Disallow /metatag/

oai-searchbot

Rule Path
Allow /