telepolis.de
robots.txt

Robots Exclusion Standard data for telepolis.de

Resource Scan

Scan Details

Site Domain telepolis.de
Base Domain telepolis.de
Scan Status Ok
Last Scan2024-11-02T19:34:19+00:00
Next Scan 2024-11-09T19:34:19+00:00

Last Scan

Scanned2024-11-02T19:34:19+00:00
URL https://www.telepolis.de/robots.txt
Domain IPs 193.99.144.85, 2a02:2e0:3fe:1001:7777:772e:2:85
Response IP 193.99.144.85
Found Yes
Hash 1eed3b071c270ff4cd015ffd524c80c8213ead08e0be7d77dde75def05d9f90f
SimHash 6814da24c511

Groups

*

Rule Path
Disallow /api/
Disallow /forum/
Disallow /sso/

ccbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.telepolis.de/sitemap.xml
sitemap https://www.telepolis.de/sitemap.xml?page=2
sitemap https://www.telepolis.de/sitemap.xml?page=3
sitemap https://www.telepolis.de/sitemap.xml?page=4
sitemap https://www.telepolis.de/sitemap.xml?page=5
sitemap https://www.telepolis.de/sitemap.xml?page=6
sitemap https://www.telepolis.de/sitemap.xml?page=7
sitemap https://www.telepolis.de/sitemap.xml?page=8
sitemap https://www.telepolis.de/sitemap.xml?page=9