kicker.de
robots.txt
Robots Exclusion Standard data for kicker.de
Resource Scan
Scan Details
| Site Domain | kicker.de |
| Base Domain | kicker.de |
| Scan Status | Ok |
| Last Scan | 2024-11-11T05:53:56+00:00 |
| Next Scan | 2024-11-18T05:53:56+00:00 |
Last Scan
| Scanned | 2024-11-11T05:53:56+00:00 |
| URL | https://kicker.de/robots.txt |
| Redirect | https://www.kicker.de/robots.txt |
| Redirect Domain | www.kicker.de |
| Redirect Base | kicker.de |
| Domain IPs | 86.109.250.101 |
| Redirect IPs | 18.161.97.129, 18.161.97.40, 18.161.97.76, 18.161.97.92, 2600:9000:2201:5e00:16:7865:b7c0:93a1, 2600:9000:2201:7400:16:7865:b7c0:93a1, 2600:9000:2201:7c00:16:7865:b7c0:93a1, 2600:9000:2201:7e00:16:7865:b7c0:93a1, 2600:9000:2201:b200:16:7865:b7c0:93a1, 2600:9000:2201:d000:16:7865:b7c0:93a1, 2600:9000:2201:d600:16:7865:b7c0:93a1, 2600:9000:2201:de00:16:7865:b7c0:93a1 |
| Response IP | 52.85.49.117 |
| Found | Yes |
| Hash | b2a1f21801b478cb43c540a654a045d81bd9eb1d20b3325b99a6ec2dd5a68066 |
| SimHash | f8040151b283 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /meinkicker* |
| Disallow | /kickerapi* |
| Disallow | /trim-krasnici* |
| Disallow | /news/fussball* |
| Disallow | /news/video* |
| Disallow | /news/handball* |
| Disallow | /news/basketball* |
| Disallow | /news/tennis* |
| Disallow | /news/eishockey* |
| Disallow | /news/radsport* |
| Disallow | /news/mehrsport* |
| Disallow | /news/wintersport* |
| Disallow | /news/formel1* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://newsfeed.kicker.de/googlesitemapnews.xml |
| sitemap | https://newsfeed.kicker.de/googlesitemapvideos.xml |
Warnings
- 1 invalid line.
- `âuser-agent` is not a known field.