freenet-mobilfunk.de
robots.txt
Robots Exclusion Standard data for freenet-mobilfunk.de
Resource Scan
Scan Details
| Site Domain | freenet-mobilfunk.de |
| Base Domain | freenet-mobilfunk.de |
| Scan Status | Ok |
| Last Scan | 2024-11-16T12:01:21+00:00 |
| Next Scan | 2024-11-30T12:01:21+00:00 |
Last Scan
| Scanned | 2024-11-16T12:01:21+00:00 |
| URL | https://freenet-mobilfunk.de/robots.txt |
| Redirect | https://www.freenet-mobilfunk.de/robots.txt |
| Redirect Domain | www.freenet-mobilfunk.de |
| Redirect Base | freenet-mobilfunk.de |
| Domain IPs | 104.18.40.101, 172.64.147.155, 2606:4700:4400::6812:2865, 2606:4700:4400::ac40:939b |
| Redirect IPs | 104.18.40.101, 172.64.147.155, 2606:4700:4400::6812:2865, 2606:4700:4400::ac40:939b |
| Response IP | 104.18.40.101 |
| Found | Yes |
| Hash | f434b76e84a6cb9c518ac1d8f6e80ca00177145879b788e6c58281a3aa411e7b |
| SimHash | a5553d14e7d9 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | |
| Disallow | /mlp/ |
| Disallow | /lp/ |
| Disallow | /api/ |
| Disallow | /shop/cart/ |
| Disallow | /shop/checkout/ |
| Disallow | /shop/my-account/ |
| Disallow | /shop/personal-data/ |
| Disallow | /shop/compare/ |
| Disallow | /shop/rest/ |
| Disallow | /shop/ws410/ |
| Disallow | /shop/*?q=* |
| Disallow | /shop/*?*&q=* |
| Disallow | /shop/*?sort=* |
| Disallow | /shop/*?*&sort=* |
| Disallow | /shop/*?text=* |
| Disallow | /shop/*?*&text=* |
| Disallow | */b/smartphones* |
| Disallow | */summary/ |
| Disallow | /online-service/login/* |
| Disallow | *static* |
| Disallow | */tablets*tariffs_postpaid_voice* |
| Disallow | */handys-smartphones*tariffs_postpaid_data* |
| Disallow | */tablets*tablets_surfsticks* |
| Disallow | /freunde-werben/formular* |
| Disallow | /suche/*?search=* |
| Disallow | /cdn-cgi/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.freenet-mobilfunk.de/sitemap.xml |
| sitemap | https://www.freenet-mobilfunk.de/sitemap-shops.xml |
| sitemap | https://www.freenet-mobilfunk.de/digitalrepublic/sitemap.xml |