check24.de
robots.txt
Robots Exclusion Standard data for check24.de
Resource Scan
Scan Details
Site Domain | check24.de |
Base Domain | check24.de |
Scan Status | Ok |
Last Scan | 2024-11-03T17:10:45+00:00 |
Next Scan | 2024-11-17T17:10:45+00:00 |
Last Scan
Scanned | 2024-11-03T17:10:45+00:00 |
URL | https://check24.de/robots.txt |
Redirect | https://www.check24.de/robots.txt |
Redirect Domain | www.check24.de |
Redirect Base | check24.de |
Domain IPs | 195.30.123.137, 195.30.141.177, 195.30.141.73, 89.191.69.71, 89.191.86.20 |
Redirect IPs | 195.30.123.137, 195.30.141.177, 195.30.141.73, 89.191.69.71, 89.191.86.20 |
Response IP | 89.191.86.20 |
Found | Yes |
Hash | b738444e03f7b7305b1754593ad850f8353c699cc6a6efa466cd983bff8600cf |
SimHash | f305b01345f1 |
Groups
*
Rule | Path |
---|---|
Disallow | /4023/ |
Disallow | /et/wf/ |
Disallow | /form.html |
Disallow | /30 |
Disallow | /freunde |
Disallow | /gold |
Disallow | /agb-gs |
Disallow | /agb-gold |
Disallow | /result/ |
Disallow | /payback/versicherungen/* |
Disallow | /payback/konto-kredit/ |
Disallow | /payback/strom-gas/ |
Disallow | /payback/mietwagen/ |
Disallow | /tariffbox/ |
Disallow | /kundenbereich/ |
Disallow | /suche/ |
Disallow | /*/vergleich/ |
Disallow | /*/result_jumpin/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.check24.de/news-sitemap.xml |
sitemap | https://urlaub.check24.de/urlaub-sitemap.xml |
sitemap | https://www.check24.de/sitemap.xml |