discountflieger.de
robots.txt
Robots Exclusion Standard data for discountflieger.de
Resource Scan
Scan Details
Site Domain | discountflieger.de |
Base Domain | discountflieger.de |
Scan Status | Ok |
Last Scan | 2024-11-02T03:56:12+00:00 |
Next Scan | 2024-11-09T03:56:12+00:00 |
Last Scan
Scanned | 2024-11-02T03:56:12+00:00 |
URL | https://discountflieger.de/robots.txt |
Domain IPs | 80.252.111.75 |
Response IP | 80.252.111.75 |
Found | Yes |
Hash | 138d443d0c0ea472ab995b62ea7931b63b87c8145085aea5994e847612cd9ff2 |
SimHash | 3c1510362417 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp_2015/wp-admin/ |
Disallow | /wp_2015/wp-includes/ |
Disallow | /wp_2015/xmlrpc.php |
Disallow | /cgi-bin/ |
Disallow | /wp_2015/trackback/ |
Disallow | /wp_2015/feed/ |
Disallow | /wp_2015/comments/ |
Disallow | /wp_2015/*/trackback/ |
Disallow | /wp_2015/*/feed/ |
Disallow | /wp_2015/*/comments/ |
Disallow | /wp_2015/author/ |
Disallow | /author/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.discountflieger.de/sitemap.xml |
Warnings
- 2 invalid lines.
Comments