malaysiaurlaub.net
robots.txt
Robots Exclusion Standard data for malaysiaurlaub.net
Resource Scan
Scan Details
Site Domain | malaysiaurlaub.net |
Base Domain | malaysiaurlaub.net |
Scan Status | Ok |
Last Scan | 2024-10-09T22:21:30+00:00 |
Next Scan | 2024-10-16T22:21:30+00:00 |
Last Scan
Scanned | 2024-10-09T22:21:30+00:00 |
URL | https://malaysiaurlaub.net/robots.txt |
Domain IPs | 198.252.104.144 |
Response IP | 198.252.104.144 |
Found | Yes |
Hash | 97100ee7c215a185be337922736a658a9ef6bb36ba9841d89f22c8cacddd19f5 |
SimHash | d39b5047c823 |
Groups
mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
Rule | Path |
---|---|
Disallow | / |
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /cgi-bin/ |
Disallow | /search/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-content/plugins/ |
Disallow | /wp-content/cache/ |
Disallow | /wp-content/themes/ |
Disallow | /wp-login.php |
Disallow | /wp-register.php |
Warnings
- 6 invalid lines.
Comments