petbook.de
robots.txt
Robots Exclusion Standard data for petbook.de
Resource Scan
Scan Details
Site Domain | petbook.de |
Base Domain | petbook.de |
Scan Status | Ok |
Last Scan | 2024-06-21T18:43:11+00:00 |
Next Scan | 2024-06-28T18:43:11+00:00 |
Last Scan
Scanned | 2024-06-21T18:43:11+00:00 |
URL | https://petbook.de/robots.txt |
Redirect | https://www.petbook.de/robots.txt |
Redirect Domain | www.petbook.de |
Redirect Base | petbook.de |
Domain IPs | 13.248.163.210, 76.223.57.215 |
Redirect IPs | 23.210.250.121, 23.210.250.154 |
Response IP | 42.99.140.168 |
Found | Yes |
Hash | 85e4861b7f1fc17f27229394a42188d0dd672bd5373dda92d34e3094a82dddc4 |
SimHash | 714cd042e183 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cms/wp-admin/ |
Disallow | /cms/wp-admin/admin-ajax.php |
Disallow | /search/ |
Disallow | /?s= |
Other Records
Field | Value |
---|---|
sitemap | https://www.petbook.de/sitemap_index.xml |
sitemap | https://asset.petbook.de/petbook/data/sitemap/sitemap-news-index.xml |