petbook-magazine.com
robots.txt
Robots Exclusion Standard data for petbook-magazine.com
Resource Scan
Scan Details
Site Domain | petbook-magazine.com |
Base Domain | petbook-magazine.com |
Scan Status | Ok |
Last Scan | 2024-11-12T10:56:03+00:00 |
Next Scan | 2024-11-19T10:56:03+00:00 |
Last Scan
Scanned | 2024-11-12T10:56:03+00:00 |
URL | https://petbook-magazine.com/robots.txt |
Redirect | https://www.petbook-magazine.com/robots.txt |
Redirect Domain | www.petbook-magazine.com |
Redirect Base | petbook-magazine.com |
Domain IPs | 13.248.163.210, 76.223.57.215 |
Redirect IPs | 23.215.7.25, 23.215.7.31, 2600:1413:b000:1b::17d7:719, 2600:1413:b000:1b::17d7:71f |
Response IP | 23.215.7.31 |
Found | Yes |
Hash | bb97be6a1c519d86f18a2897272d4aa99f5c6464c0d8002c08796113ab5bfef6 |
SimHash | 634cd852e003 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /cms/wp-admin/ |
Disallow | /cms/wp-admin/admin-ajax.php |
Disallow | /search/ |
Disallow | /?s= |
Other Records
Field | Value |
---|---|
sitemap | https://www.petbook-magazine.com/sitemap_index.xml |
sitemap | https://www.petbook-magazine.com/data/sitemap/news/en/news-sitemap.xml |