petbirds.gr
robots.txt
Robots Exclusion Standard data for petbirds.gr
Resource Scan
Scan Details
Site Domain | petbirds.gr |
Base Domain | petbirds.gr |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-09T21:37:03+00:00 |
Next Scan | 2024-10-23T21:37:03+00:00 |
Last Successful Scan
Scanned | 2024-09-30T21:36:13+00:00 |
URL | https://petbirds.gr/robots.txt |
Domain IPs | 172.66.40.196, 172.66.43.60, 2606:4700:3108::ac42:28c4, 2606:4700:3108::ac42:2b3c |
Response IP | 172.66.43.60 |
Found | Yes |
Hash | 46eb4c374d16ef273a3ba03aed7207f4c6eb26024c1172d47a9bbce1aaafa712 |
SimHash | 7b84c8c0e040 |
Groups
*
Rule | Path |
---|---|
Allow | /wp-admin/admin-ajax.php |
Allow | /wp-content/uploads/ |
Disallow | /?s=* |
Disallow | /community/misc/cookies* |
Disallow | /misc/cookies* |
Disallow | /search/* |
Disallow | /wp-json/ |
Disallow | /wp-admin/ |
Disallow | /wp-content/plugins/ |
Other Records
Field | Value |
---|---|
sitemap | https://petbirds.gr/sitemap_index.xml |
Comments