petsplaza.in
robots.txt
Robots Exclusion Standard data for petsplaza.in
Resource Scan
Scan Details
Site Domain | petsplaza.in |
Base Domain | petsplaza.in |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-05T09:41:44+00:00 |
Next Scan | 2024-06-12T09:41:44+00:00 |
Last Successful Scan
Scanned | 2024-05-28T09:41:15+00:00 |
URL | https://petsplaza.in/robots.txt |
Domain IPs | 2a02:4780:84:58be:c99e:d91b:9acb:6015, 84.32.84.104 |
Response IP | 191.101.228.243 |
Found | Yes |
Hash | b640e2a80851003b56f22cb919914cd5a8ace431e2f17c31f98b6989fe51b3d2 |
SimHash | 78396344d198 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /z/j/ |
Disallow | /z/c/ |
Disallow | /stats/ |
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Disallow | /wp-admin/ |
Disallow | /page/ |
Disallow | /?attachment_id |
Disallow | /category/ |
Disallow | /category/* |
Disallow | /tag/ |
Disallow | /tag/* |
Disallow | /comments/ |
Disallow | /comments/feed/ |
Warnings
- 2 invalid lines.
- `<b>warning</b>` is not a known field.
Comments