petsplaza.in
robots.txt

Robots Exclusion Standard data for petsplaza.in

Resource Scan

Scan Details

Site Domain petsplaza.in
Base Domain petsplaza.in
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-05T09:41:44+00:00
Next Scan 2024-06-12T09:41:44+00:00

Last Successful Scan

Scanned2024-05-28T09:41:15+00:00
URL https://petsplaza.in/robots.txt
Domain IPs 2a02:4780:84:58be:c99e:d91b:9acb:6015, 84.32.84.104
Response IP 191.101.228.243
Found Yes
Hash b640e2a80851003b56f22cb919914cd5a8ace431e2f17c31f98b6989fe51b3d2
SimHash 78396344d198

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /z/j/
Disallow /z/c/
Disallow /stats/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-admin/
Disallow /page/
Disallow /?attachment_id
Disallow /category/
Disallow /category/*
Disallow /tag/
Disallow /tag/*
Disallow /comments/
Disallow /comments/feed/

Comments

  • disallow all files in these directories

Warnings

  • 2 invalid lines.
  • `<b>warning</b>` is not a known field.