petside.com
robots.txt
Robots Exclusion Standard data for petside.com
Resource Scan
Scan Details
Site Domain | petside.com |
Base Domain | petside.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2025-09-06T03:31:04+00:00 |
Next Scan | 2025-11-05T03:31:04+00:00 |
Last Successful Scan
Scanned | 2025-06-15T22:40:45+00:00 |
URL | https://petside.com/robots.txt |
Redirect | https://www.petside.com/robots.txt |
Redirect Domain | www.petside.com |
Redirect Base | petside.com |
Domain IPs | 104.21.21.59, 172.67.196.195, 2606:4700:3033::ac43:c4c3, 2606:4700:3037::6815:153b |
Redirect IPs | 104.21.21.59, 172.67.196.195, 2606:4700:3033::ac43:c4c3, 2606:4700:3037::6815:153b |
Response IP | 172.67.196.195 |
Found | Yes |
Hash | 7dc3bf6b762f5ab4148072d59ed277d112441b11cdf5aa51e6577b12493ebfab |
SimHash | 41011a000710 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wp-content/plugins |
Other Records
Field | Value |
---|---|
sitemap | https://www.petside.com/sitemap_index.xml |