petsfriend.co.in
robots.txt

Robots Exclusion Standard data for petsfriend.co.in

Resource Scan

Scan Details

Site Domain petsfriend.co.in
Base Domain petsfriend.co.in
Scan Status Ok
Last Scan2024-06-09T12:46:38+00:00
Next Scan 2024-07-09T12:46:38+00:00

Last Scan

Scanned2024-06-09T12:46:38+00:00
URL https://petsfriend.co.in/robots.txt
Redirect https://www.petsfriend.co.in/robots.txt
Redirect Domain www.petsfriend.co.in
Redirect Base petsfriend.co.in
Domain IPs 104.21.96.137, 172.67.181.162, 2606:4700:3032::6815:6089, 2606:4700:3037::ac43:b5a2
Redirect IPs 104.21.96.137, 172.67.181.162, 2606:4700:3032::6815:6089, 2606:4700:3037::ac43:b5a2
Response IP 172.67.181.162
Found Yes
Hash 16c2407af62b07bac75cbf49c6c90bdce41c0ad55da270588182dec5322a3241
SimHash ec320c948191

Groups

*

Rule Path
Allow /
Allow /sitemap.xml
Disallow /admin/
Disallow /assets/
Disallow /function/
Disallow /image/
Disallow /js/
Disallow /cart/
Disallow /payment/
Disallow /*.php$
Disallow /*.html$
Disallow /product-detail.php
Disallow /product-list.php
Disallow /404.html
Disallow /404.shtml

Other Records

Field Value
sitemap https://www.petsfriend.co.in/sitemap.xml