Log In Sign Up

perfectpets.com.au
robots.txt

Robots Exclusion Standard data for perfectpets.com.au

Resource Scan

Scan Details

Site Domain perfectpets.com.au
Base Domain perfectpets.com.au
Scan Status Ok
Last Scan2024-09-21T08:39:44+00:00
Next Scan 2024-09-28T08:39:44+00:00

Last Scan

Scanned2024-09-21T08:39:44+00:00
URL https://perfectpets.com.au/robots.txt
Domain IPs 18.217.52.197
Response IP 18.217.52.197
Found Yes
Hash 646ea1b149d4876cc636095769c810bf5fe397cb2985469c284bb02d02f97b16
SimHash a925d9444dfe

Groups

*
twitterbot

Rule Path
Disallow /elink
Disallow /breed/default/getBreeds
Disallow /content/page
Disallow /locale
Disallow /servicetype
Disallow /pettype
Disallow /lng
Disallow /lat
Disallow /test
Back to top

Other Records

Field Value
sitemap https://www.perfectpets.com.au/sitemap.xml
Back to top