selby.com.au
robots.txt

Robots Exclusion Standard data for selby.com.au

Resource Scan

Scan Details

Site Domain selby.com.au
Base Domain selby.com.au
Scan Status Ok
Last Scan2024-09-01T22:20:05+00:00
Next Scan 2024-10-01T22:20:05+00:00

Last Scan

Scanned2024-09-01T22:20:05+00:00
URL https://selby.com.au/robots.txt
Redirect https://www.selby.com.au/robots.txt
Redirect Domain www.selby.com.au
Redirect Base selby.com.au
Domain IPs 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52
Redirect IPs 151.101.131.52, 151.101.195.52, 151.101.3.52, 151.101.67.52
Response IP 199.232.47.52
Found Yes
Hash c2b2b5cf0a6e3ad15c9895d4ff4373c157e08fc407a044d7cac95fa6a45c84dc
SimHash 1d1459954743

Groups

amazonbot

Rule Path
Disallow /

geedoproductsearch

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow /catalogsearch/