roosters.com.au
robots.txt

Robots Exclusion Standard data for roosters.com.au

Resource Scan

Scan Details

Site Domain roosters.com.au
Base Domain roosters.com.au
Scan Status Ok
Last Scan2024-05-26T16:02:04+00:00
Next Scan 2024-06-02T16:02:04+00:00

Last Scan

Scanned2024-05-26T16:02:04+00:00
URL https://roosters.com.au/robots.txt
Redirect https://www.roosters.com.au/robots.txt
Redirect Domain www.roosters.com.au
Redirect Base roosters.com.au
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Response IP 199.232.46.133
Found Yes
Hash 6081112a258509cc75201c09181c16084c6a619151de65c93f28b864182da95c
SimHash 61184d45e593

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.roosters.com.au/sitemap/sitemap.xml

Comments

  • Sitemap