hawks.com.au
robots.txt

Robots Exclusion Standard data for hawks.com.au

Resource Scan

Scan Details

Site Domain hawks.com.au
Base Domain hawks.com.au
Scan Status Ok
Last Scan2024-09-17T15:26:07+00:00
Next Scan 2024-09-24T15:26:07+00:00

Last Scan

Scanned2024-09-17T15:26:07+00:00
URL https://hawks.com.au/robots.txt
Redirect https://www.hawks.com.au/robots.txt
Redirect Domain www.hawks.com.au
Redirect Base hawks.com.au
Domain IPs 13.226.2.18, 13.226.2.38, 13.226.2.68, 13.226.2.7
Redirect IPs 13.35.238.105, 13.35.238.53, 13.35.238.54, 13.35.238.55
Response IP 13.35.238.105
Found Yes
Hash dc7f0f70e1fdd24bc6db98b589a4e64b1e073310ac7f3b4b3375ef57fda02736
SimHash 08084755c132

Groups

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://api.nbl.com.au/nbl/custom/sitemap/nbl/news
sitemap https://api.nbl.com.au/nbl/custom/sitemap/nbl/general
sitemap https://api.nbl.com.au/nbl/custom/sitemap/nbl/news_archive
sitemap https://api.nbl.com.au/nbl/custom/sitemap/nbl/nbltv
sitemap https://api.nbl.com.au/nbl/custom/sitemap/nbl/players
sitemap https://api.nbl.com.au/nbl/custom/sitemap/nbl/pages