Log In Sign Up

bunburyherald.com.au
robots.txt

Robots Exclusion Standard data for bunburyherald.com.au

Resource Scan

Scan Details

Site Domain bunburyherald.com.au
Base Domain bunburyherald.com.au
Scan Status Ok
Last Scan2024-09-21T20:37:53+00:00
Next Scan 2024-09-28T20:37:53+00:00

Last Scan

Scanned2024-09-21T20:37:53+00:00
URL https://bunburyherald.com.au/robots.txt
Redirect https://www.bunburyherald.com.au/robots.txt
Redirect Domain www.bunburyherald.com.au
Redirect Base bunburyherald.com.au
Domain IPs 18.155.68.102, 18.155.68.109, 18.155.68.27, 18.155.68.54, 2600:9000:23d2:3e00:f:a582:74c0:93a1, 2600:9000:23d2:4600:f:a582:74c0:93a1, 2600:9000:23d2:5c00:f:a582:74c0:93a1, 2600:9000:23d2:6c00:f:a582:74c0:93a1, 2600:9000:23d2:8200:f:a582:74c0:93a1, 2600:9000:23d2:8e00:f:a582:74c0:93a1, 2600:9000:23d2:9200:f:a582:74c0:93a1, 2600:9000:23d2:d200:f:a582:74c0:93a1
Redirect IPs 13.33.30.20, 13.33.30.40, 13.33.30.48, 13.33.30.81, 2600:9000:229f:2a00:1:aad4:3cc0:93a1, 2600:9000:229f:5400:1:aad4:3cc0:93a1, 2600:9000:229f:5c00:1:aad4:3cc0:93a1, 2600:9000:229f:6800:1:aad4:3cc0:93a1, 2600:9000:229f:aa00:1:aad4:3cc0:93a1, 2600:9000:229f:da00:1:aad4:3cc0:93a1, 2600:9000:229f:ec00:1:aad4:3cc0:93a1, 2600:9000:229f:f000:1:aad4:3cc0:93a1
Response IP 13.33.30.81
Found Yes
Hash bf489925f28d42982e4a20d0dd56d6859bc3d01cf1e386c9312807f60aca7770
SimHash e914bf55eed3

Groups

*

Rule Path
Disallow
Disallow /search

googlebot-image

Rule Path
Disallow /assets/profiles/*_thumb.png$
Back to top

Other Records

Field Value
sitemap https://www.bunburyherald.com.au/sitemap.xml
sitemap https://www.bunburyherald.com.au/news-sitemap.xml
Back to top