bunburyherald.com.au
robots.txt

Robots Exclusion Standard data for bunburyherald.com.au

Resource Scan

Scan Details

Site Domain bunburyherald.com.au
Base Domain bunburyherald.com.au
Scan Status Ok
Last Scan2024-11-09T20:59:47+00:00
Next Scan 2024-11-16T20:59:47+00:00

Last Scan

Scanned2024-11-09T20:59:47+00:00
URL https://bunburyherald.com.au/robots.txt
Redirect https://www.bunburyherald.com.au/robots.txt
Redirect Domain www.bunburyherald.com.au
Redirect Base bunburyherald.com.au
Domain IPs 18.155.68.102, 18.155.68.109, 18.155.68.27, 18.155.68.54, 2600:9000:23d2:1200:f:a582:74c0:93a1, 2600:9000:23d2:2400:f:a582:74c0:93a1, 2600:9000:23d2:2600:f:a582:74c0:93a1, 2600:9000:23d2:4600:f:a582:74c0:93a1, 2600:9000:23d2:600:f:a582:74c0:93a1, 2600:9000:23d2:8e00:f:a582:74c0:93a1, 2600:9000:23d2:9c00:f:a582:74c0:93a1, 2600:9000:23d2:ec00:f:a582:74c0:93a1
Redirect IPs 13.33.28.17, 13.33.28.23, 13.33.28.25, 13.33.28.61, 2600:9000:229f:1400:1:aad4:3cc0:93a1, 2600:9000:229f:200:1:aad4:3cc0:93a1, 2600:9000:229f:3000:1:aad4:3cc0:93a1, 2600:9000:229f:6a00:1:aad4:3cc0:93a1, 2600:9000:229f:7c00:1:aad4:3cc0:93a1, 2600:9000:229f:b400:1:aad4:3cc0:93a1, 2600:9000:229f:ba00:1:aad4:3cc0:93a1, 2600:9000:229f:bc00:1:aad4:3cc0:93a1
Response IP 13.33.28.25
Found Yes
Hash bf489925f28d42982e4a20d0dd56d6859bc3d01cf1e386c9312807f60aca7770
SimHash e914bf55eed3

Groups

*

Rule Path
Disallow
Disallow /search

googlebot-image

Rule Path
Disallow /assets/profiles/*_thumb.png$

Other Records

Field Value
sitemap https://www.bunburyherald.com.au/sitemap.xml
sitemap https://www.bunburyherald.com.au/news-sitemap.xml