swtimes.com.au
robots.txt

Robots Exclusion Standard data for swtimes.com.au

Resource Scan

Scan Details

Site Domain swtimes.com.au
Base Domain swtimes.com.au
Scan Status Ok
Last Scan2024-11-02T19:12:49+00:00
Next Scan 2024-11-09T19:12:49+00:00

Last Scan

Scanned2024-11-02T19:12:49+00:00
URL https://swtimes.com.au/robots.txt
Redirect https://www.swtimes.com.au/robots.txt
Redirect Domain www.swtimes.com.au
Redirect Base swtimes.com.au
Domain IPs 13.33.30.44, 13.33.30.52, 13.33.30.6, 13.33.30.99, 2600:9000:229f:4c00:13:79f9:2180:93a1, 2600:9000:229f:5000:13:79f9:2180:93a1, 2600:9000:229f:5800:13:79f9:2180:93a1, 2600:9000:229f:9c00:13:79f9:2180:93a1, 2600:9000:229f:a400:13:79f9:2180:93a1, 2600:9000:229f:b200:13:79f9:2180:93a1, 2600:9000:229f:b400:13:79f9:2180:93a1, 2600:9000:229f:d400:13:79f9:2180:93a1
Redirect IPs 13.227.254.16, 13.227.254.57, 13.227.254.70, 13.227.254.86, 2600:9000:200a:1c00:15:1643:c780:93a1, 2600:9000:200a:4000:15:1643:c780:93a1, 2600:9000:200a:400:15:1643:c780:93a1, 2600:9000:200a:4800:15:1643:c780:93a1, 2600:9000:200a:6000:15:1643:c780:93a1, 2600:9000:200a:7600:15:1643:c780:93a1, 2600:9000:200a:800:15:1643:c780:93a1, 2600:9000:200a:b400:15:1643:c780:93a1
Response IP 13.227.254.70
Found Yes
Hash d8128293300d1c218ed64a2e0c047fc1edb0adbd37a2e050097ce2a1082ada77
SimHash 691d9f16e8d3

Groups

*

Rule Path
Disallow
Disallow /search

googlebot-image

Rule Path
Disallow /assets/profiles/*_thumb.png$

Other Records

Field Value
sitemap https://www.swtimes.com.au/sitemap.xml
sitemap https://www.swtimes.com.au/news-sitemap.xml