Log In Sign Up

swtimes.com.au
robots.txt

Robots Exclusion Standard data for swtimes.com.au

Resource Scan

Scan Details

Site Domain swtimes.com.au
Base Domain swtimes.com.au
Scan Status Ok
Last Scan2024-09-21T18:15:03+00:00
Next Scan 2024-09-28T18:15:03+00:00

Last Scan

Scanned2024-09-21T18:15:03+00:00
URL https://swtimes.com.au/robots.txt
Redirect https://www.swtimes.com.au/robots.txt
Redirect Domain www.swtimes.com.au
Redirect Base swtimes.com.au
Domain IPs 13.35.18.129, 13.35.18.63, 13.35.18.91, 13.35.18.97, 2600:9000:20c7:3000:13:79f9:2180:93a1, 2600:9000:20c7:3400:13:79f9:2180:93a1, 2600:9000:20c7:8800:13:79f9:2180:93a1, 2600:9000:20c7:a00:13:79f9:2180:93a1, 2600:9000:20c7:a200:13:79f9:2180:93a1, 2600:9000:20c7:ba00:13:79f9:2180:93a1, 2600:9000:20c7:cc00:13:79f9:2180:93a1, 2600:9000:20c7:ea00:13:79f9:2180:93a1
Redirect IPs 13.227.254.16, 13.227.254.57, 13.227.254.70, 13.227.254.86, 2600:9000:200a:2600:15:1643:c780:93a1, 2600:9000:200a:2e00:15:1643:c780:93a1, 2600:9000:200a:7000:15:1643:c780:93a1, 2600:9000:200a:800:15:1643:c780:93a1, 2600:9000:200a:9e00:15:1643:c780:93a1, 2600:9000:200a:a000:15:1643:c780:93a1, 2600:9000:200a:d000:15:1643:c780:93a1, 2600:9000:200a:e200:15:1643:c780:93a1
Response IP 13.227.254.57
Found Yes
Hash d8128293300d1c218ed64a2e0c047fc1edb0adbd37a2e050097ce2a1082ada77
SimHash 691d9f16e8d3

Groups

*

Rule Path
Disallow
Disallow /search

googlebot-image

Rule Path
Disallow /assets/profiles/*_thumb.png$
Back to top

Other Records

Field Value
sitemap https://www.swtimes.com.au/sitemap.xml
sitemap https://www.swtimes.com.au/news-sitemap.xml
Back to top