theglen.com.au
robots.txt

Robots Exclusion Standard data for theglen.com.au

Resource Scan

Scan Details

Site Domain theglen.com.au
Base Domain theglen.com.au
Scan Status Ok
Last Scan2024-10-01T04:41:02+00:00
Next Scan 2024-10-15T04:41:02+00:00

Last Scan

Scanned2024-10-01T04:41:02+00:00
URL https://theglen.com.au/robots.txt
Redirect https://www.theglen.com.au:443/robots.txt
Redirect Domain www.theglen.com.au
Redirect Base theglen.com.au
Domain IPs 18.155.68.117, 18.155.68.12, 18.155.68.3, 18.155.68.70, 2600:9000:23d2:2800:16:521c:8500:93a1, 2600:9000:23d2:4000:16:521c:8500:93a1, 2600:9000:23d2:7600:16:521c:8500:93a1, 2600:9000:23d2:9200:16:521c:8500:93a1, 2600:9000:23d2:ae00:16:521c:8500:93a1, 2600:9000:23d2:c800:16:521c:8500:93a1, 2600:9000:23d2:d000:16:521c:8500:93a1, 2600:9000:23d2:d600:16:521c:8500:93a1
Redirect IPs 104.18.6.151, 104.18.7.151, 2606:4700::6812:697, 2606:4700::6812:797
Response IP 104.18.6.151
Found Yes
Hash de70aa2e5c2aa553086311429983546e52bedc607fe7c4da6893ae8f41a35fab
SimHash 68055452cf93

Groups

*

Rule Path
Disallow /preference-centre
Disallow /channels/
Disallow /*?*

Other Records

Field Value
sitemap https://www.theglen.com.au/sitemap.xml