cimet.com.au
robots.txt

Robots Exclusion Standard data for cimet.com.au

Resource Scan

Scan Details

Site Domain cimet.com.au
Base Domain cimet.com.au
Scan Status Ok
Last Scan2024-09-17T15:11:37+00:00
Next Scan 2024-10-17T15:11:37+00:00

Last Scan

Scanned2024-09-17T15:11:37+00:00
URL https://cimet.com.au/robots.txt
Redirect https://assets.cimet.com.au/cimet/robots.txt
Redirect Domain assets.cimet.com.au
Redirect Base cimet.com.au
Domain IPs 104.26.6.37, 104.26.7.37, 172.67.70.191, 2606:4700:20::681a:625, 2606:4700:20::681a:725, 2606:4700:20::ac43:46bf
Redirect IPs 108.156.133.116, 108.156.133.15, 108.156.133.42, 108.156.133.59, 2600:9000:2755:0:17:d70d:a40:93a1, 2600:9000:2755:6000:17:d70d:a40:93a1, 2600:9000:2755:6200:17:d70d:a40:93a1, 2600:9000:2755:8200:17:d70d:a40:93a1, 2600:9000:2755:8400:17:d70d:a40:93a1, 2600:9000:2755:b200:17:d70d:a40:93a1, 2600:9000:2755:c000:17:d70d:a40:93a1, 2600:9000:2755:c600:17:d70d:a40:93a1
Response IP 108.156.133.15
Found Yes
Hash cd0aeb22b4c427d54d9ecd1f2c8692dbe8fd8e3ef3bd97648f6131cb464a7103
SimHash 69009824e5b1

Groups

*

Rule Path
Allow /
Allow *?rc=*$
Disallow *?*RC=*
Disallow *?*rc=*

Other Records

Field Value
sitemap https://www.cimet.com.au/sitemap.xml.gz