cleargroup.com.au
robots.txt

Robots Exclusion Standard data for cleargroup.com.au

Resource Scan

Scan Details

Site Domain cleargroup.com.au
Base Domain cleargroup.com.au
Scan Status Ok
Last Scan2024-10-28T17:15:22+00:00
Next Scan 2024-11-27T17:15:22+00:00

Last Scan

Scanned2024-10-28T17:15:22+00:00
URL https://cleargroup.com.au/robots.txt
Redirect https://webintelligenz.com/robots.txt
Redirect Domain webintelligenz.com
Redirect Base webintelligenz.com
Domain IPs 116.90.60.141
Redirect IPs 162.159.136.54, 162.159.137.54, 2606:4700:7::a29f:8836, 2606:4700:7::a29f:8936
Response IP 162.159.136.54
Found Yes
Hash 458c46c249a0ccee52581688f6a8aad4ffd055a710b66ab3800055e13ba230ca
SimHash 88085e028fb3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /

*

Rule Path
Disallow /*.webintelligenz.com

Other Records

Field Value
sitemap https://webintelligenz.com/sitemap_index.xml