scopedout.com.au
robots.txt

Robots Exclusion Standard data for scopedout.com.au

Resource Scan

Scan Details

Site Domain scopedout.com.au
Base Domain scopedout.com.au
Scan Status Ok
Last Scan2025-12-03T07:26:43+00:00
Next Scan 2026-01-02T07:26:43+00:00

Last Scan

Scanned2025-12-03T07:26:43+00:00
URL https://scopedout.com.au/robots.txt
Redirect https://www.scopedout.com.au/robots.txt
Redirect Domain www.scopedout.com.au
Redirect Base scopedout.com.au
Domain IPs 52.62.248.101
Redirect IPs 104.16.183.152, 104.16.184.152, 104.16.185.152, 104.16.186.152, 104.16.187.152
Response IP 104.16.186.152
Found Yes
Hash d05b656a7acaa6c16eddead87f96da56ed5ae059dd861fe226b70b9117e94df8
SimHash 6514db63d393

Groups

*

Rule Path
Disallow /_cpanel
Disallow /cgi-bin/suppliers/
Disallow /do/
Disallow /*?*rf=
Disallow /search-results?q=

Other Records

Field Value
crawl-delay 1

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap http://www.scopedout.com.au/sitemap_index.xml.gz