soho.com.au
robots.txt

Robots Exclusion Standard data for soho.com.au

Resource Scan

Scan Details

Site Domain soho.com.au
Base Domain soho.com.au
Scan Status Ok
Last Scan2024-10-03T19:31:18+00:00
Next Scan 2024-10-10T19:31:18+00:00

Last Scan

Scanned2024-10-03T19:31:18+00:00
URL https://soho.com.au/robots.txt
Domain IPs 76.76.21.21
Response IP 76.76.21.21
Found Yes
Hash 7c82c4d47d59c85e8dd7c04b101c3752e3a3f0a69840835a84933f4f8112e640
SimHash 6b051a42ae00

Groups

*

Rule Path
Disallow /cdn-cgi/

trovitbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /production/uploads/document/attachment/

Other Records

Field Value
sitemap https://soho.com.au/sitemap-index.xml
sitemap https://soho.com.au/articles/sitemap_index.xml