ski.com.au
robots.txt
Robots Exclusion Standard data for ski.com.au
Resource Scan
Scan Details
Site Domain | ski.com.au |
Base Domain | ski.com.au |
Scan Status | Ok |
Last Scan | 2024-11-13T20:21:59+00:00 |
Next Scan | 2024-11-20T20:21:59+00:00 |
Last Scan
Scanned | 2024-11-13T20:21:59+00:00 |
URL | https://ski.com.au/robots.txt |
Redirect | https://www.ski.com.au/robots.txt |
Redirect Domain | www.ski.com.au |
Redirect Base | ski.com.au |
Domain IPs | 13.237.67.13, 2406:da1c:2e1:d600:1d66:339d:5ce7:c998 |
Redirect IPs | 13.237.67.13, 2406:da1c:2e1:d600:1d66:339d:5ce7:c998 |
Response IP | 13.237.67.13 |
Found | Yes |
Hash | d082c1af56aed0f42d42947663239b3af9113e8134cef8a854637671b9471e12 |
SimHash | 1c35d3c1f580 |
Groups
bingbot
Rule | Path |
---|---|
Allow | / |
Disallow | /xf/attachments |
Disallow | /xf/goto |
Disallow | /xf/members |
Disallow | /xf/posts/*/reactions |
Disallow | /xf/uix |
googlebot
Rule | Path |
---|---|
Allow | / |
Disallow | /xf/attachments |
Disallow | /xf/goto |
Disallow | /xf/members |
Disallow | /xf/posts/*/reactions |
Disallow | /xf/uix |
adsbot-google
Rule | Path |
---|---|
Allow | / |
Disallow | /xf/attachments |
Disallow | /xf/goto |
Disallow | /xf/members |
Disallow | /xf/posts/*/reactions |
Disallow | /xf/uix |
adsbot-google-mobile
Rule | Path |
---|---|
Allow | / |
Disallow | /xf/attachments |
Disallow | /xf/goto |
Disallow | /xf/members |
Disallow | /xf/posts/*/reactions |
Disallow | /xf/uix |
mediapartners-google
Rule | Path |
---|---|
Allow | / |
Disallow | /xf/attachments |
Disallow | /xf/goto |
Disallow | /xf/members |
Disallow | /xf/posts/*/reactions |
Disallow | /xf/uix |
applebot
Rule | Path |
---|---|
Allow | / |
Disallow | /xf/attachments |
Disallow | /xf/goto |
Disallow | /xf/members |
Disallow | /xf/posts/*/reactions |
Disallow | /xf/uix |
ia_archiver
Rule | Path |
---|---|
Allow | / |
Disallow | /xf/attachments |
Disallow | /xf/goto |
Disallow | /xf/members |
Disallow | /xf/posts/*/reactions |
Disallow | /xf/uix |
*
Rule | Path |
---|---|
Disallow | / |
Comments