oshclub.com.au
robots.txt
Robots Exclusion Standard data for oshclub.com.au
Resource Scan
Scan Details
Site Domain | oshclub.com.au |
Base Domain | oshclub.com.au |
Scan Status | Ok |
Last Scan | 2024-11-13T12:28:18+00:00 |
Next Scan | 2024-12-13T12:28:18+00:00 |
Last Scan
Scanned | 2024-11-13T12:28:18+00:00 |
URL | https://oshclub.com.au/robots.txt |
Redirect | https://www.oshclub.com.au/robots.txt |
Redirect Domain | www.oshclub.com.au |
Redirect Base | oshclub.com.au |
Domain IPs | 18.160.46.105, 18.160.46.12, 18.160.46.43, 18.160.46.54, 2620:12a:8000::1, 2620:12a:8001::1 |
Redirect IPs | 108.156.133.26, 108.156.133.37, 108.156.133.80, 108.156.133.89, 2600:9000:2755:1400:8:6bf9:30c0:93a1, 2600:9000:2755:3400:8:6bf9:30c0:93a1, 2600:9000:2755:3600:8:6bf9:30c0:93a1, 2600:9000:2755:5000:8:6bf9:30c0:93a1, 2600:9000:2755:9000:8:6bf9:30c0:93a1, 2600:9000:2755:be00:8:6bf9:30c0:93a1, 2600:9000:2755:d200:8:6bf9:30c0:93a1, 2600:9000:2755:e000:8:6bf9:30c0:93a1 |
Response IP | 108.156.133.89 |
Found | Yes |
Hash | 8582fde63b7fdeb660ba53e0b928774fb00b4dcf5cb3a469f07c9d8aa7d976a2 |
SimHash | 69150370cf53 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /dev-only/* |
Disallow | /page-not-found |
Disallow | /404 |
Disallow | /preview |
Disallow | /search |
Other Records
Field | Value |
---|---|
sitemap | https://www.oshclub.com.au/sitemap-0.xml |
Warnings
- `host` is not a known field.