oursteps.com.au
robots.txt
Robots Exclusion Standard data for oursteps.com.au
Resource Scan
Scan Details
| Site Domain | oursteps.com.au |
| Base Domain | oursteps.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-15T10:59:14+00:00 |
| Next Scan | 2024-11-22T10:59:14+00:00 |
Last Scan
| Scanned | 2024-11-15T10:59:14+00:00 |
| URL | https://oursteps.com.au/robots.txt |
| Redirect | https://www.oursteps.com.au/robots.txt |
| Redirect Domain | www.oursteps.com.au |
| Redirect Base | oursteps.com.au |
| Domain IPs | 67.212.239.162 |
| Redirect IPs | 67.212.239.162 |
| Response IP | 67.212.239.162 |
| Found | Yes |
| Hash | 8d97c0020aae9a17a6dd4869d1429039d9e62676615af259572a741b25cbf518 |
| SimHash | 07064aea2759 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bbs/space.php?61727%2Fmyreplies |
| Disallow | /bbs/space.php?uid=61727 |
| Disallow | /ss/?action-viewthread-tid-187080 |
| Disallow | /ss/?action-forumdisplay-fid-47-page-25 |
| Disallow | /bbsgb/ |
| Disallow | /bbs/archiver/?tid-187080-page-2.html |
| Disallow | /bbs/archiver/?tid-187080.html |
| Disallow | /bbs/viewthread.php?tid=187080&extra=page%3D2&page=2 |
| Allow | / |
| Disallow | /bbs/archiver/?fid-47-page-1.html |
| Disallow | /bbs/redirect.php?tid=187080&goto=lastpost |
| Disallow | /bbs/viewthread.php?tid=114924 |
| Disallow | /ss/?action-viewthread-tid-279541 |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Warnings
- `request-rate` is not a known field.
- `visit-time` is not a known field.