nijobfinder.co.uk
robots.txt
Robots Exclusion Standard data for nijobfinder.co.uk
Resource Scan
Scan Details
| Site Domain | nijobfinder.co.uk |
| Base Domain | nijobfinder.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-15T11:40:25+00:00 |
| Next Scan | 2024-09-22T11:40:25+00:00 |
Last Scan
| Scanned | 2024-09-15T11:40:25+00:00 |
| URL | https://nijobfinder.co.uk/robots.txt |
| Redirect | https://www.nijobfinder.co.uk/robots.txt |
| Redirect Domain | www.nijobfinder.co.uk |
| Redirect Base | nijobfinder.co.uk |
| Domain IPs | 2a05:d018:ac3:3201:ee4b:e9d0:1920:c3c9, 2a05:d018:ac3:3202:1003:2416:5d:55fc, 2a05:d018:ac3:3203:2430:4085:1052:9999, 52.215.100.99, 54.77.80.238, 99.80.48.16 |
| Redirect IPs | 2a05:d018:ac3:3201:ee4b:e9d0:1920:c3c9, 2a05:d018:ac3:3202:1003:2416:5d:55fc, 2a05:d018:ac3:3203:2430:4085:1052:9999, 52.215.100.99, 54.77.80.238, 99.80.48.16 |
| Response IP | 54.77.80.238 |
| Found | Yes |
| Hash | 7e81d1a4c9616d47db053b18ecdf8a96ea9d773b9898ac42d82101e02f8857d4 |
| SimHash | 4004db414311 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search/ |
| Disallow | /member/ |
| Disallow | /apply/ |
| Disallow | /external/ |
| Disallow | /8616/* |
| Disallow | /contact/job/ |
| Disallow | /contact/recruiter/ |
| Disallow | /unsubscribe/ |
| Disallow | /non-member/* |
| Disallow | /8216/* |
| Allow | /static/favicons/ |
| Disallow | /static/ |
| Disallow | /additional-document/ |
| Disallow | /application-pack/ |
| Disallow | /recommended/ |
| Disallow | /health-check/ |
| Disallow | /browse |
Warnings
- `noindex` is not a known field.