applynow.com.au
robots.txt
Robots Exclusion Standard data for applynow.com.au
Resource Scan
Scan Details
| Site Domain | applynow.com.au |
| Base Domain | applynow.com.au |
| Scan Status | Ok |
| Last Scan | 2024-05-02T20:17:30+00:00 |
| Next Scan | 2024-06-01T20:17:30+00:00 |
Last Scan
| Scanned | 2024-05-02T20:17:30+00:00 |
| URL | https://www.applynow.com.au/robots.txt |
| Domain IPs | 104.17.247.70, 104.17.248.70, 104.17.249.70, 104.17.250.70, 104.17.251.70, 2606:4700::6811:f746, 2606:4700::6811:f846, 2606:4700::6811:f946, 2606:4700::6811:fa46, 2606:4700::6811:fb46 |
| Response IP | 104.17.250.70 |
| Found | Yes |
| Hash | 4d80df24a57f16c6334558ca59f992565cf299d318787bd6eb870fe05a209225 |
| SimHash | a39dcc876761 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /jobs/*/tracker |
| Disallow | /jobs/*/preview |
| Disallow | /jobs/*/applicants |
| Disallow | /jobs/*/manage |
| Disallow | /messages/* |
| Disallow | /applicants/new |
| Disallow | /backfills/latest_jobs |
| Disallow | /auth/* |
| Disallow | /clk/* |
| Disallow | /employers/* |
| Disallow | /c/* |
| Disallow | /s/* |
| Disallow | /e/* |
| Disallow | /g/* |
| Disallow | /n/* |
| Disallow | /Salaries/* |
| Disallow | /*?*lat= |
| Disallow | /*?*long= |
| Disallow | /*?*sort= |
Comments