loadshift.com.au
robots.txt
Robots Exclusion Standard data for loadshift.com.au
Resource Scan
Scan Details
| Site Domain | loadshift.com.au |
| Base Domain | loadshift.com.au |
| Scan Status | Ok |
| Last Scan | 2025-10-06T00:19:59+00:00 |
| Next Scan | 2025-10-20T00:19:59+00:00 |
Last Scan
| Scanned | 2025-10-06T00:19:59+00:00 |
| URL | https://loadshift.com.au/robots.txt |
| Redirect | https://www.loadshift.com.au/robots.txt |
| Redirect Domain | www.loadshift.com.au |
| Redirect Base | loadshift.com.au |
| Domain IPs | 34.232.231.179, 52.206.80.116, 52.21.13.127 |
| Redirect IPs | 34.232.231.179, 52.206.80.116, 52.21.13.127 |
| Response IP | 52.206.80.116 |
| Found | Yes |
| Hash | f1e6fc6237034e94303702aaef7a7272993474f8e1c984209ee72b24b08be2e6 |
| SimHash | db54cc66a5dd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /users/login-faster.php* |
| Disallow | /users/login-instant.php* |
| Disallow | /users/login-quick.php* |
| Disallow | /bl-email/* |
| Disallow | /users/onUpdateOnlineStatus.php* |
| Disallow | /online-count/* |
| Disallow | /report/violation* |
| Disallow | /widgets$ |
| Disallow | /widgets/* |
| Disallow | /admin$ |
| Disallow | /admin/* |
| Disallow | /payments$ |
| Disallow | /payments/* |
| Disallow | /deloitte/* |
| Disallow | /saml_sso/* |
| Disallow | /pmi/* |
| Disallow | /jobs/?* |
| Disallow | /campaign/* |
| Disallow | /work$ |
| Disallow | /work/* |
| Disallow | /sellers/placebid.php* |
| Disallow | /buyers/repost.php* |
| Disallow | /ajax/ |
| Disallow | /job-search$ |
| Disallow | /job-search/* |
| Disallow | /community$ |
| Disallow | /community/* |
| Disallow | /articles$ |
| Disallow | /articles/* |
| Disallow | /hire$ |
| Disallow | /hire/* |
| Disallow | /find$ |
| Disallow | /find/* |
| Disallow | /u/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.loadshift.com.au/sitemap_index_x11_static-pages-loadshift_s3.xml |