hays.com.au
robots.txt
Robots Exclusion Standard data for hays.com.au
Resource Scan
Scan Details
| Site Domain | hays.com.au |
| Base Domain | hays.com.au |
| Scan Status | Ok |
| Last Scan | 2025-02-15T17:06:39+00:00 |
| Next Scan | 2025-03-17T17:06:39+00:00 |
Last Scan
| Scanned | 2025-02-15T17:06:39+00:00 |
| URL | https://hays.com.au/robots.txt |
| Redirect | https://www.hays.com.au/robots.txt |
| Redirect Domain | www.hays.com.au |
| Redirect Base | hays.com.au |
| Domain IPs | 107.154.100.108, 107.154.101.108 |
| Redirect IPs | 103.28.249.49 |
| Response IP | 103.28.249.49 |
| Found | Yes |
| Hash | 2534cad145202cb6aa7a04ba3ba051a2481f81465f089cc86e14f109e1316534 |
| SimHash | 6812dd178925 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /prd_consump/ |
| Disallow | /cs/ |
| Disallow | /1102429/ |
| Disallow | /*.pdf$ |
| Disallow | /expertise |
| Disallow | /expertise/ |
| Disallow | /viewemailink/ |
| Disallow | /whatsAppAlert/updateAlert/ |
| Disallow | /job/VerifyAlert/ |
| Disallow | /unsubscribeEshot/ |
| Disallow | /unsubscribe/ |
| Disallow | /clientPortal/clientDashboard/ |
| Disallow | /DocExSignIn/beginSigningSession |
| Disallow | /reset/ |
| Disallow | /timesheetAlert/reviewTimesheet/ |
| Disallow | /timesheetAlert/approveTimesheet/ |
| Disallow | /marketing-preferences/ |
| Disallow | /gdprThankYou/ |
| Disallow | /online-learning/employee-training/ |
| Disallow | /online-learning/employee-training/* |
| Disallow | /erp/as/secure-gateway |
| Disallow | /erp/as/alert-secure-gateway |
| Disallow | /erp/s/marketing-pref |
| Disallow | /erp/s/manage-job-alert |
| Disallow | /erp/as/marketing-pref |
| Disallow | /erp/as/manage-job-alert |
| Disallow | /job-search/* |
| Disallow | /my-account/ |
| Disallow | /job-detail/*/apply |
| Disallow | /job-detail/*/job-success |
| Disallow | /account/cv-success |
| Disallow | /account/saved-jobs |
| Disallow | /account/update-preferences-email |
| Disallow | /account/sent-preferences-email |
| Disallow | /my-account/erp/marketing-preferences |
| Disallow | /my-account/erp/marketing-preferences-confirmed |
| Disallow | /my-account/profile |
| Disallow | /my-account/erp/job-alerts |
| Disallow | /my-account/create-job-alert |
| Disallow | /my-account/create-job-alert-email |
| Disallow | /my-account/job-alert-success |
| Disallow | /my-account/delete-alert |
| Disallow | /my-account/manage-cv |
| Disallow | /my-account/change-email |
| Disallow | /my-account/change-password |
| Disallow | /account/reset |
| Disallow | /account/error |
| Allow | /o/hays-desktop-branding-theme/images/favicon.ico |
| Disallow | /o/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.hays.com.au/sitemap.xml |