hays.net.nz
robots.txt

Robots Exclusion Standard data for hays.net.nz

Resource Scan

Scan Details

Site Domain hays.net.nz
Base Domain hays.net.nz
Scan Status Ok
Last Scan2025-09-25T08:07:08+00:00
Next Scan 2025-10-25T08:07:08+00:00

Last Scan

Scanned2025-09-25T08:07:08+00:00
URL https://hays.net.nz/robots.txt
Redirect https://www.hays.net.nz/robots.txt
Redirect Domain www.hays.net.nz
Redirect Base hays.net.nz
Domain IPs 107.154.100.108, 107.154.101.108
Redirect IPs 45.64.67.14
Response IP 45.64.67.14
Found Yes
Hash 8d73f41cd95801e97917aa03bdd4c386eb386fbc1548eb4bbb16f0b51611a1ae
SimHash 6810dd55a937

Groups

*

Rule Path
Disallow /search?
Disallow /it/search?
Disallow /prd_consump/
Disallow /jobs-search/results/
Disallow /error-page/
Disallow /cs/
Disallow /971905/
Disallow /*.pdf$
Disallow /viewemailink/
Disallow /whatsAppAlert/updateAlert/
Disallow /job/VerifyAlert/
Disallow /job/VerifyAlertV2?
Disallow /unsubscribeEshot/
Disallow /unsubscribe/
Disallow /clientPortal/clientDashboard/
Disallow /DocExSignIn/beginSigningSession
Disallow /reset/
Disallow /timesheetAlert/reviewTimesheet/
Disallow /timesheetAlert/approveTimesheet/
Disallow /marketing-preferences/
Disallow /gdprThankYou/
Disallow /email-confirmation
Disallow /online-learning/employee-training/
Disallow /online-learning/employee-training/*
Disallow /erp/as/secure-gateway
Disallow /erp/as/alert-secure-gateway
Disallow /erp/s/marketing-pref
Disallow /erp/s/manage-job-alert
Disallow /erp/as/marketing-pref
Disallow /erp/as/manage-job-alert
Disallow /jobportal/as/job/browse/search?
Disallow /jobs-search/JOB_1107550
Disallow /job-search/*
Disallow /my-account/
Disallow /job-detail/*/apply
Disallow /job-detail/*/job-success
Disallow /account/cv-success
Disallow /account/saved-jobs
Disallow /account/update-preferences-email
Disallow /account/sent-preferences-email
Disallow /my-account/erp/marketing-preferences
Disallow /my-account/erp/marketing-preferences-confirmed
Disallow /my-account/profile
Disallow /my-account/job-alerts
Disallow /my-account/create-job-alert
Disallow /my-account/create-job-alert-email
Disallow /my-account/job-alert-success
Disallow /my-account/delete-alert
Disallow /my-account/manage-cv
Disallow /my-account/change-email
Disallow /my-account/change-password
Disallow /account/online-learning
Disallow /account/reset
Disallow /account/error
Allow /o/SearchCandidate/img/hays_logo.jpg
Allow /o/hays-desktop-branding-theme/images/favicon.ico
Disallow /o/

Other Records

Field Value
crawl-delay 10

omniexplorer_bot

Rule Path
Disallow /

yahooseeker/cafekelsa

Rule Path
Disallow /

wijubot/1.0

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

seoscanners.net/1

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

siteexplorer/1.0

Rule Path
Disallow /

siteexplorer/1.0b

Rule Path
Disallow /

curious george - www.analyticsseo.com/crawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mozilla/5.0 (compatible; domainappender /1.0; +http://www.profound.net/domainappender)

Rule Path
Disallow /

sitecheck-sitecrawl by siteimprove.com

Rule Path
Disallow /

feedly/1.0

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gigabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

twiceler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

jobcrawlerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

innovantagebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

innovantagebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.hays.net.nz/sitemap.xml