hays.com.hk
robots.txt

Robots Exclusion Standard data for hays.com.hk

Resource Scan

Scan Details

Site Domain hays.com.hk
Base Domain hays.com.hk
Scan Status Ok
Last Scan2025-09-26T07:02:21+00:00
Next Scan 2025-10-26T07:02:21+00:00

Last Scan

Scanned2025-09-26T07:02:21+00:00
URL https://hays.com.hk/robots.txt
Redirect https://www.hays.com.hk/robots.txt
Redirect Domain www.hays.com.hk
Redirect Base hays.com.hk
Domain IPs 103.28.250.55, 103.28.251.55
Redirect IPs 103.28.249.56
Response IP 103.28.249.56
Found Yes
Hash 203ea1e13a9646d6b034fbc18fd65ee2851d486721742748ed2a0cbf4b72a90b
SimHash 681edf55aa7a

Groups

*

Rule Path
Disallow /search?
Disallow /page-not-found/
Disallow /c/portal/
Disallow /o/
Disallow /jobs-search/
Disallow /prd_consump/
Disallow /cs/
Disallow /viewemailink/
Disallow /job/VerifyAlert/
Disallow /unsubscribeEshot/
Disallow /unsubscribe/
Disallow /clientPortal/clientDashboard/
Disallow /DocExSignIn/beginSigningSession
Disallow /reset/
Disallow /timesheetAlert/reviewTimesheet/
Disallow /timesheetAlert/approveTimesheet/
Disallow /marketing-preferences/
Disallow /gdprThankYou/
Disallow /job-search/*
Disallow /my-account/
Disallow /job-detail/*/apply
Disallow /job-detail/*/job-success
Disallow /account/cv-success
Disallow /account/saved-jobs
Disallow /account/unsubscribe
Disallow /account/unsubscribe-email
Disallow /my-account/unsubscribe-email-confirmed
Disallow /account/update-preferences-email
Disallow /account/sent-preferences-email
Disallow /my-account/marketing-preferences
Disallow /my-account/marketing-preferences-confirmed
Disallow /my-account/profile
Disallow /my-account/job-alerts
Disallow /my-account/create-job-alert
Disallow /my-account/create-job-alert-email
Disallow /my-account/job-alert-success
Disallow /my-account/delete-alert
Disallow /my-account/manage-cv
Disallow /my-account/change-email
Disallow /my-account/change-password
Disallow /account/reset
Disallow /account/error
Allow /o/SearchCandidate/img/hays_logo.jpg
Allow /o/hays-desktop-branding-theme/images/favicon.ico
Disallow /o/

Other Records

Field Value
crawl-delay 10

omniexplorer_bot

Rule Path
Disallow /

yahooseeker/cafekelsa

Rule Path
Disallow /

wijubot/1.0

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

seoscanners.net/1

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

siteexplorer/1.0

Rule Path
Disallow /

siteexplorer/1.0b

Rule Path
Disallow /

curious george - www.analyticsseo.com/crawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mozilla/5.0 (compatible; domainappender /1.0; +http://www.profound.net/domainappender)

Rule Path
Disallow /

sitecheck-sitecrawl by siteimprove.com

Rule Path
Disallow /

feedly/1.0

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gigabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

twiceler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

jobcrawlerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

innovantagebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

innovantagebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.hays.com.hk/sitemap.xml