hays.it
robots.txt

Robots Exclusion Standard data for hays.it

Resource Scan

Scan Details

Site Domain hays.it
Base Domain hays.it
Scan Status Ok
Last Scan2025-09-21T07:13:53+00:00
Next Scan 2025-10-21T07:13:53+00:00

Last Scan

Scanned2025-09-21T07:13:53+00:00
URL https://hays.it/robots.txt
Redirect https://www.hays.it/robots.txt
Redirect Domain www.hays.it
Redirect Base hays.it
Domain IPs 149.126.74.8, 185.11.125.8
Redirect IPs 45.60.35.111
Response IP 45.60.35.111
Found Yes
Hash 52023c398743271731de1238bad4f1dcd2125dd9d886700b46ec02e33a924814
SimHash 431941370c2a

Groups

*

Rule Path
Disallow /search?
Disallow /it/search?
Disallow /page-not-found/
Disallow /c/portal/
Disallow /jobs-search/
Disallow /viewemailink/
Disallow /clientPortal/clientDashboard/
Disallow /DocExSignIn/beginSigningSession
Disallow /timesheetAlert/reviewTimesheet/
Disallow /timesheetAlert/approveTimesheet/
Disallow /gdprThankYou/
Disallow /careers/s/my-profile
Disallow /careers/s/saved-searches
Disallow /careers/s/manage-cv
Disallow /careers/s/change-email
Disallow /careers/s/change-password
Disallow /careers/s/marketing-preferences
Disallow /careers/s/alert
Disallow /careers/s/update-whatsapp
Disallow /careers/s/save-whatsapp
Disallow /careers/s/dk-marketing-preferences
Disallow /careers/s/dk-marketing-preferences/thankyou
Disallow /careers/login
Disallow /careers/login/forgot-password
Disallow /careers/partner/go1/training/login
Disallow /careers/partner/go1/training/register
Disallow /careers/partner/go1/training
Disallow /careers/all-offices
Disallow /careers/office-locator
Disallow /careers/recruiting-now
Disallow /careers/whatsAppAlert
Disallow /careers/email-confirmation
Disallow /careers/update-your-details
Disallow /careers/unsubscribe-email-confirmation
Disallow /careers/search
Disallow /ricerca-offerte*
Disallow /my-account/
Disallow /account/cv-success
Disallow /account/login
Disallow /account/offerte-salvate
Disallow /account/disiscrizione
Disallow /account/disiscrizione-email
Disallow /my-account/disiscrizione-email-conferma
Disallow /account/aggiorna-preferenze-email
Disallow /my-account/invio-preferenze-email
Disallow /my-account/preferenze-marketing
Disallow /my-account/preferenze-marketing-conferma
Disallow /account/invio-informazioni
Disallow /account/aggiorna-dati-privacy
Disallow /my-account/profilo
Disallow /my-account/job-alerts
Disallow /my-account/crea-job-alert-email
Disallow /my-account/job-alert-conferma
Disallow /my-account/cancella-alert
Disallow /my-account/gestisci-cv
Disallow /my-account/cambio-email
Disallow /my-account/cambio-password
Disallow /my-account/aggiorna-numero-whatsapp
Disallow /my-account/aggiorna-numero-whatsapp-email
Disallow /my-account/conferma-numero-whatsapp
Disallow /reset
Disallow /account/errore
Disallow /careers
Disallow /careers-ricerca
Disallow /posizioni-interne
Allow /o/hays-desktop-branding-theme/images/favicon.ico
Disallow /o/
Disallow /documents/63292/53424755/*/
Disallow /*.pdf

Other Records

Field Value
crawl-delay 10

omniexplorer_bot

Rule Path
Disallow /

yahooseeker/cafekelsa

Rule Path
Disallow /

wijubot/1.0

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

scoutjet

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

seoscanners.net/1

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

siteexplorer/1.0

Rule Path
Disallow /

siteexplorer/1.0b

Rule Path
Disallow /

curious george - www.analyticsseo.com/crawler

Rule Path
Disallow /

spbot

Rule Path
Disallow /

mozilla/5.0 (compatible; domainappender /1.0; +http://www.profound.net/domainappender)

Rule Path
Disallow /

sitecheck-sitecrawl by siteimprove.com

Rule Path
Disallow /

feedly/1.0

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

gigabot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

twiceler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

jobcrawlerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

innovantagebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

innovantagebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://www.hays.it/sitemap.xml