manpower.co.uk
robots.txt

Robots Exclusion Standard data for manpower.co.uk

Resource Scan

Scan Details

Site Domain manpower.co.uk
Base Domain manpower.co.uk
Scan Status Ok
Last Scan2024-05-02T18:01:18+00:00
Next Scan 2024-06-01T18:01:18+00:00

Last Scan

Scanned2024-05-02T18:01:18+00:00
URL https://manpower.co.uk/robots.txt
Redirect https://www.manpower.co.uk/robots.txt
Redirect Domain www.manpower.co.uk
Redirect Base manpower.co.uk
Domain IPs 104.18.43.88, 172.64.144.168, 2606:4700:4400::6812:2b58, 2606:4700:4400::ac40:90a8
Redirect IPs 99.84.66.3, 99.84.66.40, 99.84.66.58, 99.84.66.59
Response IP 18.165.171.45
Found Yes
Hash 7004e39f5500bdab73686639e70ea1f67ec4efb7257387cdc97cf97f617a705c
SimHash 28107f544e94

Groups

*

Rule Path
Disallow /session-img/
Disallow /invalid-request/
Disallow /document/
Disallow /analytics/
Disallow */searchjobs/*
Disallow */jobsrss/*
Disallow /jobsrss/*
Disallow */jbequicksignup/*
Disallow */emailjob/*
Disallow /your-jobs*
Disallow */previewjob/*

Other Records

Field Value
sitemap https://www.manpower.co.uk/sitemapindex.xml

Comments

  • Robot exclusion file
  • The following pages require registration and login