scotland-jobs.co.uk
robots.txt

Robots Exclusion Standard data for scotland-jobs.co.uk

Resource Scan

Scan Details

Site Domain scotland-jobs.co.uk
Base Domain scotland-jobs.co.uk
Scan Status Ok
Last Scan2024-06-25T16:34:50+00:00
Next Scan 2024-07-02T16:34:50+00:00

Last Scan

Scanned2024-06-25T16:34:50+00:00
URL https://scotland-jobs.co.uk/robots.txt
Redirect https://www.scotland-jobs.co.uk/robots.txt
Redirect Domain www.scotland-jobs.co.uk
Redirect Base scotland-jobs.co.uk
Domain IPs 109.169.5.15
Redirect IPs 109.169.5.15
Response IP 109.169.5.15
Found Yes
Hash 9b4128e49e4d0da97c4ddfb5e8973d6d3a5cde070e106cd35580b78f8a1f4cd3
SimHash 110818e0c738

Groups

*

Rule Path
Disallow /search-jobs?*
Disallow /job/*/*/apply
Disallow /job/*/*/apply/external
Disallow /job/*/*/email
Disallow /login/
Disallow /aff/*
Disallow /candidate/
Disallow /cgi-bin
Disallow /job-alerts
Disallow /companies*
Disallow /list-jobs*

Other Records

Field Value
sitemap https://www.scotland-jobs.co.uk/sitemaps/jobs-index.xml
sitemap https://www.scotland-jobs.co.uk/sitemaps/job-posts-index.xml