dwpjobs-eorecruitment-microsite.co.uk
robots.txt

Robots Exclusion Standard data for dwpjobs-eorecruitment-microsite.co.uk

Resource Scan

Scan Details

Site Domain dwpjobs-eorecruitment-microsite.co.uk
Base Domain dwpjobs-eorecruitment-microsite.co.uk
Scan Status Ok
Last Scan2024-09-02T08:44:23+00:00
Next Scan 2024-10-02T08:44:23+00:00

Last Scan

Scanned2024-09-02T08:44:23+00:00
URL https://dwpjobs-eorecruitment-microsite.co.uk/robots.txt
Domain IPs 2600:9000:23d0:4a00:d:6787:1100:93a1, 2600:9000:23d0:6a00:d:6787:1100:93a1, 2600:9000:23d0:aa00:d:6787:1100:93a1, 2600:9000:23d0:c00:d:6787:1100:93a1, 2600:9000:23d0:cc00:d:6787:1100:93a1, 2600:9000:23d0:ce00:d:6787:1100:93a1, 2600:9000:23d0:d600:d:6787:1100:93a1, 2600:9000:23d0:d800:d:6787:1100:93a1, 65.9.112.15, 65.9.112.53, 65.9.112.76, 65.9.112.90
Response IP 3.160.246.104
Found Yes
Hash e98cd82ec43383a4aab79e954549e8272498d9421b1896976f09a7bf62e2e6f9
SimHash e90d1c48abd3

Groups

*

Rule Path
Disallow /documents/
Disallow /cymraeg/documents/

Other Records

Field Value
sitemap https://www.dwpjobs-eorecruitment-microsite.co.uk/sitemap.xml