workingdads.co.uk
robots.txt

Robots Exclusion Standard data for workingdads.co.uk

Resource Scan

Scan Details

Site Domain workingdads.co.uk
Base Domain workingdads.co.uk
Scan Status Ok
Last Scan2024-10-04T06:31:57+00:00
Next Scan 2024-10-11T06:31:57+00:00

Last Scan

Scanned2024-10-04T06:31:57+00:00
URL https://workingdads.co.uk/robots.txt
Redirect https://www.workingdads.co.uk/robots.txt
Redirect Domain www.workingdads.co.uk
Redirect Base workingdads.co.uk
Domain IPs 104.21.58.208, 172.67.164.171, 2606:4700:3032::6815:3ad0, 2606:4700:3033::ac43:a4ab
Redirect IPs 104.21.58.208, 172.67.164.171, 2606:4700:3032::6815:3ad0, 2606:4700:3033::ac43:a4ab
Response IP 104.21.58.208
Found Yes
Hash 355f5c123c587b58ce371b11f782cb26bfee508bd83df1560a6a8adc5bdd0017
SimHash 49011040c792

Groups

rogerbot

Rule Path
Disallow /jobs/

*

Rule Path
Disallow /wp-admin/
Disallow /jobs/your-jobs/*
Disallow /jobs/jbequicksignup/*
Disallow /jobs/jobsrss/*
Disallow /jobs/find/*/*/*/*
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://www.workingdads.co.uk/sitemap_index.xml