workingmums.co.uk
robots.txt

Robots Exclusion Standard data for workingmums.co.uk

Resource Scan

Scan Details

Site Domain workingmums.co.uk
Base Domain workingmums.co.uk
Scan Status Ok
Last Scan2024-11-09T19:52:33+00:00
Next Scan 2024-11-16T19:52:33+00:00

Last Scan

Scanned2024-11-09T19:52:33+00:00
URL https://workingmums.co.uk/robots.txt
Redirect https://www.workingmums.co.uk/robots.txt
Redirect Domain www.workingmums.co.uk
Redirect Base workingmums.co.uk
Domain IPs 104.21.62.223, 172.67.139.213, 2606:4700:3031::6815:3edf, 2606:4700:3034::ac43:8bd5
Redirect IPs 104.21.62.223, 172.67.139.213, 2606:4700:3031::6815:3edf, 2606:4700:3034::ac43:8bd5
Response IP 104.21.62.223
Found Yes
Hash f3f21ca14e3d895a5aab3913afc991fc63c775224be6ff259b34b38468e735cd
SimHash 43019040c792

Groups

rogerbot

Rule Path
Disallow /jobs/

*

Rule Path
Disallow /wp-admin/
Disallow /jobs/your-jobs/*
Disallow /jobs/jbequicksignup/*
Disallow /jobs/jobsrss/*
Disallow /jobs/find/*/*/*/*
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 15

Other Records

Field Value
sitemap https://www.workingmums.co.uk/sitemap_index.xml