workingmums.co.uk
robots.txt
Robots Exclusion Standard data for workingmums.co.uk
Resource Scan
Scan Details
Site Domain | workingmums.co.uk |
Base Domain | workingmums.co.uk |
Scan Status | Ok |
Last Scan | 2024-11-09T19:52:33+00:00 |
Next Scan | 2024-11-16T19:52:33+00:00 |
Last Scan
Scanned | 2024-11-09T19:52:33+00:00 |
URL | https://workingmums.co.uk/robots.txt |
Redirect | https://www.workingmums.co.uk/robots.txt |
Redirect Domain | www.workingmums.co.uk |
Redirect Base | workingmums.co.uk |
Domain IPs | 104.21.62.223, 172.67.139.213, 2606:4700:3031::6815:3edf, 2606:4700:3034::ac43:8bd5 |
Redirect IPs | 104.21.62.223, 172.67.139.213, 2606:4700:3031::6815:3edf, 2606:4700:3034::ac43:8bd5 |
Response IP | 104.21.62.223 |
Found | Yes |
Hash | f3f21ca14e3d895a5aab3913afc991fc63c775224be6ff259b34b38468e735cd |
SimHash | 43019040c792 |
Groups
*
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /jobs/your-jobs/* |
Disallow | /jobs/jbequicksignup/* |
Disallow | /jobs/jobsrss/* |
Disallow | /jobs/find/*/*/*/* |
Allow | /wp-admin/admin-ajax.php |
Other Records
Field | Value |
---|---|
crawl-delay | 15 |
Other Records
Field | Value |
---|---|
sitemap | https://www.workingmums.co.uk/sitemap_index.xml |