community.babycentre.co.uk
robots.txt
Robots Exclusion Standard data for community.babycentre.co.uk
Resource Scan
Scan Details
| Site Domain | community.babycentre.co.uk |
| Base Domain | babycentre.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-24T15:11:26+00:00 |
| Next Scan | 2024-10-01T15:11:26+00:00 |
Last Scan
| Scanned | 2024-09-24T15:11:26+00:00 |
| URL | https://community.babycentre.co.uk/robots.txt |
| Domain IPs | 96.17.96.31, 96.17.96.5 |
| Response IP | 23.44.4.169 |
| Found | Yes |
| Hash | 119c7d9fd6da71c1093c960bf016d0c78efdee8ec33e3c8d912e1a1a3b82fce6 |
| SimHash | e554b850ef82 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /css-style-guide |
| Disallow | /a/iframe/ad/ |
| Disallow | /admin/* |
| Disallow | /comment/edit/* |
| Disallow | /groups/edit/* |
| Disallow | /groups/members/* |
| Disallow | /groups/pending/* |
| Disallow | /groups/create |
| Disallow | /post/create/* |
| Disallow | /post/edit/* |
| Disallow | /search |
| Disallow | /my-profile |
| Disallow | /my-profile/edit |
| Disallow | /my-profile/hidden-posts |
| Disallow | /my-messages/* |
| Disallow | /my-activity |
| Disallow | /my-bookmarks |
| Disallow | /abuse |
Other Records
| Field | Value |
|---|---|
| sitemap | https://community.babycentre.co.uk/sitemap.xml |
| sitemap | https://community.babycentre.co.uk/sitemap/recent-posts.xml |
| sitemap | https://community.babycentre.co.uk/sitemap/sitemap-dynamic.xml |