community.babycentre.co.uk
robots.txt
Robots Exclusion Standard data for community.babycentre.co.uk
Resource Scan
Scan Details
| Site Domain | community.babycentre.co.uk |
| Base Domain | babycentre.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-11-12T16:28:16+00:00 |
| Next Scan | 2024-11-19T16:28:16+00:00 |
Last Scan
| Scanned | 2024-11-12T16:28:16+00:00 |
| URL | https://community.babycentre.co.uk/robots.txt |
| Domain IPs | 96.17.96.10, 96.17.96.31 |
| Response IP | 23.44.4.184 |
| Found | Yes |
| Hash | 4c02d1113e2a6d9909f31e221eaf9927db80a129f6f2427323fb41b0dc53c97c |
| SimHash | e944b840ee82 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /css-style-guide |
| Disallow | /a/iframe/ad/ |
| Disallow | /admin/* |
| Disallow | /comment/edit/* |
| Disallow | /groups/edit/* |
| Disallow | /groups/members/* |
| Disallow | /groups/pending/* |
| Disallow | /groups/create |
| Disallow | /post/create/* |
| Disallow | /post/edit/* |
| Disallow | /search |
| Disallow | /my-profile |
| Disallow | /my-profile/edit |
| Disallow | /my-profile/hidden-posts |
| Disallow | /my-profile/blocked-accounts |
| Disallow | /my-messages/* |
| Disallow | /my-activity |
| Disallow | /my-bookmarks |
| Disallow | /abuse |
Other Records
| Field | Value |
|---|---|
| sitemap | https://community.babycentre.co.uk/sitemap.xml |
| sitemap | https://community.babycentre.co.uk/sitemap/recent-posts.xml |
| sitemap | https://community.babycentre.co.uk/sitemap/sitemap-dynamic.xml |