babycentre.com
robots.txt
Robots Exclusion Standard data for babycentre.com
Resource Scan
Scan Details
| Site Domain | babycentre.com |
| Base Domain | babycentre.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T22:22:58+00:00 |
| Next Scan | 2024-11-22T22:22:58+00:00 |
Last Scan
| Scanned | 2024-11-15T22:22:58+00:00 |
| URL | https://babycentre.com/robots.txt |
| Redirect | https://www.babycentre.co.uk/robots.txt |
| Redirect Domain | www.babycentre.co.uk |
| Redirect Base | babycentre.co.uk |
| Domain IPs | 44.236.169.44, 52.88.230.160 |
| Redirect IPs | 23.59.168.97 |
| Response IP | 23.59.168.97 |
| Found | Yes |
| Hash | f4358369652a6f48beb01fc4ef9d8865fd98e4df5e45246b2b7f2f33a5b4a051 |
| SimHash | e840b948898b |
Groups
*
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /components/ad/display_ad.htm |
| Disallow | /emailAFriend.htm |
| Disallow | /html/thirdPartyPixel.html |
| Disallow | /html/3rdParty/ |
| Disallow | /track/diapers.htm |
| Disallow | /search/gear.htm |
| Disallow | /search.htm |
| Disallow | /swf/ |
| Disallow | /styleguide.htm |
| Disallow | /postQuestion.htm |
| Disallow | /myBabyNameList.htm |
| Disallow | /accountDetails.htm |
| Disallow | /subscriptionDetails.htm |
| Disallow | /secure/myFamily.htm |
| Disallow | /baby-name-poll |
| Disallow | /site/unsubscribe |
| Disallow | /updatePassword.htm |
| Disallow | /ajax/registrationForm.htm* |
| Disallow | /affiliate/register.htm* |
| Disallow | /affiliate/screenname.htm |
| Disallow | /requireScreenname.htm |
| Disallow | /myQuestions.htm |
| Disallow | /myBookmarks.htm |
| Disallow | /mission-motherhood/wp-admin/admin-ajax.php |
| Disallow | /ws/ajax/* |
| Disallow | /mustache/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.babycentre.co.uk/sitemap-expert.xml |
| sitemap | https://www.babycentre.co.uk/sitemap/sitemap-babynames-index.xml |
| sitemap | https://www.babycentre.co.uk/sitemap/sitemap-video1.xml |