babycenter.ca
robots.txt
Robots Exclusion Standard data for babycenter.ca
Resource Scan
Scan Details
Site Domain | babycenter.ca |
Base Domain | babycenter.ca |
Scan Status | Ok |
Last Scan | 2024-06-24T16:51:14+00:00 |
Next Scan | 2024-07-01T16:51:14+00:00 |
Last Scan
Scanned | 2024-06-24T16:51:14+00:00 |
URL | https://babycenter.ca/robots.txt |
Redirect | https://www.babycenter.ca/robots.txt |
Redirect Domain | www.babycenter.ca |
Redirect Base | babycenter.ca |
Domain IPs | 35.165.50.207, 44.239.108.29 |
Redirect IPs | 23.44.5.129, 23.44.5.99 |
Response IP | 104.88.70.139 |
Found | Yes |
Hash | c9391f184a6dac9c0a2945ac0ef3f4c8660a522774d51daf9e94610214fd67e2 |
SimHash | e05038c8fc8a |
Groups
*
adsbot-google
Rule | Path |
---|---|
Disallow | /css-style-guide |
Disallow | /a/iframe/ad/ |
Disallow | /admin/* |
Disallow | /comment/edit/* |
Disallow | /groups/edit/* |
Disallow | /groups/members/* |
Disallow | /groups/pending/* |
Disallow | /groups/create |
Disallow | /post/create/* |
Disallow | /post/edit/* |
Disallow | /search |
Disallow | /my-profile |
Disallow | /my-profile/edit |
Disallow | /my-profile/hidden-posts |
Disallow | /my-messages |
Disallow | /my-activity |
Disallow | /my-bookmarks |
Disallow | /abuse |
Disallow | /components/ad/display_ad.htm |
Disallow | /emailAFriend.htm |
Disallow | /html/thirdPartyPixel.html |
Disallow | /html/3rdParty/ |
Disallow | /track/diapers.htm |
Disallow | /search/gear.htm |
Disallow | /search.htm |
Disallow | /swf/ |
Disallow | /styleguide.htm |
Disallow | /postQuestion.htm |
Disallow | /myBabyNameList.htm |
Disallow | /accountDetails.htm |
Disallow | /subscriptionDetails.htm |
Disallow | /secure/myFamily.htm |
Disallow | /baby-name-poll |
Disallow | /site/unsubscribe |
Disallow | /updatePassword.htm |
Disallow | /ajax/registrationForm.htm* |
Disallow | /affiliate/register.htm* |
Disallow | /affiliate/screenname.htm |
Disallow | /requireScreenname.htm |
Disallow | /myQuestions.htm |
Disallow | /myBookmarks.htm |
Disallow | /mission-motherhood/wp-admin/admin-ajax.php |
Disallow | /ws/ajax/* |
Disallow | /mustache/* |
Disallow | /secure/ |
Disallow | /site/ |
Disallow | /hello |
Disallow | /doubleclick/ |
Disallow | /ws/ |
Disallow | /akamai/ |
Disallow | /search |
Disallow | /group/ |
Disallow | /delete |
Disallow | /gampad/jump |
Disallow | /gampad/ad |
Disallow | /app/id |
Other Records
Field | Value |
---|---|
sitemap | https://www.babycenter.ca/sitemap.xml |
sitemap | https://www.babycenter.ca/sitemap/recent-posts.xml |
sitemap | https://www.babycenter.ca/sitemap/sitemap-dynamic.xml |
sitemap | https://www.babycenter.ca/sitemap-expert.xml |
sitemap | https://www.babycenter.ca/sitemap/sitemap-babynames-index.xml |
sitemap | https://www.babycenter.ca/sitemap/sitemap-video1.xml |