babycenter.com
robots.txt
Robots Exclusion Standard data for babycenter.com
Resource Scan
Scan Details
| Site Domain | babycenter.com |
| Base Domain | babycenter.com |
| Scan Status | Ok |
| Last Scan | 2024-05-11T01:49:13+00:00 |
| Next Scan | 2024-05-18T01:49:13+00:00 |
Last Scan
| Scanned | 2024-05-11T01:49:13+00:00 |
| URL | https://babycenter.com/robots.txt |
| Redirect | https://www.babycenter.com/robots.txt |
| Redirect Domain | www.babycenter.com |
| Redirect Base | babycenter.com |
| Domain IPs | 100.21.56.11, 52.43.206.179 |
| Redirect IPs | 23.59.168.97 |
| Response IP | 23.59.168.97 |
| Found | Yes |
| Hash | 2d6c20ff0d78e723ba61e5644ba145b5552b1151ac8e14371e08ae353f881829 |
| SimHash | e244b9c8819b |
Groups
*
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /components/ad/display_ad.htm |
| Disallow | /emailAFriend.htm |
| Disallow | /html/thirdPartyPixel.html |
| Disallow | /html/3rdParty/ |
| Disallow | /track/diapers.htm |
| Disallow | /search/gear.htm |
| Disallow | /search.htm |
| Disallow | /swf/ |
| Disallow | /styleguide.htm |
| Disallow | /postQuestion.htm |
| Disallow | /myBabyNameList.htm |
| Disallow | /accountDetails.htm |
| Disallow | /subscriptionDetails.htm |
| Disallow | /secure/myFamily.htm |
| Disallow | /baby-name-poll |
| Disallow | /site/unsubscribe |
| Disallow | /updatePassword.htm |
| Disallow | /ajax/registrationForm.htm* |
| Disallow | /affiliate/register.htm* |
| Disallow | /affiliate/screenname.htm |
| Disallow | /requireScreenname.htm |
| Disallow | /myQuestions.htm |
| Disallow | /myBookmarks.htm |
| Disallow | /mission-motherhood/wp-admin/admin-ajax.php |
| Disallow | /ws/ajax/* |
| Disallow | /mustache/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.babycenter.com/sitemap-expert.xml |
| sitemap | https://www.babycenter.com/sitemap/sitemap-babynames-index.xml |
| sitemap | https://www.babycenter.com/sitemap/sitemap-video1.xml |