babycenter.com.au
robots.txt
Robots Exclusion Standard data for babycenter.com.au
Resource Scan
Scan Details
| Site Domain | babycenter.com.au |
| Base Domain | babycenter.com.au |
| Scan Status | Ok |
| Last Scan | 2024-11-07T15:55:59+00:00 |
| Next Scan | 2024-11-14T15:55:59+00:00 |
Last Scan
| Scanned | 2024-11-07T15:55:59+00:00 |
| URL | https://babycenter.com.au/robots.txt |
| Redirect | https://www.babycenter.com.au/robots.txt |
| Redirect Domain | www.babycenter.com.au |
| Redirect Base | babycenter.com.au |
| Domain IPs | 44.225.103.62, 52.88.230.160 |
| Redirect IPs | 96.17.96.10, 96.17.96.31 |
| Response IP | 23.44.5.129 |
| Found | Yes |
| Hash | 7bf34844fc6a7c283fd19a57c90355c8edef6d71d7ed20e79435f4ad8d361d97 |
| SimHash | e154b848bd88 |
Groups
*
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /css-style-guide |
| Disallow | /a/iframe/ad/ |
| Disallow | /admin/* |
| Disallow | /comment/edit/* |
| Disallow | /groups/edit/* |
| Disallow | /groups/members/* |
| Disallow | /groups/pending/* |
| Disallow | /groups/create |
| Disallow | /post/create/* |
| Disallow | /post/edit/* |
| Disallow | /search |
| Disallow | /my-profile |
| Disallow | /my-profile/edit |
| Disallow | /my-profile/hidden-posts |
| Disallow | /my-profile/blocked-accounts |
| Disallow | /my-messages/* |
| Disallow | /my-activity |
| Disallow | /my-bookmarks |
| Disallow | /abuse |
| Disallow | /components/ad/display_ad.htm |
| Disallow | /emailAFriend.htm |
| Disallow | /html/thirdPartyPixel.html |
| Disallow | /html/3rdParty/ |
| Disallow | /track/diapers.htm |
| Disallow | /search/gear.htm |
| Disallow | /search.htm |
| Disallow | /swf/ |
| Disallow | /styleguide.htm |
| Disallow | /postQuestion.htm |
| Disallow | /myBabyNameList.htm |
| Disallow | /accountDetails.htm |
| Disallow | /subscriptionDetails.htm |
| Disallow | /secure/myFamily.htm |
| Disallow | /baby-name-poll |
| Disallow | /site/unsubscribe |
| Disallow | /updatePassword.htm |
| Disallow | /ajax/registrationForm.htm* |
| Disallow | /affiliate/register.htm* |
| Disallow | /affiliate/screenname.htm |
| Disallow | /requireScreenname.htm |
| Disallow | /myQuestions.htm |
| Disallow | /myBookmarks.htm |
| Disallow | /mission-motherhood/wp-admin/admin-ajax.php |
| Disallow | /ws/ajax/* |
| Disallow | /mustache/* |
| Disallow | /secure/ |
| Disallow | /site/ |
| Disallow | /hello |
| Disallow | /doubleclick/ |
| Disallow | /ws/ |
| Disallow | /akamai/ |
| Disallow | /search |
| Disallow | /group/ |
| Disallow | /delete |
| Disallow | /gampad/jump |
| Disallow | /gampad/ad |
| Disallow | /app/id |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.babycenter.com.au/sitemap.xml |
| sitemap | https://www.babycenter.com.au/sitemap/recent-posts.xml |
| sitemap | https://www.babycenter.com.au/sitemap/sitemap-dynamic.xml |
| sitemap | https://www.babycenter.com.au/sitemap-expert.xml |
| sitemap | https://www.babycenter.com.au/sitemap/sitemap-babynames-index.xml |
| sitemap | https://www.babycenter.com.au/sitemap/sitemap-video1.xml |