babycenter.com.au
robots.txt
Robots Exclusion Standard data for babycenter.com.au
Resource Scan
Scan Details
| Site Domain | babycenter.com.au |
| Base Domain | babycenter.com.au |
| Scan Status | Ok |
| Last Scan | 2024-06-27T06:39:14+00:00 |
| Next Scan | 2024-07-04T06:39:14+00:00 |
Last Scan
| Scanned | 2024-06-27T06:39:14+00:00 |
| URL | https://babycenter.com.au/robots.txt |
| Redirect | https://www.babycenter.com.au/robots.txt |
| Redirect Domain | www.babycenter.com.au |
| Redirect Base | babycenter.com.au |
| Domain IPs | 35.165.50.207, 44.239.108.29 |
| Redirect IPs | 104.81.138.122, 104.81.138.16 |
| Response IP | 23.50.232.243 |
| Found | Yes |
| Hash | ca586bab527f81bc8cac3dcdcdf76c61981f6834547a149d52594310cd14435b |
| SimHash | e054b848bd98 |
Groups
*
adsbot-google
| Rule | Path |
|---|---|
| Disallow | /css-style-guide |
| Disallow | /a/iframe/ad/ |
| Disallow | /admin/* |
| Disallow | /comment/edit/* |
| Disallow | /groups/edit/* |
| Disallow | /groups/members/* |
| Disallow | /groups/pending/* |
| Disallow | /groups/create |
| Disallow | /post/create/* |
| Disallow | /post/edit/* |
| Disallow | /search |
| Disallow | /my-profile |
| Disallow | /my-profile/edit |
| Disallow | /my-profile/hidden-posts |
| Disallow | /my-messages |
| Disallow | /my-activity |
| Disallow | /my-bookmarks |
| Disallow | /abuse |
| Disallow | /components/ad/display_ad.htm |
| Disallow | /emailAFriend.htm |
| Disallow | /html/thirdPartyPixel.html |
| Disallow | /html/3rdParty/ |
| Disallow | /track/diapers.htm |
| Disallow | /search/gear.htm |
| Disallow | /search.htm |
| Disallow | /swf/ |
| Disallow | /styleguide.htm |
| Disallow | /postQuestion.htm |
| Disallow | /myBabyNameList.htm |
| Disallow | /accountDetails.htm |
| Disallow | /subscriptionDetails.htm |
| Disallow | /secure/myFamily.htm |
| Disallow | /baby-name-poll |
| Disallow | /site/unsubscribe |
| Disallow | /updatePassword.htm |
| Disallow | /ajax/registrationForm.htm* |
| Disallow | /affiliate/register.htm* |
| Disallow | /affiliate/screenname.htm |
| Disallow | /requireScreenname.htm |
| Disallow | /myQuestions.htm |
| Disallow | /myBookmarks.htm |
| Disallow | /mission-motherhood/wp-admin/admin-ajax.php |
| Disallow | /ws/ajax/* |
| Disallow | /mustache/* |
| Disallow | /secure/ |
| Disallow | /site/ |
| Disallow | /hello |
| Disallow | /doubleclick/ |
| Disallow | /ws/ |
| Disallow | /akamai/ |
| Disallow | /search |
| Disallow | /group/ |
| Disallow | /delete |
| Disallow | /gampad/jump |
| Disallow | /gampad/ad |
| Disallow | /app/id |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.babycenter.com.au/sitemap.xml |
| sitemap | https://www.babycenter.com.au/sitemap/recent-posts.xml |
| sitemap | https://www.babycenter.com.au/sitemap/sitemap-dynamic.xml |
| sitemap | https://www.babycenter.com.au/sitemap-expert.xml |
| sitemap | https://www.babycenter.com.au/sitemap/sitemap-babynames-index.xml |
| sitemap | https://www.babycenter.com.au/sitemap/sitemap-video1.xml |