community.babycenter.com
robots.txt

Robots Exclusion Standard data for community.babycenter.com

Resource Scan

Scan Details

Site Domain community.babycenter.com
Base Domain babycenter.com
Scan Status Ok
Last Scan2024-11-02T14:52:10+00:00
Next Scan 2024-11-09T14:52:10+00:00

Last Scan

Scanned2024-11-02T14:52:10+00:00
URL https://community.babycenter.com/robots.txt
Domain IPs 96.17.96.10, 96.17.96.31
Response IP 23.209.46.157
Found Yes
Hash 2406b9ec06dc5b133f846641c896bec409375acd336bce55c3e6583af66de6e5
SimHash e954b8c0ea80

Groups

*

Rule Path
Disallow /css-style-guide
Disallow /a/iframe/ad/
Disallow /admin/*
Disallow /comment/edit/*
Disallow /groups/edit/*
Disallow /groups/members/*
Disallow /groups/pending/*
Disallow /groups/create
Disallow /post/create/*
Disallow /post/edit/*
Disallow /search
Disallow /my-profile
Disallow /my-profile/edit
Disallow /my-profile/hidden-posts
Disallow /my-profile/blocked-accounts
Disallow /my-messages/*
Disallow /my-activity
Disallow /my-bookmarks
Disallow /abuse

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

Other Records

Field Value
sitemap https://community.babycenter.com/sitemap.xml
sitemap https://community.babycenter.com/sitemap/recent-posts.xml
sitemap https://community.babycenter.com/sitemap/sitemap-dynamic.xml