bumpbabyme.com
robots.txt

Robots Exclusion Standard data for bumpbabyme.com

Resource Scan

Scan Details

Site Domain bumpbabyme.com
Base Domain bumpbabyme.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-11-25T17:55:20+00:00
Next Scan 2026-02-23T17:55:20+00:00

Last Successful Scan

Scanned2025-04-07T14:08:34+00:00
URL https://bumpbabyme.com/robots.txt
Domain IPs 104.21.59.134, 172.67.177.234, 2606:4700:3030::6815:3b86, 2606:4700:3037::ac43:b1ea
Response IP 172.67.177.234
Found Yes
Hash 2a3144f4682e401e80102bac8e1995f38ef38b6858f5c8c974e9bd903c6a74fc
SimHash ee1adad1a723

Groups

*

Rule Path
Allow /
Disallow /api*
Disallow /?page=*
Disallow /blog/?page=*
Disallow /assets/*
Disallow /cdn*
Allow /blog?page=1

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://bumpbabyme.com/sitemap.xml

Comments

  • Add delay between requests