Log In Sign Up

babysits.my
robots.txt

Robots Exclusion Standard data for babysits.my

Resource Scan

Scan Details

Site Domain babysits.my
Base Domain babysits.my
Scan Status Ok
Last Scan2026-02-22T16:50:15+00:00
Next Scan 2026-03-01T16:50:15+00:00

Last Scan

Scanned2026-02-22T16:50:15+00:00
URL https://babysits.my/robots.txt
Redirect https://www.babysits.my/robots.txt
Redirect Domain www.babysits.my
Redirect Base babysits.my
Domain IPs 138.199.46.68, 2400:52e0:1500::1272:1
Redirect IPs 138.199.24.219, 2400:52e0:1500::1274:1
Response IP 138.199.46.65
Found Yes
Hash d7d8e217dcd69c02edd7b1523737ee4e759638411cf3cb05de99dc0897b6ef3c
SimHash 7c644001efb4

Groups

*

Rule Path
Disallow /*/*--*/
Disallow /*?*admin1_id=*
Disallow /*?*admin2_id=*
Disallow /*sms%3A*
Disallow /*fb-messenger%3A*
Disallow /*mailto%3A*

Other Records

Field Value
crawl-delay 1

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

mauibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

bytespider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

imagesiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

heritrix

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

harvester

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3
Back to top

Other Records

Field Value
sitemap https://www.babysits.com/sitemaps/
Back to top

Comments

  • WE HELP PARENTS
  • #
  • #
  • # #
  • # #
  • # #
  • Hello bot, engineer, or very lost layperson! Welcome to your visit on the Babysits platform, we empower our members around childcare, globally.
  • If you're a human who likes solving interesting challenges with other humans, check out our careers page: https://www.babysits.org/careers/
  • If you're a bot who likes crawling webpages, please mind the house rules and avoid excessive crawling. We have a crawl-delay set for that.
  • Either way, thanks for stopping by!
  • See you on the next crawl!
Back to top