Log In Sign Up

babysits.ug
robots.txt

Robots Exclusion Standard data for babysits.ug

Resource Scan

Scan Details

Site Domain babysits.ug
Base Domain babysits.ug
Scan Status Ok
Last Scan2025-12-24T18:03:16+00:00
Next Scan 2025-12-31T18:03:16+00:00

Last Scan

Scanned2025-12-24T18:03:16+00:00
URL https://babysits.ug/robots.txt
Redirect https://www.babysits.ug/robots.txt
Redirect Domain www.babysits.ug
Redirect Base babysits.ug
Domain IPs 2600:9000:2721:1800:11:23ae:b340:93a1, 2600:9000:2721:4800:11:23ae:b340:93a1, 2600:9000:2721:6600:11:23ae:b340:93a1, 2600:9000:2721:6c00:11:23ae:b340:93a1, 2600:9000:2721:8a00:11:23ae:b340:93a1, 2600:9000:2721:b600:11:23ae:b340:93a1, 2600:9000:2721:e00:11:23ae:b340:93a1, 2600:9000:2721:fe00:11:23ae:b340:93a1, 3.165.102.122, 3.165.102.45, 3.165.102.74, 3.165.102.95
Redirect IPs 2600:9000:2721:1400:11:23ae:b340:93a1, 2600:9000:2721:3600:11:23ae:b340:93a1, 2600:9000:2721:400:11:23ae:b340:93a1, 2600:9000:2721:5000:11:23ae:b340:93a1, 2600:9000:2721:5a00:11:23ae:b340:93a1, 2600:9000:2721:9800:11:23ae:b340:93a1, 2600:9000:2721:ba00:11:23ae:b340:93a1, 2600:9000:2721:ee00:11:23ae:b340:93a1, 3.165.102.122, 3.165.102.45, 3.165.102.74, 3.165.102.95
Response IP 3.165.102.95
Found Yes
Hash 07e32abdc59c3393d8e5ea7a96bb96b6216f27ed9505a303cd5c274fe93dc79a
SimHash 74644820cf94

Groups

*

Rule Path
Disallow /*/*--*/
Disallow /*?*admin1_id=*
Disallow /*?*admin2_id=*

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mauibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bytespider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

imagesiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

heritrix

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

harvester

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://www.babysits.com/sitemaps/
Back to top

Comments

  • WE HELP PARENTS
  • #
  • #
  • # #
  • # #
  • # #
  • Hello bot, engineer, or very lost layperson! Welcome to your visit on the Babysits platform, we empower our members around childcare, globally.
  • If you're a human who likes solving interesting challenges with other humans, check out our careers page: https://www.babysits.org/careers/
  • If you're a bot who likes crawling webpages, please mind the house rules and avoid excessive crawling. We have a crawl-delay set for that.
  • Either way, thanks for stopping by!
  • See you on the next crawl!
Back to top