Log In Sign Up

babysits.hu
robots.txt

Robots Exclusion Standard data for babysits.hu

Resource Scan

Scan Details

Site Domain babysits.hu
Base Domain babysits.hu
Scan Status Ok
Last Scan2024-11-12T12:01:27+00:00
Next Scan 2024-11-19T12:01:27+00:00

Last Scan

Scanned2024-11-12T12:01:27+00:00
URL https://babysits.hu/robots.txt
Redirect https://www.babysits.hu/robots.txt
Redirect Domain www.babysits.hu
Redirect Base babysits.hu
Domain IPs 18.155.68.110, 18.155.68.23, 18.155.68.35, 18.155.68.71, 2600:9000:23d2:2e00:7:86c3:2580:93a1, 2600:9000:23d2:4a00:7:86c3:2580:93a1, 2600:9000:23d2:9a00:7:86c3:2580:93a1, 2600:9000:23d2:a000:7:86c3:2580:93a1, 2600:9000:23d2:b000:7:86c3:2580:93a1, 2600:9000:23d2:e400:7:86c3:2580:93a1, 2600:9000:23d2:e600:7:86c3:2580:93a1, 2600:9000:23d2:ee00:7:86c3:2580:93a1
Redirect IPs 18.155.68.110, 18.155.68.23, 18.155.68.35, 18.155.68.71, 2600:9000:23d2:2800:7:86c3:2580:93a1, 2600:9000:23d2:4e00:7:86c3:2580:93a1, 2600:9000:23d2:5400:7:86c3:2580:93a1, 2600:9000:23d2:6c00:7:86c3:2580:93a1, 2600:9000:23d2:8e00:7:86c3:2580:93a1, 2600:9000:23d2:c600:7:86c3:2580:93a1, 2600:9000:23d2:c800:7:86c3:2580:93a1, 2600:9000:23d2:fc00:7:86c3:2580:93a1
Response IP 18.155.68.71
Found Yes
Hash 10d64c9dfaf62689c3b3757da77db5333c4ccf4ecda0325c99bf731f436953e1
SimHash 7464c030cf34

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

mauibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

dataforseobot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

barkrowler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bytespider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

serpstatbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

gptbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

imagesiftbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

heritrix

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

harvester

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

blexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

megaindex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

*

Rule Path
Allow /
Back to top

Comments

  • WE HELP PARENTS
  • #
  • #
  • # #
  • # #
  • # #
  • Hello bot, engineer, or very lost layperson! Welcome to your visit on the Babysits platform, we empower our members around childcare, globally.
  • If you're a human who likes solving interesting challenges with other humans, check out our careers page: https://www.airbnb.org/careers/
  • If you're a bot who likes crawling webpages, please mind the house rules and avoid excessive crawling. We have a crawl-delay set for that.
  • Either way, thanks for stopping by!
  • See you on the next crawl!
Back to top