behappyfamily.com
robots.txt

Robots Exclusion Standard data for behappyfamily.com

Resource Scan

Scan Details

Site Domain behappyfamily.com
Base Domain behappyfamily.com
Scan Status Ok
Last Scan2024-09-30T22:11:16+00:00
Next Scan 2024-10-07T22:11:16+00:00

Last Scan

Scanned2024-09-30T22:11:16+00:00
URL https://behappyfamily.com/robots.txt
Domain IPs 104.21.42.92, 172.67.160.118, 2606:4700:3033::ac43:a076, 2606:4700:3036::6815:2a5c
Response IP 104.21.42.92
Found Yes
Hash 73d10f75296bcf347461a03d8e4e6a2d6cdd5ff6199abeb3dc38697202e4985b
SimHash 4d5098654791

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-video

Rule Path
Disallow

nerdbynature

Rule Path
Disallow /

openhosebot

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://behappyfamily.com/sitemap.xml

Warnings

  • `host` is not a known field.