hartvillekitchen.com
robots.txt

Robots Exclusion Standard data for hartvillekitchen.com

Resource Scan

Scan Details

Site Domain hartvillekitchen.com
Base Domain hartvillekitchen.com
Scan Status Ok
Last Scan4/2/2025, 6:25:24 PM
Next Scan 4/16/2025, 6:25:24 PM

Last Scan

Scanned4/2/2025, 6:25:24 PM
URL https://hartvillekitchen.com/robots.txt
Domain IPs 104.21.69.22, 172.67.202.213, 2606:4700:3030::ac43:cad5, 2606:4700:3033::6815:4516
Response IP 104.21.69.22
Found Yes
Hash ce4c1c4eac6c791e6c5ec0462bf4a6aa600972f7799170d158b12febd31669d5
SimHash 0e5bf2d06502

Groups

googlebot

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

apis-google

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

mediapartners-google

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

slurp

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

duckduckbot

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

facebot

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

ia_archiver

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

baiduspider

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

yandexbot

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

exabot

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

applebot

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/

Other Records

Field Value
crawl-delay 10

*

Rule Path
Disallow /

Comments

  • Google
  • Google APIs
  • Google Media Partners
  • Microsoft Bing
  • Yahoo
  • Duck Duck Go
  • Facebook
  • Amazon Alexa
  • Baidu Search Engine
  • Yandex Search Engine
  • Exa Search Engine
  • Apple
  • Block all others