hartvillekitchen.com
robots.txt
Robots Exclusion Standard data for hartvillekitchen.com
Resource Scan
Scan Details
Site Domain | hartvillekitchen.com |
Base Domain | hartvillekitchen.com |
Scan Status | Ok |
Last Scan | 4/2/2025, 6:25:24 PM |
Next Scan | 4/16/2025, 6:25:24 PM |
Last Scan
Scanned | 4/2/2025, 6:25:24 PM |
URL | https://hartvillekitchen.com/robots.txt |
Domain IPs | 104.21.69.22, 172.67.202.213, 2606:4700:3030::ac43:cad5, 2606:4700:3033::6815:4516 |
Response IP | 104.21.69.22 |
Found | Yes |
Hash | ce4c1c4eac6c791e6c5ec0462bf4a6aa600972f7799170d158b12febd31669d5 |
SimHash | 0e5bf2d06502 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
apis-google
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
mediapartners-google
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
bingbot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
duckduckbot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
facebot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
ia_archiver
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
baiduspider
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
yandexbot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
exabot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
applebot
Rule | Path |
---|---|
Disallow | /wp-admin/ |
Disallow | /wp-includes/ |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
*
Rule | Path |
---|---|
Disallow | / |
Comments