bonschocolatiers.com
robots.txt

Robots Exclusion Standard data for bonschocolatiers.com

Resource Scan

Scan Details

Site Domain bonschocolatiers.com
Base Domain bonschocolatiers.com
Scan Status Ok
Last Scan2024-09-30T18:38:09+00:00
Next Scan 2024-10-30T18:38:09+00:00

Last Scan

Scanned2024-09-30T18:38:09+00:00
URL https://bonschocolatiers.com/robots.txt
Redirect https://www.bonschocolatiers.com/robots.txt
Redirect Domain www.bonschocolatiers.com
Redirect Base bonschocolatiers.com
Domain IPs 2001:41d0:301::26, 87.98.154.146
Redirect IPs 2001:41d0:301::26, 87.98.154.146
Response IP 87.98.154.146
Found Yes
Hash 17a48a2588a6263f3789a8247ed1993134a22c21c1f3ce8e40ba47fa0a117ab3
SimHash eb559460eab6

Groups

*

Rule Path
Disallow /_Htmls/
Disallow /_Data/
Disallow /_Logs/
Disallow /downloads/

seekportbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

megaindex.ru

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

megaindex.com

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap /_Sitemaps/index.xml

Warnings

  • `host` is not a known field.