kalbi.pl
robots.txt

Robots Exclusion Standard data for kalbi.pl

Resource Scan

Scan Details

Site Domain kalbi.pl
Base Domain kalbi.pl
Scan Status Ok
Last Scan2024-09-22T02:42:57+00:00
Next Scan 2024-09-29T02:42:57+00:00

Last Scan

Scanned2024-09-22T02:42:57+00:00
URL https://kalbi.pl/robots.txt
Redirect https://www.kalbi.pl/robots.txt
Redirect Domain www.kalbi.pl
Redirect Base kalbi.pl
Domain IPs 94.152.140.52
Redirect IPs 94.152.140.52
Response IP 94.152.140.52
Found Yes
Hash 073b3fdc957e3c43ca1ed016f6e076b4bd70cdfa63d58e0a7f6edf66a2427d06
SimHash 6248c04146b5

Groups

*

Rule Path
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 15