kaszubskidworek.pl
robots.txt

Robots Exclusion Standard data for kaszubskidworek.pl

Resource Scan

Scan Details

Site Domain kaszubskidworek.pl
Base Domain kaszubskidworek.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-08T19:07:00+00:00
Next Scan 2024-07-07T19:07:00+00:00

Last Successful Scan

Scanned2022-01-19T07:51:56+00:00
URL http://kaszubskidworek.pl/robots.txt
Response IP 193.222.135.84
Found Yes
Hash 7818a7c38498b34cc8f8af8200a22b7e5e36fd475d41bf6c486a40e5d36865b2
SimHash a25ada4263b8

Groups

*

Rule Path
Disallow /files/ajax/ajax_loader.js

*

Rule Path
Disallow /photo.php

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

twiceler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

gigabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /