apartamentynawydmie.com.pl
robots.txt

Robots Exclusion Standard data for apartamentynawydmie.com.pl

Resource Scan

Scan Details

Site Domain apartamentynawydmie.com.pl
Base Domain apartamentynawydmie.com.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-27T15:03:14+00:00
Next Scan 2024-11-25T15:03:14+00:00

Last Successful Scan

Scanned2023-02-05T06:45:44+00:00
URL http://apartamentynawydmie.com.pl/robots.txt
Domain IPs 193.222.135.84
Response IP 193.222.135.84
Found Yes
Hash c062b43931fc8f6431dfe0f5ffdd86479cc4f258568a14cfefed2ee8f3f2be07
SimHash a752dc4433b4

Groups

*

Rule Path
Disallow /files/ajax/ajax_loader.js
Disallow /?geo=
Disallow /*?language=
Disallow /plugin/Szukaj/
Disallow /plugin/_async_Szukaj/
Disallow /plugin/_async_Rezerwacja/
Disallow /plugin/WspolnyRequest/
Disallow /plugin/tracking/
Disallow /plugin/_obiekty_Datepicker/
Disallow /plugin/_obiekty_Trendy/
Disallow /plugin/_obiekty_NajnowszeOferty/
Disallow /plugin/SocialMedia/

*

Rule Path
Disallow /photo.php

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

twiceler

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

mj12bot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 120

gigabot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /