apartamentturnia.pl
robots.txt

Robots Exclusion Standard data for apartamentturnia.pl

Resource Scan

Scan Details

Site Domain apartamentturnia.pl
Base Domain apartamentturnia.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-10-05T19:42:30+00:00
Next Scan 2025-01-03T19:42:30+00:00

Last Successful Scan

Scanned2021-12-15T06:14:17+00:00
URL https://apartamentturnia.pl/robots.txt
Response IP 37.28.158.228
Found Yes
Hash f543db46b39a522bcbbb2ebf299964246d9566481a6e613a4a566bff43d8d45b
SimHash 1818de12e44b

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

twengabot-discover

Rule Path
Disallow /

twengabot/2.0

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

twengabot-2.0

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

yandex

Rule Path
Disallow /
Disallow /_cfg/
Disallow /_framework/
Disallow /_views/

Comments

  • Blokada niechcianych agentów index
  • END Blokada niechcianych agentów index
  • Blokada index
  • END Blokada index

Warnings

  • 2 invalid lines.