odleglosci.pl
robots.txt

Robots Exclusion Standard data for odleglosci.pl

Resource Scan

Scan Details

Site Domain odleglosci.pl
Base Domain odleglosci.pl
Scan Status Ok
Last Scan2024-09-18T00:03:16+00:00
Next Scan 2024-09-25T00:03:16+00:00

Last Scan

Scanned2024-09-18T00:03:16+00:00
URL https://odleglosci.pl/robots.txt
Redirect https://www.odleglosci.pl/robots.txt
Redirect Domain www.odleglosci.pl
Redirect Base odleglosci.pl
Domain IPs 46.242.245.178
Redirect IPs 46.242.245.178
Response IP 46.242.245.178
Found Yes
Hash df8ce30310f110f809c2eda507a7a0ecf7feadad9945c51fe447bb50378b886e
SimHash 01557082cf39

Groups

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

httrack

Rule Path
Disallow /

wget

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

speedy

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

teoma

Rule Path
Disallow /

sapphirewebcrawler

Rule Path
Disallow /

nutch

Rule Path
Disallow /

oozbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

nekstbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

admantx

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

linguee bot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

*

Rule Path
Disallow /wyslij-formularz.php
Disallow /wyslij-formularz2.php
Disallow /kontakt-z-autorem-zdjecia.php
Disallow /tiles/

Comments

  • www.seoprofiler.com/bot , openlinkprofiler.org
  • zwiazane z admantx
  • https://megaindex.com/crawler
  • opensiteexplorer