Log In Sign Up

nowemiasto.com.pl
robots.txt

Robots Exclusion Standard data for nowemiasto.com.pl

Resource Scan

Scan Details

Site Domain nowemiasto.com.pl
Base Domain nowemiasto.com.pl
Scan Status Ok
Last Scan2024-06-26T06:10:54+00:00
Next Scan 2024-07-03T06:10:54+00:00

Last Scan

Scanned2024-06-26T06:10:54+00:00
URL https://nowemiasto.com.pl/robots.txt
Redirect https://www.nowemiasto.com.pl/robots.txt
Redirect Domain www.nowemiasto.com.pl
Redirect Base nowemiasto.com.pl
Domain IPs 194.169.227.152
Redirect IPs 194.169.227.152
Response IP 194.169.227.152
Found Yes
Hash 03129715d1b64370c3478536ca3b74b04a8a0a333efdf1a05520a4fa1511cda5
SimHash 309445d2b5d3

Groups

*

Rule Path
Allow /
Disallow /grafika/
Disallow /pictures/
Disallow /baner/
Disallow /uzytki/
Disallow /player/
Disallow /gallery/
Disallow /scroll/
Disallow /files/
Disallow /admin/
Disallow /includes/
Disallow /license/
Disallow /baner/ti

googlebot-news

Rule Path
Allow /

petalbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

tmmbot

Rule Path
Disallow /

tenderbot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

buck

Rule Path
Disallow /

aspiegel bot

Rule Path
Disallow /

zoominfo bot

Rule Path
Disallow /

searchatlas

Rule Path
Disallow /

php-requests

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

woobot

Rule Path
Disallow /

neticle crawler

Rule Path
Disallow /

ucrawler

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

barkrowle

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

kraken

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

domaincrawler/3.0

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

cms crawler

Rule Path
Disallow /

duckduckgo

Rule Path
Disallow /

nekstbot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

addthis

Rule Path
Disallow /

proximic

Rule Path
Disallow /

pmoz

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

rssingbot

Rule Path
Disallow /

contextad

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

wesee:search

Rule Path
Disallow /

wesee:ads

Rule Path
Disallow /

gg

Rule Path
Disallow /

wesee

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

contextad

Rule Path
Disallow /

oer

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

bot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sleuth

Rule Path
Disallow /

komodiabot

Rule Path
Disallow /

obot

Rule Path
Disallow /

urlappendbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

screenerbot
semrushbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

browserng

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

xenu link sleuth

Rule Path
Disallow /

lssrocketcrawler

Rule Path
Disallow /

ssearch_bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

admedia

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

lssrocketcrawler

Rule Path
Disallow /

uipbot

Rule Path
Disallow /

netestate

Rule Path
Disallow /

bixocrawler

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

wegtam

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

raven

Rule Path
Disallow /

crazywebcrawler

Rule Path
Disallow /

nutchcrawler

Rule Path
Disallow /

fr-crawler

Rule Path
Disallow /

yahoo

Rule Path
Disallow /

contextad

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

tweetmemebot

Rule Path
Disallow /

linguee

Rule Path
Disallow /

toweya

Rule Path
Disallow /

phantom

Rule Path
Disallow /

faviconizer

Rule Path
Disallow /

crawl

Rule Path
Disallow /

java

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

spider

Rule Path
Disallow /

plukkie/1.6

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

linqiametadatadownloaderbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

datagnionbot

Rule Path
Disallow /

alphabot

Rule Path
Disallow /

dnyzbot

Rule Path
Disallow /

livelapbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

laserlikebot

Rule Path
Disallow /

seranking_audit_bot

Rule Path
Disallow /

brandonbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

pywikibot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

checkmarknetwork/1.0 (+http://www.checkmarknetwork.com/spider.html)

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.nowemiasto.com.pl/news-sitemap.xml
sitemap https://www.nowemiasto.com.pl/sitemap.xml
Back to top

Warnings

  • 4 invalid lines.
Back to top