Log In Sign Up

parosnews.net
robots.txt

Robots Exclusion Standard data for parosnews.net

Resource Scan

Scan Details

Site Domain parosnews.net
Base Domain parosnews.net
Scan Status Ok
Last Scan2025-10-12T19:48:05+00:00
Next Scan 2025-11-11T19:48:05+00:00

Last Scan

Scanned2025-10-12T19:48:05+00:00
URL https://parosnews.net/robots.txt
Domain IPs 104.21.80.216, 172.67.187.69, 2606:4700:3034::6815:50d8, 2606:4700:3035::ac43:bb45
Response IP 104.21.80.216
Found Yes
Hash e8cf00d052d88e14f8e76ff09271e49599c2ac7e633b362d2175269ee4358b7f
SimHash 7705fbf0ce2f

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

smtbot

Rule Path
Disallow /

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ccbot

Rule Path
Disallow /

sitegurucrawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

pinterest

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

gptbot

Rule Path
Disallow /

petalbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

psbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

screaming

Rule Path
Disallow /

sitecheckerbotcrawler

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

shodan

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

netcraft

Rule Path
Disallow /

sucuri

Rule Path
Disallow /

acunetix

Rule Path
Disallow /

nessus

Rule Path
Disallow /

nikto

Rule Path
Disallow /

sqlmap

Rule Path
Disallow /

wpscan

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

buzzsumo

Rule Path
Disallow /

brandwatch

Rule Path
Disallow /

awariobot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

masscan

Rule Path
Disallow /

nmap

Rule Path
Disallow /

fimap

Rule Path
Disallow /

zmeu

Rule Path
Disallow /

morfeus

Rule Path
Disallow /

openvas

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

httrack

Rule Path
Disallow /

xenu

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webzip

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

image sucker

Rule Path
Disallow /

pixray

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

autowebbot

Rule Path
Disallow /

spambot

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

backdoorbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

datacha0s

Rule Path
Disallow /

dirbuster

Rule Path
Disallow /

getweb

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

sitesucker

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

backstreet

Rule Path
Disallow /

leechftp

Rule Path
Disallow /

foobot

Rule Path
Disallow /

grapefx

Rule Path
Disallow /

black hole

Rule Path
Disallow /

internetseer

Rule Path
Disallow /

jorgee

Rule Path
Disallow /

larbin

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

netspider

Rule Path
Disallow /

netzip

Rule Path
Disallow /

nutch

Rule Path
Disallow /

openfind

Rule Path
Disallow /

pavuk

Rule Path
Disallow /

peoplepal

Rule Path
Disallow /

reaper

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

scanbot

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seobilitybot

Rule Path
Disallow /

seoprofiler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sitebeam

Rule Path
Disallow /

sitevigil

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

snapbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

spider_bot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

stripper

Rule Path
Disallow /

sucker

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

suzuran

Rule Path
Disallow /

takeout

Rule Path
Disallow /

teleport

Rule Path
Disallow /

trendiction

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

voil

Rule Path
Disallow /

vagabondo

Rule Path
Disallow /

virusdie

Rule Path
Disallow /

wasalive-bot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webcollage

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webfuck

Rule Path
Disallow /

webimagecollector

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

websiteextractor

Rule Path
Disallow /

websitequester

Rule Path
Disallow /

webster

Rule Path
Disallow /

winhttrack

Rule Path
Disallow /

wprecon

Rule Path
Disallow /

xaldon webspider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

zade

Rule Path
Disallow /

zermelo

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

arquivo-web-crawler

Rule Path
Disallow /

autoemailspider

Rule Path
Disallow /

awario crawler

Rule Path
Disallow /

backlink-check

Rule Path
Disallow /

check1.exe

Rule Path
Disallow /

clark-crawler

Rule Path
Disallow /

cognitiveseo

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

crawler.feedback

Rule Path
Disallow /

dataforseo bot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

demandbase-bot

Rule Path
Disallow /

domainsprojectbot

Rule Path
Disallow /

evc-batch

Rule Path
Disallow /

facebookscraper

Rule Path
Disallow /

gopher

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

instabid

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

iubenda-radar

Rule Path
Disallow /

linkfluence

Rule Path
Disallow /

lwp-request

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

mediawords

Rule Path
Disallow /

muhstik-scan

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

obot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

openai

Rule Path
Disallow /

pcbrowser

Rule Path
Disallow /

plumanalytics

Rule Path
Disallow /

probe-image-size

Rule Path
Disallow /

ripz

Rule Path
Disallow /

scan.lol

Rule Path
Disallow /

seobility

Rule Path
Disallow /

seocompany.store

Rule Path
Disallow /

seoscanners

Rule Path
Disallow /

seostar

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

sexsearcher

Rule Path
Disallow /

sitecheckerbot

Rule Path
Disallow /

siteripz

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

sp_auditbot

Rule Path
Disallow /

spyfu

Rule Path
Disallow /

sysscan

Rule Path
Disallow /

webgains-bot

Rule Path
Disallow /

webmeup-crawler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

serendeputy

Rule Path
Disallow /

seopultcontentanalyzer

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /

weborama

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

keys-so-bot

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

builtwith

Rule Path
Disallow /

riddler

Rule Path
Disallow /

pr-cy.ru

Rule Path
Disallow /

linux mozilla

Rule Path
Disallow /

paloaltonetworks

Rule Path
Disallow /

backupland

Rule Path
Disallow /

wellknownbot

Rule Path
Disallow /

academicbotrtu

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /
Back to top

Warnings

  • 3 invalid lines.
Back to top