Log In Sign Up

petardos.org
robots.txt

Robots Exclusion Standard data for petardos.org

Resource Scan

Scan Details

Site Domain petardos.org
Base Domain petardos.org
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2025-10-05T18:17:52+00:00
Next Scan 2025-12-04T18:17:52+00:00

Last Successful Scan

Scanned2025-07-14T23:20:19+00:00
URL https://petardos.org/robots.txt
Domain IPs 217.76.132.214
Response IP 217.76.132.214
Found Yes
Hash ae2bbf14c8c9044127071d12d615883072a9f5310eb41af9d70dbcccdb228398
SimHash d3876490c0e0

Groups

*

Rule Path
Disallow /admin/
Disallow admin/

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

fyberspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

niki-bot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

surveybot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

spbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

backlinkcrawler

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

obot

Rule Path
Disallow /

fr-crawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

cloudservermarketspider

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

careerbot

Rule Path
Disallow /

lipperhey-kaus-australis

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

metajobbot

Rule Path
Disallow /

spiderbot

Rule Path
Disallow /

linkstats

Rule Path
Disallow /

jobboersebot

Rule Path
Disallow /

iccrawler

Rule Path
Disallow /

plista

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

coccoc

Rule Path
Disallow /

um-ic

Rule Path
Disallow /

mindupbot

Rule Path
Disallow /

sg-orbiter

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

qwantify

Rule Path
Disallow /

kraken

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

openhosebot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

thumbsniper

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

implisensebot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

aihitbot

Rule Path
Disallow /

trendictionbot

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

python/3.5 aiohttp

Rule Path
Disallow /

toweya.com

Rule Path
Disallow /

netestate

Rule Path
Disallow /

linguee

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

alphaseobot

Rule Path
Disallow /

alphaseobot-sa

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

domaincrawler

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

indeedbot

Rule Path
Disallow /

garlikcrawler

Rule Path
Disallow /

gosign-security-crawler

Rule Path
Disallow /

siteliner

Rule Path
Disallow /

sabsimbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

serendeputybot

Rule Path
Disallow /

serendeputybot/0.8.6

Rule Path
Disallow /

buck

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

coccocbot-web

Rule Path
Disallow /

coccocbot

Rule Path
Disallow /

anderspinkbot

Rule Path
Disallow /

trendsmapresolver

Rule Path
Disallow /

omgili

Rule Path
Disallow /

df bot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

netvibes

Rule Path
Disallow /

r6_commentreader

Rule Path
Disallow /

siteimprove.com

Rule Path
Disallow /

linkcheck

Rule Path
Disallow /

sitecheck-sitecrawl

Rule Path
Disallow /

prtg network monitor

Rule Path
Disallow /

paessler

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

gohttpclient

Rule Path
Disallow /

go http client

Rule Path
Disallow /

twingly recon

Rule Path
Disallow /

censysinspect

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

re-re

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

r6_feedfetcher

Rule Path
Disallow /

feedparser/6

Rule Path
Disallow /

linespider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

istellabot

Rule Path
Disallow /

buck/2.2; (+https://app.hypefactors.com/media-monitoring/about.html)

Rule Path
Disallow /

buck/2.2

Rule Path
Disallow /

onalyticabot

Rule Path
Disallow /

dataforseo-bot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

chrome privacy preserving prefetch proxy

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semanticbot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.petardos.org/sitemap.xml
Back to top

Warnings

  • 10 invalid lines.
Back to top