abannew.ir
robots.txt

Robots Exclusion Standard data for abannew.ir

Resource Scan

Scan Details

Site Domain abannew.ir
Base Domain abannew.ir
Scan Status Ok
Last Scan2024-09-20T09:33:29+00:00
Next Scan 2024-10-20T09:33:29+00:00

Last Scan

Scanned2024-09-20T09:33:29+00:00
URL https://abannew.ir/robots.txt
Domain IPs 104.21.89.156, 172.67.189.150, 2606:4700:3034::6815:599c, 2606:4700:3035::ac43:bd96
Response IP 172.67.189.150
Found Yes
Hash 04c3ab53e8393d73e4c908b17ea2e2af6646b89e921c4edeae29244e11d42467
SimHash 5a5c44e1e649

Groups

*

Rule Path
Disallow /r/

googlebot

Rule Path
Disallow /search/
Disallow /*/page/
Disallow /?s=
Disallow /*?replytocom=
Disallow /*?orderby=
Disallow /*?order=
Allow /r/

googlebot-image

Rule Path
Disallow /search/
Disallow /*/page/
Disallow /?s=
Disallow /*?replytocom=
Disallow /*?orderby=
Disallow /*?order=
Allow /r/

googlebot-news

Rule Path
Disallow /search/
Disallow /*/page/
Disallow /?s=
Disallow /*?replytocom=
Disallow /*?orderby=
Disallow /*?order=
Allow /r/

googlebot-video

Rule Path
Disallow /search/
Disallow /*/page/
Disallow /?s=
Disallow /*?replytocom=
Disallow /*?orderby=
Disallow /*?order=
Allow /r/

googlebot-mobile

Rule Path
Disallow /search/
Disallow /*/page/
Disallow /?s=
Disallow /*?replytocom=
Disallow /*?orderby=
Disallow /*?order=
Allow /r/

googlebot-ads

Rule Path
Disallow /search/
Disallow /*/page/
Disallow /?s=
Disallow /*?replytocom=
Disallow /*?orderby=
Disallow /*?order=
Allow /r/

googlebot-apps

Rule Path
Disallow /search/
Disallow /*/page/
Disallow /?s=
Disallow /*?replytocom=
Disallow /*?orderby=
Disallow /*?order=
Allow /r/

ahrefsbot

Rule Path
Disallow /r/
Allow /

semrushbot

Rule Path
Disallow /r/
Allow /

mj12bot

Rule Path
Disallow /r/
Allow /

dotbot

Rule Path
Disallow /r/
Allow /

blexbot

Rule Path
Disallow /r/
Allow /

seokicks-robot

Rule Path
Disallow /r/
Allow /

linkpadbot

Rule Path
Disallow /r/
Allow /

screaming frog seo spider

Rule Path
Disallow /r/
Allow /

onpagebot

Rule Path
Disallow /r/
Allow /

rankactivelinkbot

Rule Path
Disallow /r/
Allow /

spbot

Rule Path
Disallow /r/
Allow /

yandexbot

Rule Path
Disallow /r/
Allow /

petalbot

Rule Path
Disallow /r/
Allow /

twitterbot

Rule Path
Disallow /r/
Allow /

applebot

Rule Path
Disallow /r/
Allow /

baiduspider

Rule Path
Disallow /r/
Allow /

bingbot

Rule Path
Disallow /r/
Allow /

exabot

Rule Path
Disallow /r/
Allow /

facebookexternalhit

Rule Path
Disallow /r/
Allow /

sogou web spider

Rule Path
Disallow /r/
Allow /

slurp

Rule Path
Disallow /r/
Allow /

wotbox

Rule Path
Disallow /r/
Allow /

zoominfobot

Rule Path
Disallow /r/
Allow /

seomozbot

Rule Path
Disallow /r/
Allow /

mail.ru_bot

Rule Path
Disallow /r/
Allow /

a6-indexer

Rule Path
Disallow /r/
Allow /

ccbot

Rule Path
Disallow /r/
Allow /

archivebot

Rule Path
Disallow /r/
Allow /

sogou spider

Rule Path
Disallow /r/
Allow /

magpie-crawler

Rule Path
Disallow /r/
Allow /

mojeekbot

Rule Path
Disallow /r/
Allow /

megaindex.ru

Rule Path
Disallow /r/
Allow /

cliqzbot

Rule Path
Disallow /r/
Allow /

bubing

Rule Path
Disallow /r/
Allow /

trellianbot

Rule Path
Disallow /r/
Allow /

cocolyzebot

Rule Path
Disallow /r/
Allow /

commoncrawlbot

Rule Path
Disallow /r/
Allow /

seokicks

Rule Path
Disallow /r/
Allow /

webmeup

Rule Path
Disallow /r/
Allow /

seznambot

Rule Path
Disallow /r/
Allow /

siteanalyzerbot

Rule Path
Disallow /r/
Allow /

uptimerobot

Rule Path
Disallow /r/
Allow /

mbcrawler

Rule Path
Disallow /r/
Allow /

veoozbot

Rule Path
Disallow /r/
Allow /

seekport crawler

Rule Path
Disallow /r/
Allow /