Log In Sign Up

harkadir.am
robots.txt

Robots Exclusion Standard data for harkadir.am

Resource Scan

Scan Details

Site Domain harkadir.am
Base Domain harkadir.am
Scan Status Ok
Last Scan2026-02-17T09:14:57+00:00
Next Scan 2026-03-19T09:14:57+00:00

Last Scan

Scanned2026-02-17T09:14:57+00:00
URL http://harkadir.am/robots.txt
Redirect https://cesa.am/robots.txt
Redirect Domain cesa.am
Redirect Base cesa.am
Domain IPs 31.47.196.210, 31.47.196.211
Redirect IPs 104.21.83.227, 172.67.182.101, 2606:4700:3031::6815:53e3, 2606:4700:3036::ac43:b665
Response IP 172.67.182.101
Found Yes
Hash 62915e20160ad05d9d72059462bb712e4f1ea5945a738c068dea1608da213702
SimHash 3a3f48c1a0c3

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /wp-json/
Disallow /xmlrpc.php
Disallow /search
Disallow /?s=
Disallow /*.php$
Disallow /trackback/
Disallow /feed/
Disallow /comments/
Allow /

Other Records

Field Value
crawl-delay 86400

facebookexternalhit

Rule Path
Allow /

telegrambot

Rule Path
Allow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

python

Rule Path
Disallow /

curl

Rule Path
Disallow /

spider

Rule Path
Disallow /

testcrawler

Rule Path
Disallow /

dataprovider.com

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

nutch

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

optimizer

Rule Path
Disallow /

motor

Rule Path
Disallow /

msie 5

Rule Path
Disallow /

msie 6

Rule Path
Disallow /

empty

Rule Path
Disallow /

link

Rule Path
Disallow /

obot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /wp-json/
Allow /

Other Records

Field Value
crawl-delay 86400

googlebot

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /wp-json/
Allow /

Other Records

Field Value
crawl-delay 86400

yandexbot

Rule Path
Disallow /wp-admin/
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /wp-json/
Allow /

Other Records

Field Value
crawl-delay 86400

feed

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazon-kendra

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

iaskspider/2.0

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

linerbot

Rule Path
Disallow /

machinelearningforpeacebot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

nicecrawler

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

perplexity-user

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

qualifiedbot

Rule Path
Disallow /

scoop.it

Rule Path
Disallow /

seekr

Rule Path
Disallow /

semrushbot-ocob

Rule Path
Disallow /

sidetrade indexer bot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

youbot

Rule Path
Disallow /
Back to top

Comments

  • 🛑 Վերահսկողություն բոլոր բոտերի համար
  • âœ
  • âœ
  • 🛑 Ամբողջությամբ արգելում ենք չար, անպետք Õ¯Õ¡Õ´ չարաշահող բոտերին
  • 📛 Bingbot՝ թույլ Õ´Õ« հարցում Ö
  • 📛 Googlebot
  • 📛 YandexBot
  • 🛑 Feed բոտերը արգելված Õ¥Õ¶
  • Cloudflare Managed Robots.txt to block AI related bots.
Back to top

Warnings

  • 3 invalid lines.
Back to top