kallanish.com
robots.txt

Robots Exclusion Standard data for kallanish.com

Resource Scan

Scan Details

Site Domain kallanish.com
Base Domain kallanish.com
Scan Status Ok
Last Scan2024-09-06T07:31:30+00:00
Next Scan 2024-10-06T07:31:30+00:00

Last Scan

Scanned2024-09-06T07:31:30+00:00
URL https://kallanish.com/robots.txt
Redirect https://www.kallanish.com/robots.txt
Redirect Domain www.kallanish.com
Redirect Base kallanish.com
Domain IPs 3.165.102.12, 3.165.102.24, 3.165.102.36, 3.165.102.58
Redirect IPs 52.212.52.84, 54.247.69.169, 63.32.161.232
Response IP 63.32.161.232
Found Yes
Hash 9e11f7c94fc46f5b40d37a8bdc26c03f54356a5926f8ecdbe1759d536df6ef81
SimHash 4e565400d610

Groups

semrushbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

blexbot

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

petal

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

*

Rule Path
Disallow /en/search

Comments

  • http://webmeup-crawler.com
  • https://megaindex.com/crawler