leika-ro.net
robots.txt

Robots Exclusion Standard data for leika-ro.net

Resource Scan

Scan Details

Site Domain leika-ro.net
Base Domain leika-ro.net
Scan Status Ok
Last Scan2024-10-27T22:34:32+00:00
Next Scan 2024-11-26T22:34:32+00:00

Last Scan

Scanned2024-10-27T22:34:32+00:00
URL https://leika-ro.net/robots.txt
Domain IPs 104.21.43.159, 172.67.181.47, 2606:4700:3037::6815:2b9f, 2606:4700:3037::ac43:b52f
Response IP 172.67.181.47
Found Yes
Hash 242fdd38dab82a3c0665c45a2b70a4570e3652ccc4f330757d016ba4ab271d5a
SimHash 6a777e00440b

Groups

*

Rule Path
Disallow /addons/
Disallow /cgi-bin/
Disallow /config/
Disallow /data/
Disallow /lang/
Disallow /lib/
Disallow /modules/
Disallow /patches/
Disallow /themes/
Disallow /misc/
Disallow /wiki/
Disallow /forum/

octoparse

Rule Path
Disallow /

import.io

Rule Path
Disallow /

webhose.io

Rule Path
Disallow /

dexi.io

Rule Path
Disallow /

zyte

Rule Path
Disallow /

outwit hub

Rule Path
Disallow /

getleft

Rule Path
Disallow /

httrack

Rule Path
Disallow /

cyotek webcopy

Rule Path
Disallow /

helium scraper

Rule Path
Disallow /

sequentum

Rule Path
Disallow /

webharvy

Rule Path
Disallow /

visual scraper

Rule Path
Disallow /

parsehub

Rule Path
Disallow /

exabot

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

swiftbot

Rule Path
Disallow /

contentking

Rule Path
Disallow /

netpeak spider

Rule Path
Disallow /

jetoctopus

Rule Path
Disallow /

botify

Rule Path
Disallow /

sitebulb crawler

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

oncrawl

Rule Path
Disallow /

cognitiveseo site explorer

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

lumar

Rule Path
Disallow /

deepcrawl

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

slurp

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow /

applebot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

crawl

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

nbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

facebookexternalhit/1.1

Rule Path
Disallow /

facebookcatalog

Rule Path
Disallow /

facebookcatalog/1.0

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://leika-ro.net/sitemap.xml

Warnings

  • 2 invalid lines.