lajumate.ro
robots.txt

Robots Exclusion Standard data for lajumate.ro

Resource Scan

Scan Details

Site Domain lajumate.ro
Base Domain lajumate.ro
Scan Status Ok
Last Scan2024-07-01T12:12:23+00:00
Next Scan 2024-07-08T12:12:23+00:00

Last Scan

Scanned2024-07-01T12:12:23+00:00
URL https://lajumate.ro/robots.txt
Domain IPs 104.21.87.101, 172.67.169.53, 2606:4700:3036::ac43:a935, 2606:4700:3037::6815:5765
Response IP 172.67.169.53
Found Yes
Hash 2ef3e71d0817eb833f2c1b926c9bd1b70783bf5ce3e8037d020540bcf3ec33ff
SimHash e09b790e8e75

Groups

trovitbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow

jooblebot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

gwpimages

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

netseer crawler/2.0

Rule Path
Disallow /

genieo

Rule Path
Disallow /

qwantify/2.4w

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

psbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bloglines/3.1

Rule Path
Disallow /

jyxobot/1

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

proximic

Rule Path
Disallow /

queryseekerspider

Rule Path
Disallow /

bubing

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

wesee

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

paperlibot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://lajumate.ro/sitemap.xml

Warnings

  • 4 invalid lines.