targdevinuri.ro
robots.txt

Robots Exclusion Standard data for targdevinuri.ro

Resource Scan

Scan Details

Site Domain targdevinuri.ro
Base Domain targdevinuri.ro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-28T21:45:48+00:00
Next Scan 2025-11-27T21:45:48+00:00

Last Successful Scan

Scanned2025-09-05T23:48:10+00:00
URL https://targdevinuri.ro/robots.txt
Domain IPs 104.21.0.187, 172.67.128.51, 2606:4700:3032::ac43:8033, 2606:4700:3036::6815:bb
Response IP 172.67.128.51
Found Yes
Hash f3435a052676eaa84467fc147f0961f128348616102891e34cf1a17897c57da5
SimHash d06cc380a8a3

Groups

*

Rule Path
Disallow /cumparare/

dotbot

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.