mobila-de-dormitor.ro
robots.txt

Robots Exclusion Standard data for mobila-de-dormitor.ro

Resource Scan

Scan Details

Site Domain mobila-de-dormitor.ro
Base Domain mobila-de-dormitor.ro
Scan Status Ok
Last Scan2024-10-25T16:28:29+00:00
Next Scan 2024-11-01T16:28:29+00:00

Last Scan

Scanned2024-10-25T16:28:29+00:00
URL https://mobila-de-dormitor.ro/robots.txt
Domain IPs 104.21.80.141, 172.67.185.14, 2606:4700:3032::6815:508d, 2606:4700:3033::ac43:b90e
Response IP 172.67.185.14
Found Yes
Hash 502f6f00881a65f4ecfcdee7552c78d8e7a23b3ec15fd604da9c4e838981b672
SimHash d04e4380e8a3

Groups

*

Rule Path
Disallow /cumpara/

dotbot

Rule Path
Disallow /

synthesio

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

Warnings

  • 2 invalid lines.