dev.lsn.com
robots.txt

Robots Exclusion Standard data for dev.lsn.com

Resource Scan

Scan Details

Site Domain dev.lsn.com
Base Domain lsn.com
Scan Status Ok
Last Scan2024-09-25T06:35:54+00:00
Next Scan 2024-10-09T06:35:54+00:00

Last Scan

Scanned2024-09-25T06:35:54+00:00
URL https://dev.lsn.com/robots.txt
Domain IPs 104.26.12.213, 104.26.13.213, 172.67.68.1, 2606:4700:20::681a:cd5, 2606:4700:20::681a:dd5, 2606:4700:20::ac43:4401
Response IP 104.26.12.213
Found Yes
Hash de716b04f1821b87f835955f1ca375e58b0af291df31e256d984a3a6f4ed8ffd
SimHash 006c5f484f30

Groups

*

Rule Path
Disallow /inc/
Disallow /media/
Disallow /accounts/
Disallow /settings/
Disallow /regions/
Disallow /register/
Disallow /help/
Disallow /trial/

nerdybot
websiteoutlook
crazywebcrawler-spider
yandex
baiduspider
baiduspider-video
baiduspider-image
blexbot
megaindex.ru/2.0
megaindex.ru
megaindex.ru

Rule Path
Disallow /