livewalker.com
robots.txt

Robots Exclusion Standard data for livewalker.com

Resource Scan

Scan Details

Site Domain livewalker.com
Base Domain livewalker.com
Scan Status Ok
Last Scan2024-11-12T19:30:03+00:00
Next Scan 2024-11-19T19:30:03+00:00

Last Scan

Scanned2024-11-12T19:30:03+00:00
URL https://livewalker.com/robots.txt
Redirect https://www.livewalker.com/robots.txt
Redirect Domain www.livewalker.com
Redirect Base livewalker.com
Domain IPs 202.218.143.15
Redirect IPs 202.218.143.15
Response IP 202.218.143.15
Found Yes
Hash a2f4f81cf034f84a1f962b2c7c09a8f5520b71e2e414e6a2a3d8db9231c82999
SimHash 0817cb717e3b

Groups

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mappy

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

yandexantivirus

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

feedwordpress

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

*

Rule Path
Allow /