veethi.com
robots.txt

Robots Exclusion Standard data for veethi.com

Resource Scan

Scan Details

Site Domain veethi.com
Base Domain veethi.com
Scan Status Ok
Last Scan2024-06-26T16:57:28+00:00
Next Scan 2024-07-03T16:57:28+00:00

Last Scan

Scanned2024-06-26T16:57:28+00:00
URL https://veethi.com/robots.txt
Redirect https://www.veethi.com/robots.txt
Redirect Domain www.veethi.com
Redirect Base veethi.com
Domain IPs 104.26.8.25, 104.26.9.25, 172.67.75.20, 2606:4700:20::681a:819, 2606:4700:20::681a:919, 2606:4700:20::ac43:4b14
Redirect IPs 104.26.8.25, 104.26.9.25, 172.67.75.20, 2606:4700:20::681a:819, 2606:4700:20::681a:919, 2606:4700:20::ac43:4b14
Response IP 172.67.75.20
Found Yes
Hash 45d164e7ef66b9c1f200000f68361cba1f3ef9df101a5755bc7f5b45fde53ab3
SimHash d26ee3024263

Groups

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

netseer

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

jikespider

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

maxpointcrawler/nutch-1.1

Rule Path
Disallow /

crystalsemanticsbot

Rule Path
Disallow /

nerdbynature

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

acoon

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

germcrawler

Rule Path
Disallow /

exabot

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yioopbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /