rigvedawiki.net
robots.txt

Robots Exclusion Standard data for rigvedawiki.net

Resource Scan

Scan Details

Site Domain rigvedawiki.net
Base Domain rigvedawiki.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-04-20T13:39:04+00:00
Next Scan 2025-07-19T13:39:04+00:00

Last Successful Scan

Scanned2022-12-07T23:27:54+00:00
URL https://rigvedawiki.net/robots.txt
Domain IPs 104.26.14.205, 104.26.15.205, 172.67.70.138, 2606:4700:20::681a:ecd, 2606:4700:20::681a:fcd, 2606:4700:20::ac43:468a
Response IP 172.67.70.138
Found Yes
Hash 9f51aa309143f7636ce7c8ae2c6c81be0bec4fd28de7c131db7c38dd53288137
SimHash 4c70f2b01154

Groups

baiduspider
psbot
infopath.1
infopath.2
bingpreview

Rule Path
Disallow /

naverbot
googlebot

Rule Path
Disallow /*?action=*
Allow /*?action=fullsearch&backlinks=*
Allow /*?action=download&*
Allow /*?action=atom&*
Allow /*?action=atom*