boundanna.com
robots.txt

Robots Exclusion Standard data for boundanna.com

Resource Scan

Scan Details

Site Domain boundanna.com
Base Domain boundanna.com
Scan Status Ok
Last Scan2024-05-31T19:32:53+00:00
Next Scan 2024-06-30T19:32:53+00:00

Last Scan

Scanned2024-05-31T19:32:53+00:00
URL https://boundanna.com/robots.txt
Redirect http://www.boundanna.com/robots.txt
Redirect Domain www.boundanna.com
Redirect Base boundanna.com
Domain IPs 109.235.174.4, 2a00:1968:0:1::18
Redirect IPs 109.235.174.4, 2a00:1968:0:1::17
Response IP 109.235.174.4
Found Yes
Hash 4f320cbf10682223ba47cd668d22debb1d30c557d6c86e96755546ea905cc5f5
SimHash 0548b30c8e32

Groups

boardreader

Rule Path
Disallow /

fast-webcrawler

Rule Path
Disallow /

httrack

Rule Path
Disallow /

httrack 3

Rule Path
Disallow /

naverbot-1.0 (nhn corp. / +82-2-3011-1954 / nhnbot@naver.com)

Rule Path
Disallow /

npbot

Rule Path
Disallow /

plucker

Rule Path
Disallow /

slurp

Rule Path
Disallow /

webcapture 2

Rule Path
Disallow /

webcapture 3

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webcopier v3.6

Rule Path
Disallow /

webinator-indexer

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webreaper [webreaper@webreaper.net]

Rule Path
Disallow /

webreaper [info@webreaper.net]

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

wget

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider/2.0

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /