Log In Sign Up

cactus-mall.com
robots.txt

Robots Exclusion Standard data for cactus-mall.com

Resource Scan

Scan Details

Site Domain cactus-mall.com
Base Domain cactus-mall.com
Scan Status Ok
Last Scan2026-02-05T21:56:43+00:00
Next Scan 2026-02-12T21:56:43+00:00

Last Scan

Scanned2026-02-05T21:56:43+00:00
URL https://cactus-mall.com/robots.txt
Domain IPs 2a02:4780:a:1961:0:2a35:4403:10, 46.202.192.115
Response IP 46.202.192.115
Found Yes
Hash 3b80766b3ffeebe5069d9377655dc5079ef231a6f40b11637eb44ac732b10e17
SimHash 9a5a16a42e34

Groups

mediapartners-google

Rule Path
Disallow

aal-webcopy

Rule Path
Disallow /

aspiweb

Rule Path
Disallow /

backstreet

Rule Path
Disallow /

backstreetbrowser

Rule Path
Disallow /

httpweazel

Rule Path
Disallow /

httrack

Rule Path
Disallow /

navigatorcompanion

Rule Path
Disallow /

memowebwebloader

Rule Path
Disallow /

offlineexplorer

Rule Path
Disallow /

offlineexplorerpro

Rule Path
Disallow /

pagesucker

Rule Path
Disallow /

smartbud

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webcopy

Rule Path
Disallow /

webloader

Rule Path
Disallow /

webmirror

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webspider

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webcapture

Rule Path
Disallow /

wget

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /stats
Disallow /wholesale/
Disallow /statspub/
Disallow /apps
Disallow /ftp
Back to top

Comments

  • robots.txt for http://www.cactus-mall.com/ and http://www.columnar
  • and http://www.columnar-cacti.com
  • and http://www-rainbowgardens-bookshop.com
  • Yann Cochard, 21/02/2002
  • Tony Mace, 22/02/2002
  • For more information on this file, see :
  • http://www.robotstxt.org/wc/robots.html
Back to top