geocaching.com.au robots.txt

*

Rule	Path
Disallow	/search
Disallow	/login
Disallow	/files
Disallow	/stats
Disallow	/zone
Disallow	/feeds
Disallow	/dashboard
Disallow	/my
Disallow	/admin
Disallow	/log
Disallow	/logs
Disallow	/swaggie
Disallow	/swaggies
Disallow	/gallery
Disallow	/adhoc
Disallow	/feeds
Disallow	/cacher
Disallow	/cachers
Disallow	/links
Disallow	/tags
Disallow	/xml
Disallow	/twinkle
Disallow	/*.gpx$
Disallow	/*.zip$
Disallow	/*.kml$
Disallow	/*.csv$
Disallow	/*.gmap$
Disallow	/*.gmapc$
Disallow	/*.gmapp$
Disallow	/*.json$
Disallow	/*.png$
Disallow	/*.jpg$
Disallow	/*.gif$

Rule

Path

Disallow

/search

Disallow

/login

Disallow

/files

Disallow

/stats

Disallow

/zone

Disallow

/feeds

Disallow

/dashboard

Disallow

/my

Disallow

/admin

Disallow

/log

Disallow

/logs

Disallow

/swaggie

Disallow

/swaggies

Disallow

/gallery

Disallow

/adhoc

Disallow

/feeds

Disallow

/cacher

Disallow

/cachers

Disallow

/links

Disallow

/tags

Disallow

/xml

Disallow

/twinkle

Disallow

/*.gpx$

Disallow

/*.zip$

Disallow

/*.kml$

Disallow

/*.csv$

Disallow

/*.gmap$

Disallow

/*.gmapc$

Disallow

/*.gmapp$

Disallow

/*.json$

Disallow

/*.png$

Disallow

/*.jpg$

Disallow

/*.gif$

Other Records

Field	Value
crawl-delay	15

Field

Value

crawl-delay

15

abcdatos botlink

Rule	Path
Disallow	/

Rule

Path

Disallow

/

acme.spider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

ahoy! the homepage finder

Rule	Path
Disallow	/

Rule

Path

Disallow

/

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

alkaline

Rule	Path
Disallow	/

Rule

Path

Disallow

/

anthill

Rule	Path
Disallow	/

Rule

Path

Disallow

/

walhello appie

Rule	Path
Disallow	/

Rule

Path

Disallow

/

arachnophilia

Rule	Path
Disallow	/

Rule

Path

Disallow

/

arale

Rule	Path
Disallow	/

Rule

Path

Disallow

/

araneo

Rule	Path
Disallow	/

Rule

Path

Disallow

/

araybot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

architextspider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

aretha

Rule	Path
Disallow	/

Rule

Path

Disallow

/

ariadne

Rule	Path
Disallow	/

Rule

Path

Disallow

/

arks

Rule	Path
Disallow	/

Rule

Path

Disallow

/

askjeeves

Rule	Path
Disallow	/

Rule

Path

Disallow

/

aspider (associative spider)

Rule	Path
Disallow	/

Rule

Path

Disallow

/

atn worldwide

Rule	Path
Disallow	/

Rule

Path

Disallow

/

atomz.com search robot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

auresys

Rule	Path
Disallow	/

Rule

Path

Disallow

/

awariobot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

backrub

Rule	Path
Disallow	/

Rule

Path

Disallow

/

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

baiduspider+

Rule	Path
Disallow	/

Rule

Path

Disallow

/

bay spider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

big brother

Rule	Path
Disallow	/

Rule

Path

Disallow

/

birubot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

bjaaland

Rule	Path
Disallow	/

Rule

Path

Disallow

/

blackwidow

Rule	Path
Disallow	/

Rule

Path

Disallow

/

die blinde kuh

Rule	Path
Disallow	/

Rule

Path

Disallow

/

bloodhound

Rule	Path
Disallow	/

Rule

Path

Disallow

/

borg-bot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

booglebot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

boxseabot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

bright.net caching robot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

bspider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

butterfly

Rule	Path
Disallow	/

Rule

Path

Disallow

/

bubing

Rule	Path
Disallow	/

Rule

Path

Disallow

/

buck

Rule	Path
Disallow	/

Rule

Path

Disallow

/

cactvs chemistry spider

Rule	Path
Disallow	/

Rule

Path

Disallow

/

calif

Rule	Path
Disallow	/

Rule

Path

Disallow

/

cassandra

Rule	Path
Disallow	/

Rule

Path

Disallow

/

cfnetwork

Rule	Path
Disallow	/

Rule

Path

Disallow

/

digimarc marcspider/cgi

Rule	Path
Disallow	/

Rule

Path

Disallow

/

checkbot

Rule	Path
Disallow	/

Rule

Path

Disallow

/

christcrawler.com

Rule

Path

Disallow

/

churl

Rule

Path

Disallow

/

cienciaficcion.net

Rule

Path

Disallow

/

cmc/0.01

Rule

Path

Disallow

/

collective

Rule

Path

Disallow

/

combine system

Rule

Path

Disallow

/

conceptbot

Rule

Path

Disallow

/

confuzzledbot

Rule

Path

Disallow

/

coolbot

Rule

Path

Disallow

/

web core / roots

Rule

Path

Disallow

/

xyleme robot

Rule

Path

Disallow

/

internet cruiser robot

Rule

Path

Disallow

/

cusco

Rule

Path

Disallow

/

cyberspyder link test

Rule

Path

Disallow

/

cydralspider

Rule

Path

Disallow

/

dataforseobot

Rule

Path

Disallow

/

desert realm spider

Rule

Path

Disallow

/

deweb(c) katalog/index

Rule

Path

Disallow

/

dienstspider

Rule

Path

Disallow

/

digger

Rule

Path

Disallow

/

digital integrity robot

Rule

Path

Disallow

/

direct hit grabber

Rule

Path

Disallow

/

discobot

Rule

Path

Disallow

/

dnabot

Rule

Path

Disallow

/

docomo

Rule

Path

Disallow

/

dotbot

Rule

Path

Disallow

/

download express

Rule

Path

Disallow

/

dragonbot

Rule

Path

Disallow

/

dwcp (dridus web cataloging project)

Rule

Path

Disallow

/

e-collector

Rule

Path

Disallow

/

ebiness

Rule

Path

Disallow

/

eit link verifier robot

Rule

Path

Disallow

/

elfinbot

Rule

Path

Disallow

/

emacs-w3 search engine

Rule

Path

Disallow

/

ananzi

Rule

Path

Disallow

/

esculapio

Rule

Path

Disallow

/

esther

Rule

Path

Disallow

/

evliya celebi

Rule

Path

Disallow

/

exabot

Rule

Path

Disallow

/

fastcrawler

Rule

Path

Disallow

/

femtosearchbot

Rule

Path

Disallow

*

findlinks

Rule

Path

Disallow

/

findlinks

Rule

Path

Disallow

/

fluid dynamics search engine robot

Rule

Path

Disallow

/

felix ide

Rule

Path

Disallow

/

wild ferret web hopper

Product

Comment

wild ferret web hopper

1, #2, #3

Rule

Path

Disallow

/

fetchrover

Rule

Path

Disallow

/

fido

Rule

Path

Disallow

/

hämähäkki

Rule

Path

Disallow

/

kit-fireball

Rule

Path

Disallow

/

fish search

Rule

Path

Disallow

/

fouineur

Rule

Path

Disallow

/

robot francoroute

Rule

Path

Disallow

/

freecrawl

Rule

Path

Disallow

/

funnelweb

Rule

Path

Disallow

/

funwebproducts

Rule

Path

Disallow

/

gammaspider, focusedcrawler

Rule

Path

Disallow

/

gazz

Rule

Path

Disallow

/

gcreep

Rule

Path

Disallow

/

getbot

Rule

Path

Disallow

/

geturl

Rule

Path

Disallow

/

gigabot

Rule

Path

Disallow

/

golem

Rule

Path

Disallow

/

gptbot

Rule

Path

Disallow

/

grapnel/0.01 experiment

Rule

Path

Disallow

/

griffon

Rule

Path

Disallow

/

gromit

Rule

Path

Disallow

/

northern light gulliver

Rule

Path

Disallow

/

gulper bot

Rule

Path

Disallow

/

hambot

Rule

Path

Disallow

/

harvest

Rule

Path

Disallow

/

havindex

Rule

Path

Disallow

/

hi (html index) search

Rule

Path

Disallow

/

hometown spider pro

Rule

Path

Disallow

/

ht://dig

Rule

Path

Disallow

/

htmlgobble

Rule

Path

Disallow

/

hyper-decontextualizer

Rule

Path

Disallow

/

iajabot

Rule

Path

Disallow

/

ia_archiver

Rule

Path

Disallow

/

ibm_planetwide

Rule

Path

Disallow

/

popular iconoclast

Rule

Path

Disallow

/

ingrid

Rule

Path

Disallow

/

imagelock

Rule

Path

Disallow

/

incywincy

Rule

Path

Disallow

/

informant

Rule

Path

Disallow

/

infoseek robot 1.0

Rule

Path

Disallow

/

infoseek sidewinder

Rule

Path

Disallow

/

infospiders

Rule

Path

Disallow

/

inspector web

Rule

Path

Disallow

/

intelliagent

Rule

Path

Disallow

/

i, robot

Rule

Path

Disallow

/

iron33

Rule

Path

Disallow

/

israeli-search

Rule

Path

Disallow

/

javabee

Rule

Path

Disallow

/

jbot java web robot

Rule

Path

Disallow

/

jcrawler

Rule

Path

Disallow

/

jeeves

Rule

Path

Disallow

/

jobo java web robot

Rule

Path

Disallow

/

jobot

Rule

Path

Disallow

/

joebot

Rule

Path

Disallow

/

the jubii indexing robot

Rule

Path

Disallow

/

jumpstation

Rule

Path

Disallow

/

image.kapsi.net

Rule

Path

Disallow

/

katipo

Rule

Path

Disallow

/

kavamringcrawler

Rule

Path

Disallow

/

kdd-explorer

Rule

Path

Disallow

/

kilroy

Rule

Path

Disallow

/

ko_yappo_robot

Rule

Path

Disallow

/

labelgrabber

Rule

Path

Disallow

/

larbin

Rule

Path

Disallow

/

legs

Rule

Path

Disallow

/

lijit crawler

Rule

Path

Disallow

/

link validator

Rule

Path

Disallow

/

linkscan

Rule

Path

Disallow

/

linkwalker

Rule

Path

Disallow

/

lockon

Rule

Path

Disallow

/

logo.gif crawler

Rule

Path

Disallow

/

lycos

Rule

Path

Disallow

/

mac wwwworm

Rule

Path

Disallow

/

magpie

Rule

Path

Disallow

/

marvin/infoseek

Rule

Path

Disallow

/

mattie

Rule

Path

Disallow

/

mediafox

Rule

Path

Disallow

/

merzscope

Rule

Path

Disallow

/

nec-meshexplorer

Rule

Path

Disallow

/

metauri

Rule

Path

Disallow

/

mindcrawler

Rule

Path

Disallow

/

mj12bot

Rule

Path

Disallow

/

mlbot

Rule

Path

Disallow

/

mnogosearch search engine software

Rule

Path

Disallow

/

moget

Rule

Path

Disallow

/

momspider

Rule

Path

Disallow

/

monster

Rule

Path

Disallow

/

motor

Rule

Path

Disallow

/

msnbot

Rule

Path

Disallow

/

msnbot

Rule

Path

Disallow

/

muncher

Rule

Path

Disallow

/

muninn

Rule

Path

Disallow

/

muscat ferret

Rule

Path

Disallow

/

mwd.search

Rule

Path

Disallow

/

internet shinchakubin

Rule

Path

Disallow

/

ndspider

Rule

Path

Disallow

/

nederland.zoek

Rule

Path

Disallow

/

netcarta webmap engine

Rule

Path

Disallow

/

netmechanic

Rule

Path

Disallow

/

netscoop

Rule

Path

Disallow

/

newscan-online

Rule

Path

Disallow

/

nextgensearchbot

Rule

Path

Disallow

/

nhse web forager

Rule

Path

Disallow

/

nomad

Rule

Path

Disallow

/

the northstar robot

Rule

Path

Disallow

/

nutch

Rule

Path

Disallow

/

nzexplorer

Rule

Path

Disallow

/

objectssearch

Rule

Path

Disallow

/

occam

Rule

Path

Disallow

/

hku www octopus

Rule

Path

Disallow

/

ontospider

Rule

Path

Disallow

/

openfind data gatherer

Rule

Path

Disallow

/

orb search

Rule

Path

Disallow

/

pack rat

Rule

Path

Disallow

/

pageboy

Rule

Path

Disallow

/

parasite

Rule

Path

Disallow

/

patric

Rule

Path

Disallow

/

pegasus

Rule

Path

Disallow

/

the peregrinator

Rule

Path

Disallow

/

petalbot

Rule

Path

Disallow

/

perlcrawler 1.0

Rule

Path

Disallow

/

phantom

Rule

Path

Disallow

/

phpdig

Rule

Path

Disallow

/

piltdownman

Rule

Path

Disallow

/

pimptrain.coms robot

Rule

Path

Disallow

/

pimonster

Rule

Path

Disallow

/

pimonster

Rule

Path

Disallow

/

pioneer

Rule

Path

Disallow

/

html_analyzer

Rule

Path

Disallow

/

portal juice spider

Rule

Path

Disallow

/

postpost

Rule

Path

Disallow

/

pgp key agent

Rule

Path

Disallow

/

plumtreewebaccessor

Rule

Path

Disallow

/

poppi

Rule

Path

Disallow

/

portalb spider

Rule

Path

Disallow

/

psbot

Rule

Path

Disallow

/

getterroboplus puu

Rule

Path

Disallow

/

the python robot

Rule

Path

Disallow

/

raven search

Rule

Path

Disallow

/

rbse spider

Rule

Path

Disallow

/

resume robot

Rule

Path

Disallow

/

roadhouse crawling system

Rule

Path

Disallow

/

riddler

Rule

Path

Disallow

/

rixbot

Rule

Path

Disallow

/

road runner: the imagescape robot

Rule

Path

Disallow

/

robbie the robot

Rule

Path

Disallow

/

computingsite robi/1.0

Rule

Path

Disallow

/

robocrawl spider

Rule

Path

Disallow

/

robofox

Rule

Path

Disallow

/

robozilla

Rule

Path

Disallow

/

roverbot

Rule

Path

Disallow

/

rules

Rule

Path

Disallow

/

safetynet robot

Rule

Path

Disallow

/

scooter

Rule

Path

Disallow

/

scoutjet

Rule

Path

Disallow

/

semrushbot

Rule

Path

Disallow

/

semrushbot-sa

Rule

Path

Disallow

/

seokicks

Rule

Path

Disallow

/

serpstatbot

Rule

Path

Disallow

/

sleek

Rule

Path

Disallow

/

search.aus-au.com

Rule

Path

Disallow

/

searchprocess

Rule

Path

Disallow

/

seekportbot

Rule

Path

Disallow

/

senrigan

Rule

Path

Disallow

/

sg-scout

Rule

Path

Disallow

/

shagseeker

Rule

Path

Disallow

/

shaihulud

Rule

Path

Disallow

/

sift

Rule

Path

Disallow

/

simmany robot ver1.0

Rule

Path

Disallow

/

sistrix

Rule

Path

Disallow

/

site valet

Rule

Path

Disallow

/

sitebot

Rule

Path

Disallow

/

open text index robot

Rule

Path

Disallow

/

sitetech-rover

Rule

Path

Disallow

/

skymob.com

Rule

Path

Disallow

/

slcrawler

Rule

Path

Disallow

/

inktomi slurp

Rule

Path

Disallow

/

slurp

Rule

Path

Disallow

/

slurp

Rule

Path

Disallow

/

smart spider

Rule

Path

Disallow

/

snooper

Rule

Path

Disallow

/

solbot

Rule

Path

Disallow

/

spanner

Rule

Path

Disallow

/

spbot

Rule

Path

Disallow

/

speedy

Rule

Path

Disallow

/

speedy spider

Rule

Path

Disallow

/

spider_monkey

Rule

Path

Disallow

/

spiderbot

Rule

Path

Disallow

/

spiderline crawler

Rule

Path

Disallow

/

spiderman

Rule

Path

Disallow

/

spiderview(tm)

Rule

Path

Disallow

/

spry wizard robot

Rule

Path

Disallow

/

site searcher

Rule

Path

Disallow

/

suggybot

Rule

Path

Disallow

/

suke

Rule

Path

Disallow

/

suntek search engine

Rule

Path

Disallow

/

sven

Rule

Path

Disallow

/

sygol

Rule

Path

Disallow

/

tach black widow

Rule

Path

Disallow

/

tarantula

Rule

Path

Disallow

/

tarspider

Rule

Path

Disallow

/

tcl w3 robot

Rule

Path

Disallow

/

techbot

Rule

Path

Disallow

/

templeton

Rule

Path

Disallow

/

teomatechnologies

Rule

Path

Disallow

/

titan

Rule

Path

Disallow

/

titin

Rule

Path

Disallow

/

timpibot

Rule

Path

Disallow

/

the tkwww robot

Rule

Path

Disallow

/

tlspider

Rule

Path

Disallow

/

turnitinbot

Rule

Path

Disallow

/

ucsd crawl

Rule

Path

Disallow

/

udmsearch

Rule

Path

Disallow

/

uptimebot

Rule

Path

Disallow

/

url check

Rule

Path

Disallow

/

url spider pro

Rule

Path

Disallow

/

valkyrie

Rule

Path

Disallow

/

vagabondo

Rule

Path

Disallow

/

verticrawl

Rule

Path

Disallow

/

victoria

Rule

Path

Disallow

/

vision-search

Rule

Path

Disallow

/

void-bot

Rule

Path

Disallow

/

voyager

Rule

Path

Disallow

/

vwbot

Rule

Path

Disallow

/

the nwi robot

Rule

Path

Disallow

/

w3m2

Rule

Path

Disallow

/

wallpaper (alias crawlpaper)

Rule

Path

Disallow

/

the world wide web wanderer

Rule

Path

Disallow

/

w@pspider by wap4.com

Rule

Path

Disallow

/

webbandit web spider

Rule

Path

Disallow

/

webcatcher

Rule

Path

Disallow

/

webcopy

Rule

Path

Disallow

/

webfetcher

Rule

Path

Disallow

/

the webfoot robot

Rule

Path

Disallow

/

webinator

Rule

Path

Disallow

/

weblayers

Rule

Path

Disallow

/

weblinker

Rule

Path

Disallow

/

webmirror

Rule

Path

Disallow

/

the web moose

Rule

Path

Disallow

/

webquest

Rule

Path

Disallow

/

digimarc marcspider

Rule

Path

Disallow

/

webreaper

Rule

Path

Disallow

/

webs

Rule

Path

Disallow

/

websnarf

Rule

Path

Disallow

/

webspider

Rule

Path

Disallow

/

webvac

Rule

Path

Disallow

/

webwalk

Rule

Path

Disallow

/

webwalker

Rule

Path

Disallow

/

webwatch

Rule

Path

Disallow

/

wget

Rule

Path

Disallow

/

whatuseek winona

Rule

Path

Disallow

/

whowhere robot

Rule

Path

Disallow

/

wired digital

Rule

Path

Disallow

/

weblog monitor

Rule

Path

Disallow

/

w3mir

Rule

Path

Disallow

/

webstolperer

Rule

Path

Disallow

/

the web wombat

Rule

Path

Disallow

/

the world wide web worm

Rule

Path

Disallow

/

wwwc ver 0.2.5

Rule

Path

Disallow

/

webzinger

Rule

Path

Disallow

/

xget

Rule

Path

Disallow

/

yahoo! slurp

Rule

Path

Disallow

/

yahoo-slurp

Rule

Path

Disallow

/

yandex

Rule

Path

Disallow

/

yeti

Rule

Path

Disallow

/

Site Domain	geocaching.com.au
Base Domain	geocaching.com.au
Scan Status	Ok
Last Scan	2024-11-05T04:09:18+00:00
Next Scan	2024-12-05T04:09:18+00:00

Scanned	2024-11-05T04:09:18+00:00
URL	https://geocaching.com.au/robots.txt
Domain IPs	27.121.112.196
Response IP	27.121.112.196
Found	Yes
Hash	ba8ecb6232a439de77827542efdde2a8e77bdbb80c07e1344a43f7d03c7051de
SimHash	f2968f122ecb

geocaching.com.aurobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

Other Records

abcdatos botlink

acme.spider

ahoy! the homepage finder

ahrefsbot

alkaline

anthill

walhello appie

arachnophilia

arale

araneo

araybot

architextspider

aretha

ariadne

arks

askjeeves

aspider (associative spider)

atn worldwide

atomz.com search robot

auresys

awariobot

backrub

baiduspider

baiduspider

baiduspider+

bay spider

big brother

birubot

bjaaland

blackwidow

die blinde kuh

bloodhound

borg-bot

booglebot

boxseabot

bright.net caching robot

bspider

butterfly

bubing

buck

cactvs chemistry spider

calif

cassandra

cfnetwork

digimarc marcspider/cgi

checkbot

christcrawler.com

churl

cienciaficcion.net

cmc/0.01

collective

combine system

conceptbot

confuzzledbot

coolbot

web core / roots

xyleme robot

internet cruiser robot

cusco

cyberspyder link test

cydralspider

dataforseobot

desert realm spider

deweb(c) katalog/index

dienstspider

digger

digital integrity robot

direct hit grabber

discobot

dnabot

docomo

dotbot

download express

geocaching.com.au
robots.txt

dwcp (dridus web cataloging project)