audiotools.com
robots.txt

Robots Exclusion Standard data for audiotools.com

Resource Scan

Scan Details

Site Domain audiotools.com
Base Domain audiotools.com
Scan Status Ok
Last Scan2024-09-29T03:09:49+00:00
Next Scan 2024-10-29T03:09:49+00:00

Last Scan

Scanned2024-09-29T03:09:49+00:00
URL http://audiotools.com/robots.txt
Domain IPs 217.160.0.230
Response IP 217.160.0.230
Found Yes
Hash c953deaafdfa1daac7752548aa8b21d98de4fbb4018a9e3aee9a3877a97f3977
SimHash 81d8e3e2dfc7

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /r2r/
Disallow /amp/
Disallow /myndir/
Disallow /dat/
Disallow /cass/
Disallow /companies/
Disallow /ordabok/
Disallow /arm/
Disallow /cart/
Disallow /labels/
Disallow /car/
Disallow /adverts/
Disallow /radios/
Disallow /lp/
Disallow /pers/
Disallow /vamp/
Disallow /informatics/
Disallow /rec/
Disallow /cable/
Disallow /leit/
Disallow /spk/
Disallow /CD/
Disallow /midi/
Disallow /greinar/
Disallow /txt/
Disallow /husgogn/
Disallow /publ/
Disallow /msys/
Disallow /tonlist/
Disallow /old/
Disallow /gtr/
Disallow /leit/
Disallow /mp3/
Disallow /parts/
Disallow /soft/

Other Records

Field Value
crawl-delay 20

ia_archiver

Rule Path
Disallow /

psbot

Rule Path
Disallow /

webcapture

Rule Path
Disallow /

popdexter

Rule Path
Disallow /

bdfetch

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

npbot

Rule Path
Disallow /

lightningdownload

Rule Path
Disallow /

lightningdownload/1.0.1

Rule Path
Disallow /

net_vampire

Rule Path
Disallow /

offline explorer/1.3

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

mass downloader

Rule Path
Disallow /

anthill

Rule Path
Disallow /

inspectorwww

Rule Path
Disallow /

katipo

Rule Path
Disallow /

larbin

Rule Path
Disallow /

cjnetworkquality

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

ariadne

Rule Path
Disallow /

mattie

Rule Path
Disallow /

atlas

Rule Path
Disallow /

auresys

Rule Path
Disallow /

backrub

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

ukonline

Rule Path
Disallow /

borg-bot/0.9

Rule Path
Disallow /

borg-bot

Rule Path
Disallow /

mediafox

Rule Path
Disallow /

packrat

Rule Path
Disallow /

robofox

Rule Path
Disallow /

cmc/0.01

Rule Path
Disallow /

cmc

Rule Path
Disallow /

downloadexpress

Rule Path
Disallow /

webdownloader

Rule Path
Disallow /

download demon

Rule Path
Disallow /

download express

Rule Path
Disallow /

download wonder

Rule Path
Disallow /

webcopy

Rule Path
Disallow /

downloader

Rule Path
Disallow /

templeton

Rule Path
Disallow /

webmirror

Rule Path
Disallow /

wget

Rule Path
Disallow /

xget

Rule Path
Disallow /

diibot

Rule Path
Disallow /

deweb

Rule Path
Disallow /

ecollector

Rule Path
Disallow /

gammaspider

Rule Path
Disallow /

gerurl

Rule Path
Disallow /

javabee

Rule Path
Disallow /

jobo

Rule Path
Disallow /

joebot

Rule Path
Disallow /

spiderbot/1.0

Rule Path
Disallow /

tarspider

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

urlck

Rule Path
Disallow /

download accelerator (downloader)

Rule Path
Disallow /

download accelerator

Rule Path
Disallow /

httrack

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

linkwalker/2.0

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

qryos

Rule Path
Disallow /

nutch

Rule Path
Disallow /

mediapartners-google*

Rule Path
Disallow