darkmodelmusic.com
robots.txt

Robots Exclusion Standard data for darkmodelmusic.com

Resource Scan

Scan Details

Site Domain darkmodelmusic.com
Base Domain darkmodelmusic.com
Scan Status Ok
Last Scan2024-10-04T22:08:26+00:00
Next Scan 2024-10-11T22:08:26+00:00

Last Scan

Scanned2024-10-04T22:08:26+00:00
URL https://darkmodelmusic.com/robots.txt
Domain IPs 162.43.117.86
Response IP 162.43.117.86
Found Yes
Hash 5e1f7e071c6738c3cb100d5b65f402ee0541a2d24eba8e9d9bb5864549d6e4c9
SimHash 12154eaad6b0

Groups

*

Rule Path
Disallow /*.swf
Disallow /*.flv$
Disallow /*.mp3$
Disallow /*.mp4$
Disallow /trackback/
Disallow /draft/
Disallow /wp-content/cache/*
Disallow /wp-content/plugins/*
Disallow /wp-content/plugins/contact-form-7/includes/css/*
Disallow /my-account/
Disallow /checkout/
Disallow /cart/
Disallow /shop/
Disallow /index_past.html
Disallow /google7e41101f1c2b01d5.html
Disallow /wp-content/cache/autoptimize/*
Allow /

pockey-gethtml

Rule Path
Disallow /

exabot

Rule Path
Disallow /

zangotoolbar

Rule Path
Disallow /

peoplepal

Rule Path
Disallow /

becomejpbot

Rule Path
Disallow /

getleft

Rule Path
Disallow /

ninja

Rule Path
Disallow /

indy

Rule Path
Disallow /

voilabot

Rule Path
Disallow /

morfeus

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

masagool

Rule Path
Disallow /

irvine

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

core-project

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

python-urllib/2.7

Rule Path
Disallow /

steeler

Rule Path
Disallow /

kyoto-tohoku-crawler

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

adsbot/3.1

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

gitcrawlerbot/0.0.1

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

infotigerbot

Rule Path
Disallow /

infotigerbot/1.9

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

ias-sg

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

proximic

Rule Path
Disallow /

guzzlehttp

Rule Path
Disallow /

aiohttp

Rule Path
Disallow /