kingsmusic.ca
robots.txt

Robots Exclusion Standard data for kingsmusic.ca

Resource Scan

Scan Details

Site Domain kingsmusic.ca
Base Domain kingsmusic.ca
Scan Status Ok
Last Scan2024-10-27T13:52:30+00:00
Next Scan 2024-11-26T13:52:30+00:00

Last Scan

Scanned2024-10-27T13:52:30+00:00
URL http://kingsmusic.ca/robots.txt
Domain IPs 18.214.235.150, 2600:1f18:2302:f01:7fd:3048:8667:f6f5, 2600:1f18:2302:f02:a52a:8340:86a2:9823, 54.82.139.218
Response IP 54.82.139.218
Found Yes
Hash 642b7e7974b26ec2bd3a0ffb218b2c859939360ca2013d6abe7b84007cc271ff
SimHash d31455d23f09

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

blexbot
mj12bot
goodzer
ahrefsbot
spbot
dotbot
dotbot
turnitinbot
seznambot
the knowledge ai
checkmarknetwork
ever accountable
seekportbot
claudebot
mauibot
houzzbot
baiduspider
baiduspider-image
serpstatbot
sogou blog
sogou inst spider
sogou news spider
sogou orion spider
sogou spider2
sogou web spider
uptimebot
yandex
yandexmobilebot
zoominfobot
megaindex.ru
alphaseobot-sa
proximic
amazonbot
petalbot
re-re studio
barkrowler
siteauditbot
awariorssbot
awariosmartbot
bytespider
dataforseobot
ioncrawl
nutch
oai-searchbot
gptbot
chatgpt-user

Rule Path
Disallow /

semrushbot-ba
semrushbot

Rule Path
Disallow /

Comments

  • See if Semrush can behave - March 2023.
  • Update Nov 2023, no, they can't behave.

Warnings

  • 1 invalid line.