archidust.com
robots.txt

Robots Exclusion Standard data for archidust.com

Resource Scan

Scan Details

Site Domain archidust.com
Base Domain archidust.com
Scan Status Ok
Last Scan2024-06-22T01:02:05+00:00
Next Scan 2024-06-29T01:02:05+00:00

Last Scan

Scanned2024-06-22T01:02:05+00:00
URL https://archidust.com/robots.txt
Redirect https://www.archidust.com/robots.txt
Redirect Domain www.archidust.com
Redirect Base archidust.com
Domain IPs 162.241.121.112
Response IP 162.241.121.112
Found Yes
Hash 2cab3f4f27392bd67b0385bb3ac7f5822c966f43dbc71cd9c8c8dcb7e774e37f
SimHash 392c8f707eb8

Groups

*

Rule Path
Allow /
Allow /sitemap.htm

adcore

Rule Path
Disallow /

ipvanish

Rule Path
Disallow /

requestedoffers.clu

Rule Path
Disallow /

notarius-russia.ru

Rule Path
Disallow /

bitminer.it

Rule Path
Disallow /

secretsharinghub.com

Rule Path
Disallow /

ibsconsultant.com

Rule Path
Disallow /

generositycool.com

Rule Path
Disallow /

ioflood.com

Rule Path
Disallow /

shootorder.com

Rule Path
Disallow /

visualpleasures.net

Rule Path
Disallow /

ninja-crawler

Rule Path
Disallow /

audit

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

opensiteexplorer.org

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

go-resty

Rule Path
Disallow /

crownpeak

Rule Path
Disallow /

clearscope.io

Rule Path
Disallow /

seopowersuite

Rule Path
Disallow /

webceo

Rule Path
Disallow /

cognitiveseo

Rule Path
Disallow /

netpeaksoftware

Rule Path
Disallow /

majestic.com

Rule Path
Disallow /

agencyanalytics

Rule Path
Disallow /

netpeaksoftware

Rule Path
Disallow /

brightedge

Rule Path
Disallow /

raventools

Rule Path
Disallow /

conductor.com

Rule Path
Disallow /

seranking

Rule Path
Disallow /

ispionage

Rule Path
Disallow /

similarweb

Rule Path
Disallow /

buzzsumo

Rule Path
Disallow /

sproutsocial

Rule Path
Disallow /

siteimprove.com

Rule Path
Disallow /

ahrefs.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

webmeup.com

Rule Path
Disallow /

webmeup-crawler.com

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bot\*

Rule Path
Disallow /

ahrefsbot/7.0

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

bingbot/2.0

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

Other Records

Field Value
sitemap https://archidust.com/sitemap.xml

Warnings

  • 2 invalid lines.