motominer.com
robots.txt

Robots Exclusion Standard data for motominer.com

Resource Scan

Scan Details

Site Domain motominer.com
Base Domain motominer.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-12T07:58:17+00:00
Next Scan 2024-11-26T07:58:17+00:00

Last Successful Scan

Scanned2024-10-27T20:44:09+00:00
URL https://motominer.com/robots.txt
Domain IPs 13.107.246.59
Response IP 13.107.246.59
Found Yes
Hash a3745a762719290d5d56f9ee3288c2b2e60b6a59a7aa2d1ebaee16d4396fbfc4
SimHash 491c7d12e811

Groups

*

Rule Path
Disallow /Activity/*
Disallow /Redirect?*

a6-indexer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

trovitbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

Other Records

Field Value
sitemap https://motominer.com/sitemap.xml