crystal933.mx
robots.txt

Robots Exclusion Standard data for crystal933.mx

Resource Scan

Scan Details

Site Domain crystal933.mx
Base Domain crystal933.mx
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2026-03-19T20:49:45+00:00
Next Scan 2026-04-02T20:49:45+00:00

Last Successful Scan

Scanned2026-03-04T19:59:22+00:00
URL https://crystal933.mx/robots.txt
Domain IPs 144.126.209.86, 2604:a880:4:1d0:0:1:3011:7000
Response IP 144.126.209.86
Found Yes
Hash a4cee640640e27e171d5e5768b0e50db5e473d803a32971cb25d8c1c6ffeb8c8
SimHash 1010ddc6fa18

Groups

*

Rule Path
Allow /

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

megaindexbot

Rule Path
Disallow /

seo-powersuite-bot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

zoombot

Rule Path
Disallow /

seplinkbot

Rule Path
Disallow /

linkpadbot

Rule Path
Disallow /

rankactivelinkbot

Rule Path
Disallow /

accuranker

Rule Path
Disallow /

siteanalyzerbot

Rule Path
Disallow /

similarweb

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

netcraftsurveyagent

Rule Path
Disallow /