astrodex.ro
robots.txt

Robots Exclusion Standard data for astrodex.ro

Resource Scan

Scan Details

Site Domain astrodex.ro
Base Domain astrodex.ro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-09-27T13:30:34+00:00
Next Scan 2025-11-26T13:30:34+00:00

Last Successful Scan

Scanned2025-07-30T12:21:52+00:00
URL https://astrodex.ro/robots.txt
Domain IPs 89.42.218.81
Response IP 89.42.218.81
Found Yes
Hash fb45e1b5a12a9d3d378cf14937d722cc3412f7eb284a3c2df5352466429f5cc7
SimHash 10558872cb5b

Groups

ahrefsbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmobilebot

Rule Path
Disallow /

*

Rule Path
Disallow /_inc/
Disallow /_resurse/include/
Disallow /continut/
Disallow /lucru/