arnetminer.org
robots.txt

Robots Exclusion Standard data for arnetminer.org

Resource Scan

Scan Details

Site Domain arnetminer.org
Base Domain arnetminer.org
Scan Status Ok
Last Scan2025-11-07T02:17:02+00:00
Next Scan 2025-12-07T02:17:02+00:00

Last Scan

Scanned2025-11-07T02:17:02+00:00
URL https://arnetminer.org/robots.txt
Domain IPs 92.243.74.2, 92.243.74.3
Response IP 92.243.74.3
Found Yes
Hash c8425b8bc7abb93fb443c5ad3767b67a8891792c3c1a2e419a701cc5d344d89e
SimHash 4a094c040413

Groups

*

Rule Path
Allow /
Allow /rules-game
Allow /history/number
Allow /dream-book
Allow /referral
Allow /support
Allow /forgot/password
Allow /vip
Allow /promotion
Allow /register
Allow /sitemap.xml

spambot

Rule Path
Disallow /

lumen

Rule Path
Disallow /

lumendatabase

Rule Path
Disallow /

chillingeffects

Rule Path
Disallow /

lumenbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://arnetminer.org/sitemap.xml