dwlmain.org
robots.txt

Robots Exclusion Standard data for dwlmain.org

Resource Scan

Scan Details

Site Domain dwlmain.org
Base Domain dwlmain.org
Scan Status Ok
Last Scan2025-10-13T04:10:16+00:00
Next Scan 2025-11-12T04:10:16+00:00

Last Scan

Scanned2025-10-13T04:10:16+00:00
URL https://dwlmain.org/robots.txt
Domain IPs 104.21.45.237, 172.67.220.186, 2606:4700:3033::ac43:dcba, 2606:4700:3035::6815:2ded
Response IP 104.21.45.237
Found Yes
Hash 0891f4f852f59ae72ad6c398fa60bc01edd45aa96d6335aa65aba3de0af5ec13
SimHash 4a080c050c11

Groups

*

Rule Path
Allow /
Allow /rules-game
Allow /history/number
Allow /dream-book
Allow /referral
Allow /support
Allow /forgot/password
Allow /vip
Allow /promotion
Allow /register
Allow /sitemap.xml

spambot

Rule Path
Disallow /

lumen

Rule Path
Disallow /

lumendatabase

Rule Path
Disallow /

chillingeffects

Rule Path
Disallow /

lumenbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://dwlmain.org/sitemap.xml