bengawan.org
robots.txt

Robots Exclusion Standard data for bengawan.org

Resource Scan

Scan Details

Site Domain bengawan.org
Base Domain bengawan.org
Scan Status Ok
Last Scan2025-10-10T02:04:16+00:00
Next Scan 2025-11-09T02:04:16+00:00

Last Scan

Scanned2025-10-10T02:04:16+00:00
URL https://bengawan.org/robots.txt
Domain IPs 104.21.72.131, 172.67.185.31, 2606:4700:3031::6815:4883, 2606:4700:3035::ac43:b91f
Response IP 172.67.185.31
Found Yes
Hash 6cd735e103ac31df90ace5c33491b71053ec22ac71c3896d6844f46d9f5662cb
SimHash 4914d4508313

Groups

*

Rule Path
Allow /$

*

Rule Path
Allow /
Disallow /idnlive/lobby

spambot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bengawan.org/sitemap.xml