internetcwd.pro
robots.txt

Robots Exclusion Standard data for internetcwd.pro

Resource Scan

Scan Details

Site Domain internetcwd.pro
Base Domain internetcwd.pro
Scan Status Ok
Last Scan2025-04-09T01:09:29+00:00
Next Scan 2025-04-10T01:09:29+00:00

Last Scan

Scanned2025-04-09T01:09:29+00:00
URL https://internetcwd.pro/robots.txt
Domain IPs 104.21.71.38, 172.67.143.20, 2606:4700:3030::6815:4726, 2606:4700:3030::ac43:8f14
Response IP 104.21.71.38
Found Yes
Hash 5861bb211ba3534135e6a0519946162a922b4cd9cb7aa595adb1a078a8135697
SimHash c81586c0c701

Groups

*

Rule Path
Allow /$
Allow /promotion
Allow /referrals
Allow /sportsbook
Allow /casino
Allow /idnpoker
Allow /slots
Allow /idnlive
Allow /password/reset
Allow /contact-us
Allow /sitemap.xml
Allow /assets
Disallow /idnlive/lobby
Disallow /

spambot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://internetcwd.pro/sitemap.xml