internetcwd.pro
robots.txt
Robots Exclusion Standard data for internetcwd.pro
Resource Scan
Scan Details
Site Domain | internetcwd.pro |
Base Domain | internetcwd.pro |
Scan Status | Ok |
Last Scan | 2025-04-09T01:09:29+00:00 |
Next Scan | 2025-04-10T01:09:29+00:00 |
Last Scan
Scanned | 2025-04-09T01:09:29+00:00 |
URL | https://internetcwd.pro/robots.txt |
Domain IPs | 104.21.71.38, 172.67.143.20, 2606:4700:3030::6815:4726, 2606:4700:3030::ac43:8f14 |
Response IP | 104.21.71.38 |
Found | Yes |
Hash | 5861bb211ba3534135e6a0519946162a922b4cd9cb7aa595adb1a078a8135697 |
SimHash | c81586c0c701 |
Groups
*
Rule | Path |
---|---|
Allow | /$ |
Allow | /promotion |
Allow | /referrals |
Allow | /sportsbook |
Allow | /casino |
Allow | /idnpoker |
Allow | /slots |
Allow | /idnlive |
Allow | /password/reset |
Allow | /contact-us |
Allow | /sitemap.xml |
Allow | /assets |
Disallow | /idnlive/lobby |
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://internetcwd.pro/sitemap.xml |