indowebsite.id
robots.txt
Robots Exclusion Standard data for indowebsite.id
Resource Scan
Scan Details
| Site Domain | indowebsite.id |
| Base Domain | indowebsite.id |
| Scan Status | Ok |
| Last Scan | 2025-10-31T18:33:30+00:00 |
| Next Scan | 2025-11-30T18:33:30+00:00 |
Last Scan
| Scanned | 2025-10-31T18:33:30+00:00 |
| URL | https://indowebsite.id/robots.txt |
| Redirect | https://www.indowebsite.co.id/robots.txt |
| Redirect Domain | www.indowebsite.co.id |
| Redirect Base | indowebsite.co.id |
| Domain IPs | 103.233.103.202 |
| Redirect IPs | 104.21.63.91, 172.67.145.22, 2606:4700:3031::ac43:9116, 2606:4700:3035::6815:3f5b |
| Response IP | 104.21.63.91 |
| Found | Yes |
| Hash | 3127d1a32095462749bb4d192892255cc4a7aaf6a60853e33f341439c6a2cfbc |
| SimHash | 6c04cc4a4bf2 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bbm1212/ |
| Disallow | /storage/ |
| Disallow | /banner/ |
| Disallow | 404.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.indowebsite.co.id/sitemap.xml |