bi.com
robots.txt
Robots Exclusion Standard data for bi.com
Resource Scan
Scan Details
| Site Domain | bi.com |
| Base Domain | bi.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T05:33:25+00:00 |
| Next Scan | 2024-11-17T05:33:25+00:00 |
Last Scan
| Scanned | 2024-11-03T05:33:25+00:00 |
| URL | https://bi.com/robots.txt |
| Domain IPs | 104.18.24.190, 104.18.25.190, 2606:4700::6812:18be, 2606:4700::6812:19be |
| Response IP | 104.18.25.190 |
| Found | Yes |
| Hash | fe15f8e9c5a91ce4069a461bc13c3d4b8622701ab3e1e8202c8040064b3f54eb |
| SimHash | 6d65684eed13 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */amp/ |
| Disallow | */?amp |
gptbot
| Rule | Path |
|---|---|
| Disallow | /kyr |
| Disallow | /abr |
| Disallow | /fedtaminfo |
| Disallow | /minnesotaform |
| Disallow | /minnesotaformlandline |
| Disallow | /minnesotaformlandline-old |
| Disallow | /tech-forum-2021 |
| Disallow | /tech-forum-2022 |
| Disallow | /tech-forum-2023 |
| Disallow | /techforum_ly |
| Disallow | /temp |
| Disallow | /trainingregistration |
| Disallow | /rpt |
| Disallow | /rpt-confirmation |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bi.com/sitemap_index.xml |