bt.com
robots.txt
Robots Exclusion Standard data for bt.com
Resource Scan
Scan Details
| Site Domain | bt.com |
| Base Domain | bt.com |
| Scan Status | Ok |
| Last Scan | 2024-11-15T22:09:28+00:00 |
| Next Scan | 2024-11-22T22:09:28+00:00 |
Last Scan
| Scanned | 2024-11-15T22:09:28+00:00 |
| URL | https://bt.com/robots.txt |
| Redirect | https://www.bt.com/robots.txt |
| Redirect Domain | www.bt.com |
| Redirect Base | bt.com |
| Domain IPs | 45.60.65.23, 45.60.72.23 |
| Redirect IPs | 45.60.67.23 |
| Response IP | 45.60.67.23 |
| Found | Yes |
| Hash | 0b46196c787538f88157f0574946e428ec6fb2ea2c59f8719307432f36682196 |
| SimHash | 6914d7c0d7d2 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /dev/ |
| Disallow | */order- |
| Disallow | */existing |
| Disallow | *affiliate |
| Disallow | */closed/ |
| Disallow | */sim-ordersummary/ |
| Disallow | *acq1 |
| Disallow | *uinf1 |
| Disallow | *uinf2 |
| Disallow | *acq1 |
| Disallow | *acq2 |
| Disallow | *ec1 |
| Disallow | *ec2 |
| Disallow | */retention |
| Disallow | /lookup-pages |
| Disallow | /modals/ |
| Disallow | /local-navigation/ |
| Disallow | /campaign/ |
| Disallow | /pricing/ |
| Disallow | /help/tv/now-tv-on-bt-tv |
| Disallow | /help/tv/ocean/* |
| Disallow | /newjoiners |
| Disallow | /mydonate |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.bt.com/sitemap.xml |
Comments