bor.com
robots.txt
Robots Exclusion Standard data for bor.com
Resource Scan
Scan Details
| Site Domain | bor.com |
| Base Domain | bor.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T15:39:23+00:00 |
| Next Scan | 2024-10-02T15:39:23+00:00 |
Last Scan
| Scanned | 2024-09-25T15:39:23+00:00 |
| URL | https://bor.com/robots.txt |
| Redirect | https://www.billoreilly.com/robots.txt |
| Redirect Domain | www.billoreilly.com |
| Redirect Base | billoreilly.com |
| Domain IPs | 13.33.30.117, 13.33.30.33, 13.33.30.43, 13.33.30.76, 2600:9000:229f:1600:6:95e3:db40:93a1, 2600:9000:229f:200:6:95e3:db40:93a1, 2600:9000:229f:3600:6:95e3:db40:93a1, 2600:9000:229f:5200:6:95e3:db40:93a1, 2600:9000:229f:7000:6:95e3:db40:93a1, 2600:9000:229f:800:6:95e3:db40:93a1, 2600:9000:229f:da00:6:95e3:db40:93a1, 2600:9000:229f:f600:6:95e3:db40:93a1 |
| Redirect IPs | 108.156.133.10, 108.156.133.103, 108.156.133.129, 108.156.133.88, 2600:9000:2755:1200:1:a1e6:4d80:93a1, 2600:9000:2755:4e00:1:a1e6:4d80:93a1, 2600:9000:2755:5200:1:a1e6:4d80:93a1, 2600:9000:2755:6200:1:a1e6:4d80:93a1, 2600:9000:2755:9800:1:a1e6:4d80:93a1, 2600:9000:2755:c200:1:a1e6:4d80:93a1, 2600:9000:2755:d000:1:a1e6:4d80:93a1, 2600:9000:2755:ee00:1:a1e6:4d80:93a1 |
| Response IP | 108.156.133.10 |
| Found | Yes |
| Hash | 8e3f4748b9bfb92f8105d601af131217d3469e30bf7de95a486d4c56d8ec038c |
| SimHash | f5154c9e3911 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /cart |
| Disallow | /checkout |
| Disallow | /site/product |
| Disallow | /p/Give-Please-a-Chance/Give-Please-a-Chance---free/47469.html |
| Disallow | /p/Culture-Warrior/Give-Please-a-Chance---free/47469.html?dispid=409 |
| Disallow | /terms-of-sale |
| Disallow | /g/Terms-of-Sale/861.html |
| Disallow | /premiumterms |
| Disallow | /g/Premium-Membership-Terms-and-Conditions/862.html |
| Disallow | /vb/oreilly-factor |
| Disallow | /podcast?action=fullShowPodcast |