bearinsider.com
robots.txt
Robots Exclusion Standard data for bearinsider.com
Resource Scan
Scan Details
| Site Domain | bearinsider.com |
| Base Domain | bearinsider.com |
| Scan Status | Ok |
| Last Scan | 2024-11-04T18:07:22+00:00 |
| Next Scan | 2024-11-11T18:07:22+00:00 |
Last Scan
| Scanned | 2024-11-04T18:07:22+00:00 |
| URL | https://bearinsider.com/robots.txt |
| Domain IPs | 40.119.40.202 |
| Response IP | 40.119.40.202 |
| Found | Yes |
| Hash | 5050abd0980c35b1b1431620ab446e3347386fbf2ad6d036044226c32dc2b7c2 |
| SimHash | f90024c1d515 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /modules/foundationarticles |
| Disallow | /news/link/ |
| Disallow | /modules/sportsblock |
| Disallow | /modules/maroonbookspotlight |
| Disallow | /forums/_post |
| Disallow | /store/_store_addtocart |
| Disallow | /store/_store_items |
| Disallow | /store/_skeleton |
| Disallow | /store/_store_items_list |
| Disallow | /store/_store_updatecart |
| Disallow | /account/validate |
| Disallow | /home/small |
| Disallow | /forums/_potdpost |
| Disallow | /recruiting/_sidecommits |
| Disallow | /premium/feedpartial |
| Disallow | /premium/_feedinner |
| Disallow | /players/_recruitupdate |
| Disallow | /media/customize |
| Disallow | /media/playerdata |
| Disallow | /players/_recruitupdate |
| Disallow | /newsletter/unsubscribe |
| Disallow | /account/profile |
Other Records
| Field | Value |
|---|---|
| sitemap | http://bearinsider.com/sitemap.xml |