clemsonsportstalk.com
robots.txt
Robots Exclusion Standard data for clemsonsportstalk.com
Resource Scan
Scan Details
| Site Domain | clemsonsportstalk.com |
| Base Domain | clemsonsportstalk.com |
| Scan Status | Ok |
| Last Scan | 2024-09-25T16:15:03+00:00 |
| Next Scan | 2024-10-02T16:15:03+00:00 |
Last Scan
| Scanned | 2024-09-25T16:15:03+00:00 |
| URL | https://clemsonsportstalk.com/robots.txt |
| Domain IPs | 40.119.40.202 |
| Response IP | 40.119.40.202 |
| Found | Yes |
| Hash | 2b9a70c1dae78b6e6ed06e2129d48d04247d4bcb92eeff3800c1b36040d9b81b |
| SimHash | f91424c9d415 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /modules/foundationarticles |
| Disallow | /news/link/ |
| Disallow | /modules/sportsblock |
| Disallow | /modules/maroonbookspotlight |
| Disallow | /forums/_post |
| Disallow | /store/_store_addtocart |
| Disallow | /store/_store_items |
| Disallow | /store/_skeleton |
| Disallow | /store/_store_items_list |
| Disallow | /store/_store_updatecart |
| Disallow | /account/validate |
| Disallow | /home/small |
| Disallow | /forums/_potdpost |
| Disallow | /recruiting/_sidecommits |
| Disallow | /premium/feedpartial |
| Disallow | /premium/_feedinner |
| Disallow | /players/_recruitupdate |
| Disallow | /media/customize |
| Disallow | /media/playerdata |
| Disallow | /players/_recruitupdate |
| Disallow | /newsletter/unsubscribe |
| Disallow | /account/profile |
Other Records
| Field | Value |
|---|---|
| sitemap | http://clemsonsportstalk.com/sitemap.xml |