terrapintimes.com
robots.txt
Robots Exclusion Standard data for terrapintimes.com
Resource Scan
Scan Details
| Site Domain | terrapintimes.com |
| Base Domain | terrapintimes.com |
| Scan Status | Ok |
| Last Scan | 2024-11-19T10:27:26+00:00 |
| Next Scan | 2024-11-26T10:27:26+00:00 |
Last Scan
| Scanned | 2024-11-19T10:27:26+00:00 |
| URL | https://terrapintimes.com/robots.txt |
| Domain IPs | 40.119.40.202 |
| Response IP | 40.119.40.202 |
| Found | Yes |
| Hash | d80ae0332467ec888977e8ab3b246764dfb04bc4ab17fcb8ab3a9f8145fc8883 |
| SimHash | 790024cd9514 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /modules/foundationarticles |
| Disallow | /news/link/ |
| Disallow | /modules/sportsblock |
| Disallow | /modules/maroonbookspotlight |
| Disallow | /forums/_post |
| Disallow | /store/_store_addtocart |
| Disallow | /store/_store_items |
| Disallow | /store/_skeleton |
| Disallow | /store/_store_items_list |
| Disallow | /store/_store_updatecart |
| Disallow | /account/validate |
| Disallow | /home/small |
| Disallow | /forums/_potdpost |
| Disallow | /recruiting/_sidecommits |
| Disallow | /premium/feedpartial |
| Disallow | /premium/_feedinner |
| Disallow | /players/_recruitupdate |
| Disallow | /media/customize |
| Disallow | /media/playerdata |
| Disallow | /players/_recruitupdate |
| Disallow | /newsletter/unsubscribe |
| Disallow | /account/profile |
Other Records
| Field | Value |
|---|---|
| sitemap | http://terrapintimes.com/sitemap.xml |