sfasawmill.com
robots.txt
Robots Exclusion Standard data for sfasawmill.com
Resource Scan
Scan Details
Site Domain | sfasawmill.com |
Base Domain | sfasawmill.com |
Scan Status | Ok |
Last Scan | 2024-11-14T08:14:56+00:00 |
Next Scan | 2024-11-21T08:14:56+00:00 |
Last Scan
Scanned | 2024-11-14T08:14:56+00:00 |
URL | https://sfasawmill.com/robots.txt |
Domain IPs | 40.119.40.202 |
Response IP | 40.119.40.202 |
Found | Yes |
Hash | 2d43876e3d008f866a52f3e353e6e2702cd28f1f543b31a7bb7a081111c1b50d |
SimHash | f90024c1d414 |
Groups
*
Rule | Path |
---|---|
Disallow | /modules/foundationarticles |
Disallow | /news/link/ |
Disallow | /modules/sportsblock |
Disallow | /modules/maroonbookspotlight |
Disallow | /forums/_post |
Disallow | /store/_store_addtocart |
Disallow | /store/_store_items |
Disallow | /store/_skeleton |
Disallow | /store/_store_items_list |
Disallow | /store/_store_updatecart |
Disallow | /account/validate |
Disallow | /home/small |
Disallow | /forums/_potdpost |
Disallow | /recruiting/_sidecommits |
Disallow | /premium/feedpartial |
Disallow | /premium/_feedinner |
Disallow | /players/_recruitupdate |
Disallow | /media/customize |
Disallow | /media/playerdata |
Disallow | /players/_recruitupdate |
Disallow | /newsletter/unsubscribe |
Disallow | /account/profile |
Other Records
Field | Value |
---|---|
sitemap | http://sfasawmill.com/sitemap.xml |