tigerbait.com
robots.txt
Robots Exclusion Standard data for tigerbait.com
Resource Scan
Scan Details
Site Domain | tigerbait.com |
Base Domain | tigerbait.com |
Scan Status | Ok |
Last Scan | 2024-11-15T20:08:48+00:00 |
Next Scan | 2024-11-22T20:08:48+00:00 |
Last Scan
Scanned | 2024-11-15T20:08:48+00:00 |
URL | https://tigerbait.com/robots.txt |
Domain IPs | 40.119.40.202 |
Response IP | 40.119.40.202 |
Found | Yes |
Hash | 4f5a522bc5e3ff4c7484d7f30da392f178442c584915f2a0432d6edbea346c88 |
SimHash | 790424c99415 |
Groups
*
Rule | Path |
---|---|
Disallow | /modules/foundationarticles |
Disallow | /news/link/ |
Disallow | /modules/sportsblock |
Disallow | /modules/maroonbookspotlight |
Disallow | /forums/_post |
Disallow | /store/_store_addtocart |
Disallow | /store/_store_items |
Disallow | /store/_skeleton |
Disallow | /store/_store_items_list |
Disallow | /store/_store_updatecart |
Disallow | /account/validate |
Disallow | /home/small |
Disallow | /forums/_potdpost |
Disallow | /recruiting/_sidecommits |
Disallow | /premium/feedpartial |
Disallow | /premium/_feedinner |
Disallow | /players/_recruitupdate |
Disallow | /media/customize |
Disallow | /media/playerdata |
Disallow | /players/_recruitupdate |
Disallow | /newsletter/unsubscribe |
Disallow | /account/profile |
Other Records
Field | Value |
---|---|
sitemap | http://tigerbait.com/sitemap.xml |