fantasysp.com
robots.txt

Robots Exclusion Standard data for fantasysp.com

Resource Scan

Scan Details

Site Domain fantasysp.com
Base Domain fantasysp.com
Scan Status Ok
Last Scan2024-11-16T03:00:17+00:00
Next Scan 2024-11-23T03:00:17+00:00

Last Scan

Scanned2024-11-16T03:00:17+00:00
URL https://fantasysp.com/robots.txt
Redirect https://www.fantasysp.com/robots.txt
Redirect Domain www.fantasysp.com
Redirect Base fantasysp.com
Domain IPs 192.124.249.2
Redirect IPs 192.124.249.2
Response IP 192.124.249.2
Found Yes
Hash 5105b65bcdad86754d2405ec3195a595efaa9319bf85bd334a82202a83c647a5
SimHash 102493a02c32

Groups

*

Rule Path
Disallow /nhl_top_100/
Disallow /nfl_top_100/
Disallow /mlb_top_100/
Disallow /nba_top_100/
Disallow /_player_news/
Disallow /all_player_news/
Disallow /bapi.php
Disallow */ajax/aggregate
Disallow */spa/aggregate
Disallow */page_action/aggregate
Disallow */session_trace/aggregate
Disallow */metrics/aggregate
Disallow */jserrors/aggregate
Disallow */page_view_timing/aggregate
Disallow */page_view_event/aggregate
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /