fantasy.nfl.com
robots.txt
Robots Exclusion Standard data for fantasy.nfl.com
Resource Scan
Scan Details
Site Domain | fantasy.nfl.com |
Base Domain | nfl.com |
Scan Status | Ok |
Last Scan | 2024-05-08T03:54:19+00:00 |
Next Scan | 2024-05-22T03:54:19+00:00 |
Last Scan
Scanned | 2024-05-08T03:54:19+00:00 |
URL | https://fantasy.nfl.com/robots.txt |
Domain IPs | 151.101.1.153, 151.101.129.153, 151.101.193.153, 151.101.65.153 |
Response IP | 199.232.45.153 |
Found | Yes |
Hash | 6c6a3a88d65977cfaa0bb27b66b8dd0f6533561f01bc0f2ef0f6a162a6184999 |
SimHash | aa0d8a12a993 |
Groups
*
Rule | Path |
---|---|
Disallow | /league* |
Disallow | /autopick* |
Disallow | /registration* |
Disallow | /draftclienttest* |
Other Records
Field | Value |
---|---|
sitemap | https://fantasy.nfl.com/sitemap.xml |