canada.fantasy.nfl.com
robots.txt
Robots Exclusion Standard data for canada.fantasy.nfl.com
Resource Scan
Scan Details
| Site Domain | canada.fantasy.nfl.com |
| Base Domain | nfl.com |
| Scan Status | Ok |
| Last Scan | 2024-04-26T02:50:54+00:00 |
| Next Scan | 2024-05-10T02:50:54+00:00 |
Last Scan
| Scanned | 2024-04-26T02:50:54+00:00 |
| URL | https://canada.fantasy.nfl.com/robots.txt |
| Domain IPs | 151.101.1.153, 151.101.129.153, 151.101.193.153, 151.101.65.153 |
| Response IP | 199.232.45.153 |
| Found | Yes |
| Hash | 6c6a3a88d65977cfaa0bb27b66b8dd0f6533561f01bc0f2ef0f6a162a6184999 |
| SimHash | aa0d8a12a993 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /league* |
| Disallow | /autopick* |
| Disallow | /registration* |
| Disallow | /draftclienttest* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://fantasy.nfl.com/sitemap.xml |