nfl.com
robots.txt
Robots Exclusion Standard data for nfl.com
Resource Scan
Scan Details
Site Domain | nfl.com |
Base Domain | nfl.com |
Scan Status | Ok |
Last Scan | 2024-04-22T10:42:36+00:00 |
Next Scan | 2024-04-29T10:42:36+00:00 |
Last Scan
Scanned | 2024-04-22T10:42:36+00:00 |
URL | https://nfl.com/robots.txt |
Redirect | https://www.nfl.com/robots.txt |
Redirect Domain | www.nfl.com |
Redirect Base | nfl.com |
Domain IPs | 151.101.1.153, 151.101.129.153, 151.101.193.153, 151.101.65.153 |
Redirect IPs | 151.101.1.153, 151.101.129.153, 151.101.193.153, 151.101.65.153 |
Response IP | 199.232.45.153 |
Found | Yes |
Hash | 50eb909af0c7ee0f60215c45acb6c49635a6552ee9c161c899fbc86b2f435e32 |
SimHash | 8d2c9ec2ed18 |
Groups
*
Rule | Path |
---|---|
Disallow | /_ctv/ |
Disallow | /_fantasy-app/ |
Disallow | /_libraries/ |
Disallow | /_mobile-app/ |
Disallow | /_mobileview/ |
Disallow | /_phs/ |
Disallow | /_sponsors/ |
Disallow | /account/ |
Disallow | /nfl-films-beta/ |
Disallow | /search/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.nfl.com/sitemap-index.xml |