cfsleague.org
robots.txt
Robots Exclusion Standard data for cfsleague.org
Resource Scan
Scan Details
| Site Domain | cfsleague.org |
| Base Domain | cfsleague.org |
| Scan Status | Ok |
| Last Scan | 2024-09-28T10:33:22+00:00 |
| Next Scan | 2024-10-05T10:33:22+00:00 |
Last Scan
| Scanned | 2024-09-28T10:33:22+00:00 |
| URL | https://cfsleague.org/robots.txt |
| Domain IPs | 104.16.222.243, 104.16.223.243 |
| Response IP | 104.16.222.243 |
| Found | Yes |
| Hash | ddb2bb637f94b10a4933353ae31b05fc9914c9a3a8de4d27e577a0e8d8f4970d |
| SimHash | 4e18fed0cab1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /roster/show/5890821?subseason=699001 |
| Disallow | /roster/show/5578983?subseason=670169 |
| Disallow | /roster/show/5276914?subseason=638017 |
| Disallow | /roster/show/4809168?subseason=590615 |
| Disallow | /roster/show/4342732?subseason=530866 |
*
| Rule | Path |
|---|---|
| Disallow | /event/show_day |
| Disallow | /event/*/*/*/* |
Warnings
- 2 invalid lines.