nonleaguematters.co.uk
robots.txt
Robots Exclusion Standard data for nonleaguematters.co.uk
Resource Scan
Scan Details
Site Domain | nonleaguematters.co.uk |
Base Domain | nonleaguematters.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-07-31T15:18:55+00:00 |
Next Scan | 2024-10-29T15:18:55+00:00 |
Last Successful Scan
Scanned | 2023-04-09T15:15:32+00:00 |
URL | https://nonleaguematters.co.uk/robots.txt |
Redirect | https://www.nonleaguematters.co.uk/robots.txt |
Redirect Domain | www.nonleaguematters.co.uk |
Redirect Base | nonleaguematters.co.uk |
Domain IPs | 104.26.14.27, 104.26.15.27, 172.67.75.138, 2606:4700:20::681a:e1b, 2606:4700:20::681a:f1b, 2606:4700:20::ac43:4b8a |
Redirect IPs | 104.26.14.27, 104.26.15.27, 172.67.75.138, 2606:4700:20::681a:e1b, 2606:4700:20::681a:f1b, 2606:4700:20::ac43:4b8a |
Response IP | 172.67.75.138 |
Found | Yes |
Hash | eb7b51409b658fcdcc5fb139fbd6131cb883355c05aaeedcecce636612397659 |
SimHash | 2814d7925681 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /images/ |
Disallow | /includes/ |
Disallow | /plugins/ |
Disallow | /skins/ |
*
Rule | Path |
---|---|
Disallow | / |
Warnings
- 1 invalid line.