canlansports.com
robots.txt
Robots Exclusion Standard data for canlansports.com
Resource Scan
Scan Details
| Site Domain | canlansports.com |
| Base Domain | canlansports.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-07-16T13:18:05+00:00 |
| Next Scan | 2024-10-14T13:18:05+00:00 |
Last Successful Scan
| Scanned | 2024-03-18T11:24:24+00:00 |
| URL | https://canlansports.com/robots.txt |
| Redirect | https://www.canlansports.com/robots.txt |
| Redirect Domain | www.canlansports.com |
| Redirect Base | canlansports.com |
| Domain IPs | 3.98.175.228 |
| Redirect IPs | 13.33.88.126, 13.33.88.31, 13.33.88.59, 13.33.88.71, 2600:9000:223b:2600:5:19da:f700:93a1, 2600:9000:223b:6400:5:19da:f700:93a1, 2600:9000:223b:9200:5:19da:f700:93a1, 2600:9000:223b:a600:5:19da:f700:93a1, 2600:9000:223b:d200:5:19da:f700:93a1, 2600:9000:223b:e600:5:19da:f700:93a1, 2600:9000:223b:ec00:5:19da:f700:93a1, 2600:9000:223b:f200:5:19da:f700:93a1 |
| Response IP | 13.33.88.126 |
| Found | Yes |
| Hash | 20b0d2c2453379c3bf4875787a9f5a712292f24be798362b379a83dc254fd857 |
| SimHash | 7041590690d4 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /app/wp-admin |
| Disallow | /app/wp-includes |
| Disallow | /app/wp-content/plugins/ |
| Disallow | /app/wp-content/cache/ |
| Disallow | /app/wp-content/themes/ |
| Disallow | */trackback/ |
| Disallow | */feed/ |
| Disallow | /*/feed/rss/$ |
| Disallow | /category/* |
| Disallow | /thank-you |