crowdranking.com
robots.txt
Robots Exclusion Standard data for crowdranking.com
Resource Scan
Scan Details
| Site Domain | crowdranking.com |
| Base Domain | crowdranking.com |
| Scan Status | Ok |
| Last Scan | 2024-09-12T05:22:02+00:00 |
| Next Scan | 2024-10-12T05:22:02+00:00 |
Last Scan
| Scanned | 2024-09-12T05:22:02+00:00 |
| URL | http://crowdranking.com/robots.txt |
| Domain IPs | 213.208.138.231 |
| Response IP | 213.208.138.231 |
| Found | Yes |
| Hash | c7a0b76ba393e68634a657d6efde8dcc491b56752fd6af173ac7aaf5297bb955 |
| SimHash | 105c5040996a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /comments/*/reply$ |
| Disallow | /filter |
| Disallow | /*/filter |
| Disallow | /groups/*/filter |
| Disallow | /messages |
| Disallow | /sessions |
| Disallow | /tickets |
| Disallow | /users/*/filter |
| Disallow | /*?cat= |
| Disallow | /*?sort= |
| Disallow | /*?by= |
| Disallow | /*?type= |
| Disallow | /*?lang= |
| Disallow | /*?*&cat= |
| Disallow | /*?*&sort= |
| Disallow | /*?*&by= |
| Disallow | /*?*&type= |
| Disallow | /*?*&lang= |
| Disallow | /redirect |
| Disallow | /redirect.asp |
Warnings
- 2 invalid lines.
Comments