nofollow.ru
robots.txt
Robots Exclusion Standard data for nofollow.ru
Resource Scan
Scan Details
| Site Domain | nofollow.ru |
| Base Domain | nofollow.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-12T21:50:06+00:00 |
| Next Scan | 2024-06-19T21:50:06+00:00 |
Last Scan
| Scanned | 2024-06-12T21:50:06+00:00 |
| URL | http://nofollow.ru/robots.txt |
| Response IP | 178.218.218.20 |
| Found | Yes |
| Hash | a3ffd2b63b15a96ffbdfa0d6d1f468ca2a65bb4ecf3179a07d2e64a675a96e92 |
| SimHash | 6ff74e63c68b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search.php |
| Disallow | /channel.php |
| Disallow | /photosearch.php |
| Disallow | /yasearch.php |
| Allow | /photosearch.php?tag* |
| Disallow | /cgi-bin/ |
| Disallow | /?page=escape* |
| Disallow | /?page=img* |
| Disallow | /spec/* |
| Disallow | /*.htm?* |
| Allow | /photos_*.htm?* |
Warnings
- `host` is not a known field.