anekdot.ru
robots.txt
Robots Exclusion Standard data for anekdot.ru
Resource Scan
Scan Details
Site Domain | anekdot.ru |
Base Domain | anekdot.ru |
Scan Status | Ok |
Last Scan | 2024-11-13T19:20:42+00:00 |
Next Scan | 2024-11-20T19:20:42+00:00 |
Last Scan
Scanned | 2024-11-13T19:20:42+00:00 |
URL | https://anekdot.ru/robots.txt |
Redirect | https://www.anekdot.ru/robots.txt |
Redirect Domain | www.anekdot.ru |
Redirect Base | anekdot.ru |
Domain IPs | 135.181.220.96 |
Redirect IPs | 135.181.220.96 |
Response IP | 135.181.220.96 |
Found | Yes |
Hash | 85f084099a617756a946d6807bc49595ce8dc9a934e7faa989014335f4777006 |
SimHash | 528188ef07f1 |
Groups
*
Rule | Path |
---|---|
Disallow | /away/ |
Disallow | /rating |
Disallow | /index.php |
Disallow | /a/top/ |
Disallow | /an/top/ |
Disallow | /send/ |
Disallow | /random/*/?rank= |
Disallow | /authors/?o= |
Disallow | /author-best/?o=dp |
Disallow | /author-best/?o=o2 |
Disallow | /author-best/?o=-dp |
Disallow | /author-best/?o=-o1 |
Disallow | /author-best/?o=-o2 |
Disallow | /tags/*type%3D |
Disallow | /tags/*sort%3D |
Disallow | /scripts/ |
Disallow | /author-best/comments/? |
Disallow | /author-best/blocks/? |
Disallow | /author-best/rating/? |
Disallow | /author-best/daily* |
Disallow | /blog/view/*page%3D* |
Disallow | /plugins/ |
Disallow | /ajax/ |
Disallow | /i/apics/ |
Disallow | /i/mp3/ |
Disallow | /i/flv/ |
Disallow | /i/gallery/ |
Disallow | /audio/ |
Disallow | /i/flash/ |
Disallow | /rss/ |
Disallow | /id/statUsers |
Disallow | /id/voteStats |
Other Records
Field | Value |
---|---|
sitemap | https://www.anekdot.ru/rss/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.