anekdot.ru
robots.txt

Robots Exclusion Standard data for anekdot.ru

Resource Scan

Scan Details

Site Domain anekdot.ru
Base Domain anekdot.ru
Scan Status Ok
Last Scan2024-11-13T19:20:42+00:00
Next Scan 2024-11-20T19:20:42+00:00

Last Scan

Scanned2024-11-13T19:20:42+00:00
URL https://anekdot.ru/robots.txt
Redirect https://www.anekdot.ru/robots.txt
Redirect Domain www.anekdot.ru
Redirect Base anekdot.ru
Domain IPs 135.181.220.96
Redirect IPs 135.181.220.96
Response IP 135.181.220.96
Found Yes
Hash 85f084099a617756a946d6807bc49595ce8dc9a934e7faa989014335f4777006
SimHash 528188ef07f1

Groups

*

Rule Path
Disallow /away/
Disallow /rating
Disallow /index.php
Disallow /a/top/
Disallow /an/top/
Disallow /send/
Disallow /random/*/?rank=
Disallow /authors/?o=
Disallow /author-best/?o=dp
Disallow /author-best/?o=o2
Disallow /author-best/?o=-dp
Disallow /author-best/?o=-o1
Disallow /author-best/?o=-o2
Disallow /tags/*type%3D
Disallow /tags/*sort%3D
Disallow /scripts/
Disallow /author-best/comments/?
Disallow /author-best/blocks/?
Disallow /author-best/rating/?
Disallow /author-best/daily*
Disallow /blog/view/*page%3D*
Disallow /plugins/
Disallow /ajax/
Disallow /i/apics/
Disallow /i/mp3/
Disallow /i/flv/
Disallow /i/gallery/
Disallow /audio/
Disallow /i/flash/
Disallow /rss/
Disallow /id/statUsers
Disallow /id/voteStats

yadirectbot

Rule Path
Disallow

yandex

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.anekdot.ru/rss/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.