Log In Sign Up

scalemodels.ru
robots.txt

Robots Exclusion Standard data for scalemodels.ru

Resource Scan

Scan Details

Site Domain scalemodels.ru
Base Domain scalemodels.ru
Scan Status Ok
Last Scan2024-11-09T08:59:52+00:00
Next Scan 2024-11-16T08:59:52+00:00

Last Scan

Scanned2024-11-09T08:59:52+00:00
URL http://scalemodels.ru/robots.txt
Domain IPs 176.9.19.188
Response IP 176.9.19.188
Found Yes
Hash c1512d98f7fb1d7ae851c2f1a735a204d5c28918d1be59f4b5e4c54648598893
SimHash 868ad683a757

Groups

disco pump, wget, webzip, teleport pro, websnake, offline explorer, web-by-mail

Rule Path
Disallow /

*

Rule Path
Disallow /scalemodels.ru
Disallow /*utm_source%3Dfeedburner
Disallow /*fb_xd_fragment
Disallow /?*
Disallow /*admin/
Disallow /*class/
Disallow /*include/
Disallow /*themes/
Disallow /*language/
Disallow /_install/
Disallow /*system/
Disallow /*manual/
Disallow /*search.php
Disallow /modules/banners/
Disallow /modules/mylinks/modlink
Disallow /modules/mylinks/brokenlink
Disallow /modules/mylinks/ratelink
Disallow /modules/mylinks/visit
Disallow /modules/mylinks/singlelink.php?lid=
Disallow /modules/mylinks/viewcat
Disallow /modules/mydownloads/modfile
Disallow /modules/mydownloads/brokenfile
Disallow /modules/mydownloads/ratefile
Disallow /modules/mydownloads/visit
Disallow /modules/mydownloads/viewcat
Disallow /modules/myarticles/ratearticles.php
Disallow /modules/myarticles/im
Disallow /*/article.php?storyid=
Disallow /modules/partners/
Disallow /modules/photo/rateimg.php
Disallow /modules/photo/thumbnail
Disallow /modules/photo/carte
Disallow /modules/forum/login
Disallow /modules/forum/groupcp
Disallow /modules/forum/faq
Disallow /modules/forum/login
Disallow /modules/forum/memberlist
Disallow /modules/forum/posting
Disallow /modules/forum/privmsg
Disallow /modules/forum/profile
Disallow /modules/forum/search
Disallow /modules/forum/viewonline
Disallow /modules/forum/index.php?c=
Disallow /modules/forum/viewtopic_p_
Disallow /modules/forum/viewtopic.php?p=
Disallow /modules/forum/*lofi%3D1
Disallow /modules/forum/*printertopic%3D1
Disallow /modules/forum/admin/
Disallow /modules/forum/cache/
Disallow /modules/forum/db/
Disallow /modules/forum/images/
Disallow /modules/forum/includes/
Disallow /modules/forum/language/
Disallow /modules/forum/templates/
Disallow /modules/forum/extension
Disallow /modules/forum/news
Disallow /modules/forum/common
Disallow /modules/forum/config
Disallow /modules/forum/faq
Disallow /modules/forum/friend
Disallow /modules/forum/groupcp
Disallow /modules/forum/memberlist
Disallow /modules/forum/modcp
Disallow /modules/forum/posting
Disallow /modules/forum/post_report
Disallow /modules/forum/*mark_
Disallow /modules/forum/privmsg
Disallow /modules/forum/profile
Disallow /modules/forum/search.php
Disallow /modules/forum/viewonline.php
Disallow /modules/forum/login
Disallow /modules/forum/watched.php
Disallow /modules/forum/index.php?c=
Disallow /modules/forum/*highlight
Disallow /modules/forum/*mode%3Dreputation
Disallow /modules/forum/viewtopi*postdays_0_postorder_asc__start_*
Disallow /modules/forum/viewtopic*%26view%3D
Disallow /modules/forum/viewtopic*?topic_id=*
Disallow /modules/forum/viewtopic*?forum=*
Disallow /go/
Disallow /register.php
Disallow /whyregister.php
Disallow /user.php
Disallow /userinfo.php
Disallow /edituser.php
Disallow /wiki
Disallow /tag/%3C
Disallow /abuse
Disallow /modules/forum/viewtopic*view*
Disallow /modules/forum/login
Disallow /modules/forum/viewtopic*watch%3Dtopic*
Disallow

Other Records

Field Value
crawl-delay 2

googlebot-image
yandeximages
psbot (picsearch)
yahoo-mmcrawler

Rule Path
Allow /modules/myarticles/im
Back to top

Comments

  • robots.txt
  • User-agent: Mediapartners-Google
  • Disallow:
  • Disallow: /modules/myarticles/*$$$$
  • Disallow: /*print
  • User-agent: Yandex
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top