citaty.info
robots.txt

Robots Exclusion Standard data for citaty.info

Resource Scan

Scan Details

Site Domain citaty.info
Base Domain citaty.info
Scan Status Ok
Last Scan2024-06-24T16:48:13+00:00
Next Scan 2024-07-01T16:48:13+00:00

Last Scan

Scanned2024-06-24T16:48:13+00:00
URL https://citaty.info/robots.txt
Domain IPs 138.201.51.136
Response IP 138.201.51.136
Found Yes
Hash 5af1b61bc0ef28af11de251a7e14107aa63e37d1e9fcff37b1faee553eba7930
SimHash f84b83038c74

Groups

*

Rule Path
Disallow /admin
Disallow /comment/
Disallow /comment/reply
Disallow /comment/reply/
Disallow /node/add/
Disallow /node/all/*
Disallow /search/*
Disallow /user/login/
Disallow /profile
Disallow /contact
Disallow /vote_up_down/
Disallow /my_quotes
Disallow /bookmarks
Disallow /flag/
Disallow /messages/
Disallow /taxonomy/
Disallow /*/feed$
Disallow /*/rss$
Disallow /*/track$
Disallow /tracker
Disallow /*%26openid_identifier%3D
Disallow *?destination
Disallow *?qt
Disallow /user/*
Disallow /hybridauth
Disallow /signin
Disallow /report
Disallow /image_captcha
Disallow /votes
Disallow /users/*
Disallow /ajax
Disallow *page%3D0
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /sites/
Disallow /themes/
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /buy.php
Allow /user/register
Allow /user/password
Allow /user/*/collections
Allow /user/131777/translations

yandex

Rule Path
Disallow /*/amp
Disallow /admin
Disallow /comment/
Disallow /comment/reply
Disallow /comment/reply/
Disallow /node/add/
Disallow /node/all/*
Disallow /search/*
Disallow /user/register/
Disallow /user/password/
Disallow /user/login/
Disallow /profile
Disallow /contact
Disallow /vote_up_down/
Disallow /my_quotes
Disallow /bookmarks
Disallow /flag/
Disallow /messages/
Disallow /taxonomy/
Disallow /*/feed$
Disallow /*/rss$
Disallow /*/track$
Disallow /tracker
Disallow /user/*
Disallow /hybridauth
Disallow /signin
Disallow /report
Disallow /image_captcha
Disallow /votes
Disallow /users/*
Disallow /ajax
Disallow *page%3D0
Disallow /includes/
Disallow /misc/
Disallow /modules/
Disallow /profiles/
Disallow /scripts/
Disallow /sites/
Disallow /themes/
Disallow /cron.php
Disallow /update.php
Disallow /xmlrpc.php
Disallow /buy.php
Allow /user/register
Allow /user/password
Allow /user/*/collections

slurp

Rule Path
Disallow /

yahoo-newscrawler

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

spinn3r

Rule Path
Disallow /

riddler

Rule Path
Disallow /

Comments

  • Directories
  • Files
  • Yandex

Warnings

  • `clean-param` is not a known field.