kozhikode.quikr.com
robots.txt

Robots Exclusion Standard data for kozhikode.quikr.com

Resource Scan

Scan Details

Site Domain kozhikode.quikr.com
Base Domain quikr.com
Scan Status Ok
Last Scan2024-11-12T19:59:47+00:00
Next Scan 2024-11-19T19:59:47+00:00

Last Scan

Scanned2024-11-12T19:59:47+00:00
URL https://kozhikode.quikr.com/robots.txt
Domain IPs 104.83.197.228
Response IP 23.195.154.32
Found Yes
Hash eddc2a78a11cddfe02a8488e8f0bceebd89e77d14365c1aac64553f87af7559d
SimHash b8f139934fdb

Groups

*

Rule Path
Disallow /core/checkUser
Disallow /core/new-login-popup
Disallow /cg_confi
Disallow /datamigration
Disallow /cg_img
Disallow /cg_valid
Disallow /cg_util
Disallow /js
Disallow /interface
Disallow /DMEg
Disallow /cg_js
Disallow /cd_css
Disallow /cg_core
Disallow /cd_action
Disallow /_help
Disallow /PostAd?categoryId*
Disallow /fabu?categoryId*
Disallow /?changeLocation=Y*
Disallow /MyQuikr*
Disallow /view-ad*
Disallow /SignIn?keepPost=true*
Disallow /SignIn*
Disallow /content/
Disallow /zhuce
Disallow /tu0
Disallow /tu1
Disallow /tu2
Disallow /tu3
Disallow /tu4
Disallow /tu5
Disallow /tu6
Disallow /tu7
Disallow /tu8
Disallow /tu9
Disallow /u0
Disallow /u1
Disallow /u2
Disallow /u3
Disallow /u4
Disallow /u5
Disallow /u6
Disallow /u7
Disallow /u8
Disallow /u9
Disallow /*WOQQAdIdZ
Disallow /msp?*
Disallow /pets/*_*
Disallow /cars/new*%26
Disallow /re2/
Disallow */pg/
Disallow /managed-rentals/

psbot/0.1

Rule Path
Disallow /

twiceler www.cuill.com/robots.html

Rule Path
Disallow /

twiceler-0.9 http://www.cuill.com/twiceler/robot.html

Rule Path
Disallow /

dwaarbot+(dwaarbot@dwaar.com)

Rule Path
Disallow /

cazoodlebot

Rule Path
Disallow /

giga�mega.bot/1.0; +http://www.giga�mega.net/bot.html

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baidu

Rule Path
Disallow /

speedy

Rule Path
Disallow /

iiitbot/1.1 (indian language web search engine; http://webkhoj.iiit.net; pvvpr at iiit dot ac dot in)

Rule Path
Disallow /

boitho.com-dc

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

seekbot

Rule Path
Disallow /

pete-spider light

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

Comments

  • BEGIN FILE
  • allow-all
  • The use of robots or other automated means to access the Quikr site
  • without the express permission of Quikr is strictly prohibited.
  • Notwithstanding the foregoing, quikr may permit automated access to
  • access certain Quikr pages but soley for the limited purpose of
  • including content in publicly available search engines. Any other
  • use of robots or failure to obey the robots exclusion standards set
  • forth at <http://www.robotstxt.org/ wc/ exclusion.html> is strictly
  • prohibited.
  • v3
  • END FILE