quotationspage.com
robots.txt

Robots Exclusion Standard data for quotationspage.com

Resource Scan

Scan Details

Site Domain quotationspage.com
Base Domain quotationspage.com
Scan Status Ok
Last Scan2024-09-23T05:32:15+00:00
Next Scan 2024-09-30T05:32:15+00:00

Last Scan

Scanned2024-09-23T05:32:15+00:00
URL http://quotationspage.com/robots.txt
Redirect http://www.quotationspage.com/robots.txt
Redirect Domain www.quotationspage.com
Redirect Base quotationspage.com
Domain IPs 74.208.47.119
Redirect IPs 74.208.47.119
Response IP 74.208.47.119
Found Yes
Hash 1995fdaced0647a17ac05a1c114bc2420dfa631bdf415777a42b04cee4a91938
SimHash a19590b30b60

Groups

webzip

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

copernic

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

crescent

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

mozilla

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

ia_archiver/1.6

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

miixpc

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

website quester

Rule Path
Disallow /

moget/2.1

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

netants

Rule Path
Disallow /

httplib

Rule Path
Disallow /

spanner

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

cherrypickerse/1.0

Rule Path
Disallow /

cherrypickerelite/1.0

Rule Path
Disallow /

webbandit/3.50

Rule Path
Disallow /

nicerspro

Rule Path
Disallow /

microsoft url control - 5.01.4511

Rule Path
Disallow /

lwp-trivial/1.34

Rule Path
Disallow /

lwp-trivial

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

linkextractorpro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

lexibot

Rule Path
Disallow /

webenhancer

Rule Path
Disallow /

getright/4.2

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

npbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

slysearch

Rule Path
Disallow /

*

Rule Path
Disallow /zz
Disallow /ztrap.php
Disallow /zpage
Disallow /zzpage
Disallow /work

Comments

  • loosely based on webmasterworld.com, most probably unneeded
  • bots that waste traffic but don't give me search results
  • Stop plagiarism.com's stupid robot from pounding on my site