Log In Sign Up

flordeplanta.com.ar
robots.txt

Robots Exclusion Standard data for flordeplanta.com.ar

Resource Scan

Scan Details

Site Domain flordeplanta.com.ar
Base Domain flordeplanta.com.ar
Scan Status Ok
Last Scan2024-10-26T19:44:14+00:00
Next Scan 2024-11-02T19:44:14+00:00

Last Scan

Scanned2024-10-26T19:44:14+00:00
URL https://flordeplanta.com.ar/robots.txt
Domain IPs 104.21.68.138, 172.67.195.237, 2606:4700:3030::6815:448a, 2606:4700:3037::ac43:c3ed
Response IP 104.21.68.138
Found Yes
Hash fe958256581d364f72e4008e939cc87052ac7524447a7c63581f33cd32663fc1
SimHash f61041c96ef7

Groups

dotbot/1.2;

Rule Path
Disallow /

semrushbot/7~bl;

Rule Path
Disallow /

ahrefsbot/7.0;

Rule Path
Disallow /

mj12bot/v1.4.8

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow
Allow /*

mediapartners-google*

Rule Path
Disallow
Allow /*

duggmirror

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /wp-content/plugins
Disallow /wp-content/backup*
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /*/*/*/feed.xml
Disallow /*/*/attachment
Disallow */trackback
Disallow /search/
Disallow */comment-page-*/
Disallow */*/?x=0&y=0
Disallow */*/*%26x%3D0%26y%3D0
Disallow /*/*/?ref*
Disallow /*/?ref*
Disallow /categoria/*..*/*
Disallow /tag/*..*/*
Disallow *?ref*
Disallow /*?fb_xd_fragment
Disallow /page/*iframe*
Disallow *?refsite=www.n1ads.com&ref=alexa-traffic-rank
Disallow /*/*/?newwindow=*
Disallow /*/*/?dur=*
Disallow /*/?newwindow=*
Disallow /*/?dur=*
Disallow /*/*/?utm_source=*
Disallow /*/*/?a=*
Disallow /*/?utm_source=*
Disallow /*/?a=*
Allow /ads.txt
Back to top

Other Records

Field Value
sitemap https://www.flordeplanta.com.ar/sitemap_index.xml
Back to top

Comments

  • robots.txt
  • First, this is the
  • robots.txt from http://www.wikipedia.org/ for "other" robots
  • Thanks Wikipedians!
  • Please note: There are a lot of pages on this site, and there are
  • some misbehaved spiders out there that go _way_ too fast. If you're
  • irresponsible, your access to the site may be blocked.
  • Google Image
  • Google AdSense
  • digg mirror
  • Crawlers that are kind enough to obey, but which we'd rather not have
  • unless they're feeding search engines.
  • Some bots are known to be trouble, particularly those designed to copy
  • entire sites. Please obey robots.txt.
  • Sorry, wget in its recursive mode is a frequent problem.
  • Please read the man page and use it properly; there is a
  • --wait option you can use to set the delay between hits,
  • for instance.
  • The 'grub' distributed client has been *very* poorly behaved.
  • Doesn't follow robots.txt anyway, but...
  • Hits many times per second, not acceptable
  • http://www.nameprotect.com/botinfo.html
  • A capture bot, downloads gazillions of pages with no public benefit
  • http://www.webreaper.net/
Back to top