Log In Sign Up

comparasoftware.com.ar
robots.txt

Robots Exclusion Standard data for comparasoftware.com.ar

Resource Scan

Scan Details

Site Domain comparasoftware.com.ar
Base Domain comparasoftware.com.ar
Scan Status Ok
Last Scan2024-11-14T08:34:50+00:00
Next Scan 2024-12-14T08:34:50+00:00

Last Scan

Scanned2024-11-14T08:34:50+00:00
URL https://comparasoftware.com.ar/robots.txt
Redirect https://www.comparasoftware.com.ar:443/robots.txt
Redirect Domain www.comparasoftware.com.ar
Redirect Base comparasoftware.com.ar
Domain IPs 34.228.108.3, 34.231.158.245, 54.161.238.35
Redirect IPs 108.157.254.13, 108.157.254.34, 108.157.254.77, 108.157.254.98
Response IP 108.157.254.13
Found Yes
Hash 852f5d0bbcfa9189ad7dcf384b243f1e1dc3c6f41aaa2db94fb7946d57d04cf0
SimHash 2094db226e21

Groups

*

Rule Path
Disallow /*index.php*

*

Rule Path
Disallow /*/1000

*

Rule Path
Allow /*.js$
Allow /*.css$

*

Rule Path
Disallow /*.pdf$

*

Rule Path
Disallow /*?

*

Rule Path
Disallow /*?s=
Disallow /search

*

Rule Path
Disallow /ppc/*

googlebot-image

Rule Path
Allow /wp-content/uploads/
Disallow /productos/*
Disallow /categorias/*
Disallow /images/Vector_7.png
Disallow /images/Vector-gray.png
Disallow /images/Vector_7_purple.png
Disallow /images/Vector-gray.png
Disallow /images/check-icon.svg
Disallow /images/arrow-select-gray.png
Disallow /images/down-arrow.png
Disallow /js/modules/formbuilder/form2022.min.js
Disallow /js/comparator-static.min.js

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

semrushbot

Rule Path
Allow /

semrushbot-sa

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

psbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bloglines/3.1

Rule Path
Disallow /

jyxobot/1

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

vegi

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

hl_ftien_spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.comparasoftware.com.ar/sitemap.xml/static
sitemap https://www.comparasoftware.com.ar/sitemap.xml/categories
sitemap https://www.comparasoftware.com.ar/sitemap.xml/softwares
sitemap https://www.comparasoftware.com.ar/sitemap.xml/partners
Back to top

Comments

  • Bloquear url con index.php
  • Evita bloqueos de CSS y JS.
  • Bloquear todos los pdfs
  • Bloqueo de las URL dinamicas
  • Bloqueo de busquedas
  • Bloqueo de busquedas
  • Lista de bots a permitir.
  • Bloqueo urls antigua jerarquia
  • Bloqueo imagenes
  • Lista de bots bloqueados
Back to top