Log In Sign Up

comparasoftware.com
robots.txt

Robots Exclusion Standard data for comparasoftware.com

Resource Scan

Scan Details

Site Domain comparasoftware.com
Base Domain comparasoftware.com
Scan Status Ok
Last Scan2024-10-25T15:51:10+00:00
Next Scan 2024-11-24T15:51:10+00:00

Last Scan

Scanned2024-10-25T15:51:10+00:00
URL https://comparasoftware.com/robots.txt
Redirect https://www.comparasoftware.com:443/robots.txt
Redirect Domain www.comparasoftware.com
Redirect Base comparasoftware.com
Domain IPs 18.213.32.101, 34.193.153.212, 35.175.30.132
Redirect IPs 108.157.254.13, 108.157.254.34, 108.157.254.77, 108.157.254.98
Response IP 108.157.254.13
Found Yes
Hash 909cd28801aaabf7b572b31f1f165467cb862ea6253f81f337c9333dba56df52
SimHash 20d4db204e61

Groups

*

Rule Path
Disallow /*index.php*

*

Rule Path
Disallow /*/1000

*

Rule Path
Allow /*.js$
Allow /*.css$

*

Rule Path
Disallow /*.pdf$

*

Rule Path
Disallow /*?

*

Rule Path
Disallow /*?s=
Disallow /search

*

Rule Path
Disallow /ppc/*

googlebot-image

Rule Path
Allow /wp-content/uploads/
Disallow /productos/*
Disallow /categorias/*
Disallow /images/Vector_7.png
Disallow /images/Vector-gray.png
Disallow /images/Vector_7_purple.png
Disallow /images/Vector-gray.png
Disallow /images/check-icon.svg
Disallow /images/arrow-select-gray.png
Disallow /images/down-arrow.png
Disallow /js/modules/formbuilder/form2022.min.js
Disallow /js/comparator-static.min.js

adsbot-google

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

semrushbot

Rule Path
Allow /

semrushbot-sa

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

bubing

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

psbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

speedy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bloglines/3.1

Rule Path
Disallow /

jyxobot/1

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

crazywebcrawler-spider

Rule Path
Disallow /

domain re-animator bot

Rule Path
Disallow /

vegi

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

gurujibot

Rule Path
Disallow /

hl_ftien_spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.comparasoftware.com/sitemap.xml/static
sitemap https://www.comparasoftware.com/sitemap.xml/categories
sitemap https://www.comparasoftware.com/sitemap.xml/softwares
Back to top

Comments

  • Bloquear url con index.php
  • Evita bloqueos de CSS y JS.
  • Bloquear todos los pdfs
  • Bloqueo de las URL dinamicas
  • Bloqueo de busquedas
  • Bloqueo de busquedas
  • Lista de bots a permitir.
  • Bloqueo urls antigua jerarquia
  • Bloqueo imagenes
  • Lista de bots bloqueados
Back to top