Log In Sign Up

cubacute.com
robots.txt

Robots Exclusion Standard data for cubacute.com

Resource Scan

Scan Details

Site Domain cubacute.com
Base Domain cubacute.com
Scan Status Ok
Last Scan2024-11-16T01:41:05+00:00
Next Scan 2024-11-23T01:41:05+00:00

Last Scan

Scanned2024-11-16T01:41:05+00:00
URL https://cubacute.com/robots.txt
Domain IPs 104.21.75.98, 172.67.220.94, 2606:4700:3033::6815:4b62, 2606:4700:3036::ac43:dc5e
Response IP 104.21.75.98
Found Yes
Hash c85f18715bfba090e59240553c01c0c178cd2a65ace84e56ad2e8b3f765b8580
SimHash 95d272c2c4f6

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /tag/
Allow /tag/noticias-de-cuba
Allow /tag/noticias
Allow /tag/coronavirus
Allow /tag/farandula
Allow /tag/diliamne-jouve-gonzalez
Allow /tag/aventuras-cubanas
Allow /tag/cubadetodos
Allow /tag/humor
Allow /tag/diliamne-jouve
Allow /tag/miguel-alvarez-sanchez
Allow /tag/iset-maritza-vazquez-brizuela
Allow /tag/crimen-en-cuba
Allow /tag/telegram
Allow /tag/farandula-cubana

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /wp-content/plugins/link-juice-optimizer/public/js/link-juice-optimizer.js
Back to top

Other Records

Field Value
sitemap https://www.cubacute.com/sitemap-news.xml
Back to top

Comments

  • XML Sitemap & Google News version 5.2.7 - https://status301.net/wordpress-plugins/xml-sitemap-feed/
  • no more tag indexing xD
  • Allows tags
  • Agentes nocivos conocidos
  • No indexar copias de seguridad
  • No indexar linkkuicer
Back to top