mundocofrade.es
robots.txt

Robots Exclusion Standard data for mundocofrade.es

Resource Scan

Scan Details

Site Domain mundocofrade.es
Base Domain mundocofrade.es
Scan Status Ok
Last Scan2024-11-15T21:09:48+00:00
Next Scan 2024-11-22T21:09:48+00:00

Last Scan

Scanned2024-11-15T21:09:48+00:00
URL https://mundocofrade.es/robots.txt
Domain IPs 185.45.72.249
Response IP 185.45.72.249
Found Yes
Hash e49d8833c4abf8583757e58c4ac37919c796f1e394baf115b548d22a0e859e9b
SimHash a05258c2c6ff

Groups

*

Rule Path
Disallow /harming/humans
Disallow /ignoring/human/orders
Disallow /harm/to/self
Disallow /api
Disallow /admin
Disallow /search/
Disallow /ads/
Disallow /comments/
Disallow /thelook/
Allow /ads.txt
Allow /tags/economia
Allow /tags/noticias-interesantes
Allow /tags/andalucia
Allow /tags/jerez

ia_archiver

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Disallow /?s=
Disallow /*.swf$
Disallow /*.tif$
Disallow /*.mp3$
Disallow /*.flv$
Disallow /*.mp4$
Disallow /*.avi$
Disallow /*.ics$
Disallow /*.pdf$
Disallow /*.ppt$
Disallow /*.pptx$
Disallow /*.doc$
Disallow /*.docx$

Comments

  • TEMAS
  • Agentes nocivos conocidos
  • Roilab SEO