programasperu.com
robots.txt

Robots Exclusion Standard data for programasperu.com

Resource Scan

Scan Details

Site Domain programasperu.com
Base Domain programasperu.com
Scan Status Ok
Last Scan2025-08-31T14:03:36+00:00
Next Scan 2025-09-07T14:03:36+00:00

Last Scan

Scanned2025-08-31T14:03:36+00:00
URL https://programasperu.com/robots.txt
Domain IPs 199.167.131.11
Response IP 199.167.131.11
Found Yes
Hash 02411f8579e2cbc7f173b6d2945c959561c1db5720b2817c978ac04ac0fce208
SimHash 80d259028673

Groups

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

yandex

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /
Disallow /cgi-admin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /trackback
Allow /wp-content/plugins/*.css*$
Allow /wp-content/plugins/*.js*$
Allow /wp-content/plugins/*.gif*$
Allow /wp-content/plugins/*.png*$
Allow /wp-content/cache/*.css*$
Allow /wp-content/cache/*.js*$
Allow /wp-includes/js/*.js*$
Allow /wp-includes/*.png*$
Allow /wp-admin/admin-ajax.php

Comments

  • Crawlers en otros idiomas
  • General

Warnings

  • `uuser-agent` is not a known field.