madeiradeuz.org
robots.txt

Robots Exclusion Standard data for madeiradeuz.org

Resource Scan

Scan Details

Site Domain madeiradeuz.org
Base Domain madeiradeuz.org
Scan Status Ok
Last Scan2024-10-28T12:17:04+00:00
Next Scan 2024-11-27T12:17:04+00:00

Last Scan

Scanned2024-10-28T12:17:04+00:00
URL https://madeiradeuz.org/robots.txt
Domain IPs 104.21.90.225, 172.67.205.174, 2606:4700:3035::ac43:cdae, 2606:4700:3036::6815:5ae1
Response IP 172.67.205.174
Found Yes
Hash 085218bebef1a04980e52876bccd3b239ac68c4f935ddd56341e6575a7441ff5
SimHash a25b7999cef5

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /_backuz/
Disallow /wiki/
Disallow /exp/

petalbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

libwww

Rule Path
Disallow /

orthogaffe

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

linko

Rule Path
Disallow /

larbin

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

giant oak mn

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

good bot

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

slurp

Rule Path
Disallow /

maxthon

Rule Path
Disallow /

cncdialer

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

Other Records

Field Value
sitemap http://www.madeiradeuz.org/sitemap.xml

Comments

  • Parâmetros gerais
  • Desabilitando bots específicos

Warnings

  • 2 invalid lines.