aita-menni.org
robots.txt

Robots Exclusion Standard data for aita-menni.org

Resource Scan

Scan Details

Site Domain aita-menni.org
Base Domain aita-menni.org
Scan Status Ok
Last Scan4/7/2025, 9:58:39 AM
Next Scan 5/7/2025, 9:58:39 AM

Last Scan

Scanned4/7/2025, 9:58:39 AM
URL https://aita-menni.org/robots.txt
Redirect https://ospitalarioakfundazioaeuskadi.org/robots.txt
Redirect Domain ospitalarioakfundazioaeuskadi.org
Redirect Base ospitalarioakfundazioaeuskadi.org
Domain IPs 104.21.27.40, 172.67.168.226, 2606:4700:3031::6815:1b28, 2606:4700:3035::ac43:a8e2
Redirect IPs 104.21.55.24, 172.67.144.34, 2606:4700:3032::6815:3718, 2606:4700:3036::ac43:9022
Response IP 172.67.144.34
Found Yes
Hash a526c0d4f3e36a6f48f729c19a792b5a89aef145e47963ebdad7b4fcf4c61a33
SimHash 6048669056ff

Groups

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow /wp-admin/
Disallow /trackback/
Disallow /?s=
Disallow /search
Disallow /archives/
Disallow /index.php
Disallow /*?
Disallow /*.php$
Disallow /*.inc$
Disallow */trackback/
Disallow /page/
Disallow /tag/
Disallow /category/
Disallow /*.git$
Disallow /*.sql$
Disallow /*.tgz$
Disallow /*.gz$
Disallow /*.tar$
Disallow /*.svn$
Disallow /*.bz2$
Disallow /*.log$

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

libwww

Rule Path
Disallow /

Comments

  • No rastrear copias de seguridad
  • Reglas para bots conocidos