torreoria.es
robots.txt

Robots Exclusion Standard data for torreoria.es

Resource Scan

Scan Details

Site Domain torreoria.es
Base Domain torreoria.es
Scan Status Ok
Last Scan2024-09-30T08:02:09+00:00
Next Scan 2024-10-30T08:02:09+00:00

Last Scan

Scanned2024-09-30T08:02:09+00:00
URL https://torreoria.es/robots.txt
Domain IPs 51.254.53.99
Response IP 51.254.53.99
Found Yes
Hash fbf5db5ce1a55510b62da74138b4b67cb4f1b5c05acceb6cc110c61b48b8dae3
SimHash 6b540218c8f1

Groups

*

Rule Path
Allow /wp-content/*.css
Allow /wp-content/plugins/*.css
Allow /wp-content/plugins/*.js
Allow /wp-content/plugins/*.png
Allow /wp-content/themes/*.css
Allow /wp-content/themes/*.js
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Allow /wp-content/uploads/*/*/*.jpg
Allow /wp-content/uploads/*/*/*.png
Allow /wp-content/uploads/*/*/*.pdf
Allow /wp-content/uploads/*/*/*.gif
Allow /wp-content/uploads/*/*/*.ttf
Allow /wp-content/uploads/*/*.css
Allow /wp-content/uploads/*/*/*.png
Disallow /wp-content/
Disallow /wp-login/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-snapshots/
Disallow /*.php$
Disallow /*/trackback/
Disallow /*/attachment/
Disallow /tag/*/page/
Disallow /tag/*/feed/
Disallow /comments/
Disallow /xmlrpc.php
Disallow /*?s=
Disallow /?p=*
Disallow /?page_id=*
Disallow /?preview_id=*
Disallow /*/*/*/feed.xml
Disallow /?attachment_id*
Disallow /cdn-cgi/*
Disallow /page/x/?s=*
Disallow /ca/wp-admin/*.php$

compspybot

Rule Path
Disallow /

curious george

Rule Path
Disallow /

cybeye.com

Rule Path
Disallow /

docomo

Rule Path
Disallow /

exb language crawler

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

genieo

Rule Path
Disallow /

genio

Rule Path
Disallow /

lwnutch

Rule Path
Disallow /

lexxebot

Rule Path
Disallow /

openwebindex

Rule Path
Disallow /

rediffnewsbot

Rule Path
Disallow /

seoengworldbot

Rule Path
Disallow /

scanmine

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

showyoubot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

wocbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

gsa-crawler

Rule Path
Disallow /

libcrawl

Rule Path
Disallow /

linkdex

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

repparser

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

sindice-site-manager

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

woriobot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yolinkbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://torreoria.com/sitemap_index.xml

Comments

  • Torreoria.com Robots.txt
  • The following Robots are not allowed.