aquicerrajeros.es
robots.txt

Robots Exclusion Standard data for aquicerrajeros.es

Resource Scan

Scan Details

Site Domain aquicerrajeros.es
Base Domain aquicerrajeros.es
Scan Status Ok
Last Scan2024-09-28T20:27:28+00:00
Next Scan 2024-10-05T20:27:28+00:00

Last Scan

Scanned2024-09-28T20:27:28+00:00
URL https://aquicerrajeros.es/robots.txt
Domain IPs 104.21.76.129, 172.67.195.122, 2606:4700:3033::ac43:c37a, 2606:4700:3034::6815:4c81
Response IP 172.67.195.122
Found Yes
Hash c7b053589fb5bfc2d7d1e2d54213162e8313f9898123f3670cd1fb99c82aef06
SimHash 6b164250c833

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-includes/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/*/*.jpg
Allow /wp-content/*/*.png
Allow /wp-content/*/*.gif
Allow /wp-content/plugins/*.css
Allow /wp-content/plugins/*.js
Allow /wp-content/themes/*.css
Allow /wp-content/themes/*.js
Allow /wp-includes/*/*.png
Allow /wp-includes/*/*.js
Disallow /cgi-bin/
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-login/
Disallow /wp-admin/
Disallow /?s=
Disallow /search
Disallow /*/*/*/feed.xml
Disallow /?attachment_id*
Disallow /*/feed/
Disallow /*/trackback/
Disallow /*/attachment/
Disallow /comments/
Disallow /xmlrpc.php
Disallow /aq/
Disallow /aqorbit/

compspybot
curious george
cybeye.com
docomo
exb language crawler
ezooms
flamingo_searchengine
genieo
genio
lwnutch
lexxebot
openwebindex
rediffnewsbot
seoengworldbot
scanmine
shopwiki
showyoubot
sosospider
wocbot
yeti
yeti
youdaobot
daumoa
gsa-crawler
libcrawl
linkdex
magpie-crawler
repparser
rogerbot
sindice-site-manager
sogou spider
sogou
woriobot
yacybot
yolinkbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.aquicerrajeros.es/sitemap_index.xml