tenth.es
robots.txt

Robots Exclusion Standard data for tenth.es

Resource Scan

Scan Details

Site Domain tenth.es
Base Domain tenth.es
Scan Status Ok
Last Scan2025-10-16T16:54:33+00:00
Next Scan 2025-10-30T16:54:33+00:00

Last Scan

Scanned2025-10-16T16:54:33+00:00
URL https://tenth.es/robots.txt
Domain IPs 104.26.12.91, 104.26.13.91, 172.67.68.181, 2606:4700:20::681a:c5b, 2606:4700:20::681a:d5b, 2606:4700:20::ac43:44b5
Response IP 172.67.68.181
Found Yes
Hash 637b7339142fcec000683083a06c5727843a17b33ac5b3580a4187eda0ed5b7c
SimHash 6151d24a8630

Groups

*

Rule Path
Disallow /app/
Disallow /bin/
Disallow /dev/
Disallow /lib/
Disallow /phpserver/
Disallow /pkginfo/
Disallow /report/
Disallow /setup/
Disallow /update/
Disallow /var/
Disallow /vendor/
Disallow /index.php/
Disallow */catalogsearch/
Disallow */checkout/
Disallow */control/
Disallow */contacts/
Disallow */customer/
Disallow */customize/
Disallow */newsletter/
Disallow */review/
Disallow */sendfriend/
Disallow */wishlist/
Disallow */account/
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /RELEASE_NOTES.txt
Disallow /*?*product_list_mode=
Disallow /*?*product_list_order=
Disallow /*?*product_list_limit=
Disallow /*?*product_list_dir=
Disallow /*?*q=
Disallow /*?SID=
Disallow /*.php$
Disallow /*.CVS
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Disallow /blog/wp-admin/
Disallow */search-result
Disallow /feed/
Allow /feed/$
Disallow /comments/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow ///trackback/$
Disallow ///*/feed/$
Disallow ///*/feed/rss/$
Disallow ///*/trackback/$
Disallow */_redux
Allow /wp-content/*.js
Allow /wp-content/*.css
Allow /wp-includes/*.js
Allow /wp-includes/*.css
Disallow /wp-content/plugins/
Disallow /wp-content/themes/
Disallow /wp-includes/

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

bingbot-image

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

slurp

Rule Path
Allow /

gptbot

Rule Path
Allow /

chatgpt-user

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

claudebot

Rule Path
Allow /

anthropic-ai

Rule Path
Allow /

amazonbot

Rule Path
Allow /

bytespider

Rule Path
Allow /

facebookexternalhit

Rule Path
Allow /

facebookbot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

applebot

Rule Path
Allow /

perplexitybot

Rule Path
Allow /

perplexity-user

Rule Path
Allow /

googlebot

Rule Path
Allow /

bravebot

Rule Path
Allow /

komobot

Rule Path
Allow /

consensusbot

Rule Path
Allow /

*

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.tenth.es/sitemap_tenth.xml
sitemap https://www.tenth.es/sitemap_tenth_en.xml
sitemap https://www.tenth.es/sitemap_image_tenth.xml
sitemap https://www.tenth.es/sitemap_image_tenth_en.xml

Comments

  • Directories
  • Paths (clean URLs)
  • Files
  • Do not index pages that are sorted or filtered.
  • Do not index search results
  • Do not index session ID
  • CVS, SVN directory and dump files
  • Wordpress
  • Tenth
  • Tenth EN
  • Tenth Image
  • Tenth Image EN
  • Permitir Google
  • Permitir Bing
  • Permitir DuckDuckGo
  • Permitir Yahoo
  • Permitir ChatGPT / OpenAI
  • Permitir Perplexity
  • Permitir Anthropic / Claude
  • Permitir Amazonbot
  • Permitir Bytespider
  • Permitir Facebook / previews sociales
  • Permitir Twitter previews
  • Permitir Applebot
  • Permitir Perplexity
  • Permitir Gemini (Google)
  • Permitir Brave (navegador con IA integrada)
  • Permitir Komo (motor de búsqueda con IA)
  • Permitir Consensus (motor de búsqueda académico con IA)
  • Bloquear todos los demás (por defecto)