bicicletasypiruletas.com
robots.txt

Robots Exclusion Standard data for bicicletasypiruletas.com

Resource Scan

Scan Details

Site Domain bicicletasypiruletas.com
Base Domain bicicletasypiruletas.com
Scan Status Ok
Last Scan2025-04-04T23:44:24+00:00
Next Scan 2025-04-11T23:44:24+00:00

Last Scan

Scanned2025-04-04T23:44:24+00:00
URL https://bicicletasypiruletas.com/robots.txt
Domain IPs 51.254.152.94
Response IP 51.254.152.94
Found Yes
Hash 6cf973da3fcf6b68fed7b6050fb4f08cab409aa3c0bb056c892b5bd036110437
SimHash 758e18559e56

Groups

agent gpt

Rule Path
Disallow /

agentgpt

Rule Path
Disallow /

aibot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

aisearchbot

Rule Path
Disallow /

alexatm

Rule Path
Disallow /

alpha ai

Rule Path
Disallow /

alphaai

Rule Path
Disallow /

amazon bedrock

Rule Path
Disallow /

amazon lex

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amelia

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

anypicker

Rule Path
Disallow /

applebot

Rule Path
Disallow /

autogpt

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

awariosmartbot

Rule Path
Disallow /

brave leo ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

catboost

Rule Path
Disallow /

cc-crawler

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt

Rule Path
Disallow /

chinchilla

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

cohere-training-data-crawler

Rule Path
Disallow /

common crawl

Rule Path
Disallow /

commoncrawl

Rule Path
Disallow /

crawlspace

Rule Path
Disallow /

crew ai

Rule Path
Disallow /

crewai

Rule Path
Disallow /

dall-e

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

deepmind

Rule Path
Disallow /

deepseek

Rule Path
Disallow /

depolarizinggpt

Rule Path
Disallow /

dialogpt

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

firecrawl

Rule Path
Disallow /

flyriver

Rule Path
Disallow /

friendlycrawler

Rule Path
Disallow /

gemini

Rule Path
Disallow /

gemma

Rule Path
Disallow /

genai

Rule Path
Disallow /

google bard ai

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

googleother

Rule Path
Disallow /

gpt-2

Rule Path
Disallow /

gpt-3

Rule Path
Disallow /

gpt-4

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

gptzero

Rule Path
Disallow /

grok

Rule Path
Disallow /

hugging face

Rule Path
Disallow /

iaskspider

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

img2dataset

Rule Path
Disallow /

intelliseek.ai

Rule Path
Disallow /

isscyberriskcrawler

Rule Path
Disallow /

kangaroo

Rule Path
Disallow /

leftwinggpt

Rule Path
Disallow /

llama

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

meta ai

Rule Path
Disallow /

meta llama

Rule Path
Disallow /

meta.ai

Rule Path
Disallow /

meta-ai

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

meta-externalfetcher

Rule Path
Disallow /

metaai

Rule Path
Disallow /

mistral

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

oai searchbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

open ai

Rule Path
Disallow /

openai

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

rightwinggpt

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

searchgpt

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sidetrade

Rule Path
Disallow /

stability

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

webchatgpt

Rule Path
Disallow /

webzio

Rule Path
Disallow /

whisper

Rule Path
Disallow /

x.ai

Rule Path
Disallow /

xai

Rule Path
Disallow /

youbot

Rule Path
Disallow /

zero gtp

Rule Path
Disallow /

*

Rule Path
Allow /wp-admin/admin-ajax.php
Disallow */comment-page-
Disallow */trackback/
Disallow */wp-*.php
Disallow */xmlrpc.php
Disallow *?comments=
Disallow *?orderby=date
Disallow *?orderby=popularity
Disallow *?orderby=price
Disallow *?orderby=price-desc
Disallow *?orderby=rating
Disallow *?replytocom
Disallow *?replytocom
Disallow *?wptheme=
Disallow /*/attachment/
Disallow /*/feed/
Disallow /?s=
Disallow /wp-admin/
Disallow /wp-content/languages
Disallow /wp-content/mu-plugins
Disallow /wp-content/plugins/asesor-cookies-para-la-ley-en-espana
Disallow /wp-content/plugins/broken-link-checker
Disallow /wp-content/plugins/category-collapser-for-woocommerce-seo
Disallow /wp-content/plugins/contact-form-7
Disallow /wp-content/plugins/contact-form-submissions
Disallow /wp-content/plugins/dnui_pro
Disallow /wp-content/plugins/limit-login-attempts
Disallow /wp-content/plugins/nofollow
Disallow /wp-content/plugins/seo-ultimate
Disallow /wp-content/plugins/tablepress
Disallow /wp-content/plugins/woo-button-text
Disallow /wp-content/plugins/woocommerce-brands
Disallow /wp-content/plugins/WooImporter
Disallow /wp-content/plugins/woozone
Disallow /wp-content/plugins/wp-amp
Disallow /wp-content/plugins/wp-google-analytics-events
Disallow /wp-content/plugins/wp-rocket
Disallow /wp-content/plugins/wp-sitem
Disallow /wp-content/themes/
Disallow /wp-includes/
Disallow /wp-json/
Disallow /blog/page/
Disallow /page/
Disallow /tienda/page/
Disallow /albuferabici/
Disallow /ama/
Disallow /bahia-arcachon/
Disallow /baixebre/
Disallow /fu/
Disallow /murcia/
Disallow /carrilet1/
Disallow /carrilet2/
Disallow /costa-mediterraneo-francia/
Disallow /deltabici/
Disallow /deltaebro/
Disallow /eliana/
Disallow /estreno/
Disallow /flyingpigeon/
Disallow /formentera-low-cost/
Disallow /irta/
Disallow /ligero/
Disallow /malvarrosa/
Disallow /mijares/
Disallow /marjal/
Disallow /ojosnegros/
Disallow /ojosnegros2/
Disallow /ojosnegros3/
Disallow /pinar/
Disallow /prat/
Disallow /saler/
Disallow /santosab/
Disallow /serpis/
Disallow /serrairta/
Disallow /tarragona/
Disallow /terraalta/
Disallow /turia/
Disallow /valencia/
Disallow /viaxurra/
Disallow /binding/
Disallow /tag/video/page/4/
Disallow /tag/video/page/3/
Disallow /tag/video/page/2/
Disallow /tag/valencia/page/2/
Disallow /tag/lo-mas-leido/page/2/
Disallow /tag/infantil/page/2/
Disallow /tag/francia/page/2/
Disallow /tag/eurovelo/page/2/
Disallow /tag/equipo/page/3/
Disallow /tag/equipo/page/4/
Disallow /tag/equipo/page/2/
Disallow /tag/cosas-divertidas/page/2/
Disallow /tag/cosas-divertidas/page/3/
Disallow /tag/cicloturismo/page/2/
Disallow /tag/cicloturismo/page/3/
Disallow /tag/cicloturismo/page/4/
Disallow /tag/ciclismo-urbano/page/3/
Disallow /tag/ciclismo-urbano/page/2/
Disallow /tag/castellon/page/2/
Disallow /tag/castellon/page/3/

Other Records

Field Value
sitemap https://bicicletasypiruletas.com/post-sitemap.xml
sitemap https://bicicletasypiruletas.com/page-sitemap.xml
sitemap https://bicicletasypiruletas.com/category-sitemap.xml
sitemap https://bicicletasypiruletas.com/post_tag-sitemap.xml
sitemap https://bicicletasypiruletas.com/video-sitemap.xml

Comments

  • Bloquear bots de todas las IAs
  • https://perishablepress.com/ultimate-ai-block-list/