Log In Sign Up

pccomponentes.fr
robots.txt

Robots Exclusion Standard data for pccomponentes.fr

Resource Scan

Scan Details

Site Domain pccomponentes.fr
Base Domain pccomponentes.fr
Scan Status Ok
Last Scan2024-11-09T09:23:17+00:00
Next Scan 2024-11-16T09:23:17+00:00

Last Scan

Scanned2024-11-09T09:23:17+00:00
URL https://pccomponentes.fr/robots.txt
Redirect https://www.pccomponentes.fr/robots.txt
Redirect Domain www.pccomponentes.fr
Redirect Base pccomponentes.fr
Domain IPs 104.18.42.39, 172.64.145.217, 2606:4700:4400::6812:2a27, 2606:4700:4400::ac40:91d9
Redirect IPs 104.18.42.39, 172.64.145.217, 2606:4700:4400::6812:2a27, 2606:4700:4400::ac40:91d9
Response IP 104.18.42.39
Found Yes
Hash bfcdc2ef4746012461f9fdba753ab6284e0aadd8dc157b01137ab80efe32f1bb
SimHash 2262a9b09cb2

Groups

*

Rule Path
Disallow /usuarios/*
Disallow /core/*
Disallow /cart/*
Disallow /lista-de-deseos/*
Disallow /members.php*
Disallow /*?price_*
Disallow /*/*/*/*
Disallow /*?idArticle=*
Disallow /*?valoration=*
Disallow /search/?query=*
Disallow /reserche/?query=*
Disallow /*/madrid
Disallow /*/murcia
Disallow /*/stock
Disallow /*/nuevo
Disallow */*?acc=av
Disallow /ofertas/*
Disallow /*?offer=*
Disallow /*?filters=*
Disallow /*?seller=pccomponentes
Disallow /a/*/historicprices
Disallow /a/recommendations*
Disallow /ajax_nc/*
Disallow /ajax/configurador/articulos*
Disallow /bundles/*
Allow /bundles/fosjsrouting/*
Disallow /ads.txt
Disallow /js/pccpop.js
Disallow /config-*
Disallow /carrito.php*
Disallow /formulario_avisame.php*
Disallow /*?view=*
Disallow /imprimir.php*
Disallow /*?tag=*
Disallow /*?page=0
Disallow /*?page=1$
Disallow /0
Disallow /cms-preview/*
Disallow /*reacondicionado$
Disallow /*/reacondicionado$
Disallow /*reacondicionado*
Disallow /*reaconditionne$
Disallow /*/reaconditionne$
Disallow /*reaconditionne*
Disallow /*reaconditionn%C3%83%C2%A9$
Disallow /*/reaconditionn%C3%83%C2%A9$
Disallow /*reaconditionn%C3%83%C2%A9*
Disallow /*refurbished*
Disallow /*-recertified$
Disallow /informes/*
Disallow /docs/*
Disallow /promocion-tintas-cartuchos-hp*
Disallow /pbf2017
Disallow /cbm2017
Disallow /seleccion*
Allow /seleccion-especial-equipos-con-procesador-intel
Allow /seleccion-especial-portatiles-nvidia-studio
Allow /seleccion-educacion
Disallow /boletines/*
Disallow /rec-elec
Disallow /*?__cn_tracker*

baiduspider

Rule Path
Disallow /

yahoo! slurp china

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

archive.org_bot
semrushbot
yandeximages

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

noxtrumbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

ahrefsbot

No rules defined. All paths allowed.

msiecrawler

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

url_spider_pro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

copyrightcheck

Rule Path
Disallow /

alexibot

Rule Path
Disallow /

web image collector

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

xenu's

Rule Path
Disallow /

zeus

Rule Path
Disallow /

zeus link scout

Rule Path
Disallow /

erocrawler

Rule Path
Disallow /

linkscan/8.1a unix

Rule Path
Disallow /

keyword density/0.9

Rule Path
Disallow /

webcopier v3.2a

Rule Path
Disallow /

webcapture 2.0

Rule Path
Disallow /

webcopier v.2.2

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

black hole

Rule Path
Disallow /

xenu\\\'s link sleuth 1.1c

Rule Path
Disallow /

xenu\\\'s

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.pccomponentes.fr/sitemap/sitemap_categories.xml
sitemap https://www.pccomponentes.fr/sitemap/blog.xml
Back to top

Comments

  • Bienvenue sur PcComponentes.fr Robots.txt :)
  • _____ _ _ _ _ _ _
  • / ____| | | (_) | | | | | | | |
  • | | ___ _ __ ___| |_ _ __ _ _ _ _ __ ___ __ _ _ _ ___| | __ _ _ _ ___ ___| |__ ___ ___ ___ __| | ___ __ _ _ __ __ _ _ __ __| |
  • | | / _ \| '_ \/ __| __| '__| | | | | '__/ _ \ / _` | | | |/ _ \ |/ _` | | | |/ _ \ / __| '_ \ / _ \/ __|/ _ \ / _` |/ _ \ / _` | '__/ _` | '_ \ / _` |
  • | |___| (_) | | | \__ \ |_| | | |_| | | | | __/ | (_| | |_| | __/ | (_| | |_| | __/ | (__| | | | (_) \__ \ __/ | (_| | __/ | (_| | | | (_| | | | | (_| |_
  • \_____\___/|_| |_|___/\__|_| \__,_|_|_| \___| \__, |\__,_|\___|_|\__, |\__,_|\___| \___|_| |_|\___/|___/\___| \__,_|\___| \__, |_| \__,_|_| |_|\__,_(_)
  • | | | | __/ |
  • |_| |_| |___/
  • GENERAL SETTINGS
  • SITEMAPS
  • SITEMAP INDEX
  • Sitemap: https://www.pccomponentes.fr/sitemap.xml
  • SITEMAP PRODUCTS INDEX
  • Sitemap: https://www.pccomponentes.fr/sitemap/sitemap_articles.xml
  • SITEMAP PRODUCTS BY PARENT
  • Pending...
  • SITEMAP CATEGORIES
  • SITEMAP BLOG
  • PRIVATE URLS
  • CORPORATIVE PAGES
  • STATICS
  • Pending...
  • CRAWL BUDGET OPTIMIZATION
  • 5+ FILTERS
  • VALORATIONS AND REVIEWS
  • QUERIES
  • AVAILABILITY AND UX FEATURES
  • PRICE HISTORY
  • COMPLEMENTS
  • Disallow: /a/complements/*
  • RECOMMENDER
  • TECHNICAL RESOURCES
  • CAMPAIGN TAGGING
  • General
  • Black Friday
  • To be defined...
  • Cyber Monday
  • To be defined...
  • Christmas
  • To be defined...
  • TECHNICAL ISSUES
  • DEV ENVIRONMENTS
  • REFURBISHED PRODUCTS
  • DOCS, PDF AND MEDIA
  • GROUNDWORK
  • TRACKING CODES
  • SPECIFIC BOTS SETTINGS
Back to top

Warnings

  • 1 invalid line.
  • `visit-time` is not a known field.
Back to top