fr.todocoleccion.net
robots.txt

Robots Exclusion Standard data for fr.todocoleccion.net

Resource Scan

Scan Details

Site Domain fr.todocoleccion.net
Base Domain todocoleccion.net
Scan Status Ok
Last Scan2024-09-27T06:30:35+00:00
Next Scan 2024-10-11T06:30:35+00:00

Last Scan

Scanned2024-09-27T06:30:35+00:00
URL https://fr.todocoleccion.net/robots.txt
Domain IPs 104.20.2.51, 104.20.3.51, 2606:4700:10::6814:233, 2606:4700:10::6814:333
Response IP 104.20.3.51
Found Yes
Hash 6bde74a1452481f3754df432779bfcc9a11074ae5dc316872359da9c263bd9a9
SimHash f70f97b34991

Groups

*

Rule Path
Allow /
Disallow /lote/ajax/
Disallow /carrito_de_compra
Disallow /info/hora
Disallow /api/sistema/track
Disallow /lotes/similares_tienda
Disallow /*_vendedorTC
Disallow /buscador*
Disallow /recommender*
Disallow /guide-de-prix/
Disallow /api/pujas/
Disallow /tiendas/
Disallow /colecciona-recuerdos/
Disallow /indices/
Disallow /s/*?*
Disallow *?op=*
Disallow *?sec=*
Disallow *%26sec%3D*
Disallow /b/
Disallow */lotes/envia_amigo*
Disallow */historial_pujas
Disallow */acceder/*
Disallow *_vendedortc/*
Disallow */tiendas/mensaje*
Disallow /usuario/valoraciones/
Disallow /usuario/lotes/
Disallow /usuario/seguimientos/
Disallow /usuario/favoritos/
Disallow /lote.cfm?*
Disallow /lotes/show?*
Disallow /mitc
Disallow /app/buscador?
Disallow /videos/
Allow /s/*?P*

mediapartners-google

Rule Path
Allow /

trovitbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

microsoft url control - 6.01.9782

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://fr.todocoleccion.net/sitemap_fr.xml
sitemap https://fr.todocoleccion.net/sitemap-ventes-aux-encheres.xml