en.todocoleccion.net
robots.txt

Robots Exclusion Standard data for en.todocoleccion.net

Resource Scan

Scan Details

Site Domain en.todocoleccion.net
Base Domain todocoleccion.net
Scan Status Ok
Last Scan2024-11-14T08:57:55+00:00
Next Scan 2024-11-28T08:57:55+00:00

Last Scan

Scanned2024-11-14T08:57:55+00:00
URL https://en.todocoleccion.net/robots.txt
Domain IPs 104.20.2.51, 104.20.3.51, 2606:4700:10::6814:233, 2606:4700:10::6814:333
Response IP 104.20.2.51
Found Yes
Hash 08f11b27075c4dfc16f259cf1e9ff800ba49567e09d55173bef567d5df9b50e3
SimHash fe079b730991

Groups

*

Rule Path
Allow /
Disallow /lote/ajax/
Disallow /carrito_de_compra
Disallow /info/hora
Disallow /api/sistema/track
Disallow /lotes/similares_tienda
Disallow /*_vendedorTC
Disallow /buscador*
Disallow /recommender*
Disallow /pricing-guide/
Disallow /api/pujas/
Disallow /tiendas/
Disallow /colecciona-recuerdos/
Disallow /indices/
Disallow /s/*?*
Disallow *?op=*
Disallow *?sec=*
Disallow *%26sec%3D*
Disallow /b/
Disallow */lotes/envia_amigo*
Disallow */historial_pujas
Disallow */acceder/*
Disallow *_vendedortc/*
Disallow */tiendas/mensaje*
Disallow /usuario/valoraciones/
Disallow /usuario/lotes/
Disallow /usuario/seguimientos/
Disallow /usuario/favoritos/
Disallow /lote.cfm?*
Disallow /lotes/show?*
Disallow /mitc
Disallow /app/buscador?
Disallow /videos/
Allow /s/*?P*

mediapartners-google

Rule Path
Allow /

trovitbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

microsoft url control - 6.01.9782

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://en.todocoleccion.net/sitemap_en.xml
sitemap https://en.todocoleccion.net/sitemap-auctions.xml