pt.todocoleccion.net
robots.txt

Robots Exclusion Standard data for pt.todocoleccion.net

Resource Scan

Scan Details

Site Domain pt.todocoleccion.net
Base Domain todocoleccion.net
Scan Status Ok
Last Scan2024-11-10T14:17:06+00:00
Next Scan 2024-11-24T14:17:06+00:00

Last Scan

Scanned2024-11-10T14:17:06+00:00
URL https://pt.todocoleccion.net/robots.txt
Domain IPs 104.20.2.51, 104.20.3.51, 2606:4700:10::6814:233, 2606:4700:10::6814:333
Response IP 104.20.2.51
Found Yes
Hash 4b2fda0601d410c84c0e3b2ea248237c7b97c89918b3312ac0c7dfd429cd2a17
SimHash fd0597134991

Groups

*

Rule Path
Allow /
Disallow /lote/ajax/
Disallow /carrito_de_compra
Disallow /info/hora
Disallow /api/sistema/track
Disallow /lotes/similares_tienda
Disallow /*_vendedorTC
Disallow /buscador*
Disallow /recommender*
Disallow /guia-de-precos/
Disallow /api/pujas/
Disallow /tiendas/
Disallow /colecciona-recuerdos/
Disallow /indices/
Disallow /s/*?*
Disallow *?op=*
Disallow *?sec=*
Disallow *%26sec%3D*
Disallow /b/
Disallow */lotes/envia_amigo*
Disallow */historial_pujas
Disallow */acceder/*
Disallow *_vendedortc/*
Disallow */tiendas/mensaje*
Disallow /usuario/valoraciones/
Disallow /usuario/lotes/
Disallow /usuario/seguimientos/
Disallow /usuario/favoritos/
Disallow /lote.cfm?*
Disallow /lotes/show?*
Disallow /mitc
Disallow /app/buscador?
Disallow /videos/
Allow /s/*?P*

mediapartners-google

Rule Path
Allow /

trovitbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

microsoft url control - 6.01.9782

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://pt.todocoleccion.net/sitemap_pt.xml
sitemap https://pt.todocoleccion.net/sitemap-leiloes.xml