de.todocoleccion.net
robots.txt

Robots Exclusion Standard data for de.todocoleccion.net

Resource Scan

Scan Details

Site Domain de.todocoleccion.net
Base Domain todocoleccion.net
Scan Status Ok
Last Scan2024-11-02T04:40:26+00:00
Next Scan 2024-11-16T04:40:26+00:00

Last Scan

Scanned2024-11-02T04:40:26+00:00
URL https://de.todocoleccion.net/robots.txt
Domain IPs 104.20.2.51, 104.20.3.51, 2606:4700:10::6814:233, 2606:4700:10::6814:333
Response IP 104.20.3.51
Found Yes
Hash 99a9928f342496a8853f23ee91db71e33a521dbdd429b29e41e3f1e00dd94b1c
SimHash fc079f334981

Groups

*

Rule Path
Allow /
Disallow /lote/ajax/
Disallow /carrito_de_compra
Disallow /info/hora
Disallow /api/sistema/track
Disallow /lotes/similares_tienda
Disallow /*_vendedorTC
Disallow /buscador*
Disallow /recommender*
Disallow /preisleitfaden/
Disallow /api/pujas/
Disallow /tiendas/
Disallow /colecciona-recuerdos/
Disallow /indices/
Disallow /s/*?*
Disallow *?op=*
Disallow *?sec=*
Disallow *%26sec%3D*
Disallow /b/
Disallow */lotes/envia_amigo*
Disallow */historial_pujas
Disallow */acceder/*
Disallow *_vendedortc/*
Disallow */tiendas/mensaje*
Disallow /usuario/valoraciones/
Disallow /usuario/lotes/
Disallow /usuario/seguimientos/
Disallow /usuario/favoritos/
Disallow /lote.cfm?*
Disallow /lotes/show?*
Disallow /mitc
Disallow /app/buscador?
Disallow /videos/
Allow /s/*?P*

mediapartners-google

Rule Path
Allow /

trovitbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

microsoft url control

Rule Path
Disallow /

microsoft url control - 6.01.9782

Rule Path
Disallow /

twengabot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

nutch

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://de.todocoleccion.net/sitemap_de.xml
sitemap https://de.todocoleccion.net/sitemap-auktionen.xml