motor.es
robots.txt
Robots Exclusion Standard data for motor.es
Resource Scan
Scan Details
Site Domain | motor.es |
Base Domain | motor.es |
Scan Status | Ok |
Last Scan | 2024-06-28T12:37:13+00:00 |
Next Scan | 2024-07-05T12:37:13+00:00 |
Last Scan
Scanned | 2024-06-28T12:37:13+00:00 |
URL | https://motor.es/robots.txt |
Redirect | https://www.motor.es/robots.txt |
Redirect Domain | www.motor.es |
Redirect Base | motor.es |
Domain IPs | 104.19.164.59, 104.19.165.59, 2606:4700::6813:a43b, 2606:4700::6813:a53b |
Redirect IPs | 104.19.164.59, 104.19.165.59, 2606:4700::6813:a43b, 2606:4700::6813:a53b |
Response IP | 104.19.165.59 |
Found | Yes |
Hash | 0065db0680ff077b9777a3e7bc663bb8129d54344a367bc8730b4b9e72291170 |
SimHash | e109fc066b43 |
Groups
*
Rule | Path |
---|---|
Disallow | /vercoche/* |
Disallow | /ni/* |
Disallow | /alertas/* |
Disallow | /noticias/get-navegacion-noticias |
Disallow | /*/set-navegacion-session/ |
Disallow | /vercoche/getNavegacionFicha |
Disallow | /vercoche/checkFavorito |
Disallow | /formula-1/get-*-directo |
Disallow | /home/getModelosVN |
Disallow | /home/getAcabadosVN |
Disallow | /*/get-populares |
Disallow | /procesos* |
Disallow | /cdn-cgi/rum* |
Disallow | /api/* |
Disallow | /acceso-usuarios/guest* |
Disallow | /acceso-usuarios/ajax* |
Disallow | /renting/get_ofertas_populares* |
Allow | /.well-known/amphtml/apikey.pub |
Allow | /ni/fce_disqus_amp* |
Allow | /ni/formulario_solicitar_oferta* |
Allow | /ficha/calculate_finance_data* |
Allow | /ni/noticias* |
Allow | /ni/politica* |
Other Records
Field | Value |
---|---|
sitemap | https://www.motor.es/fichas-tecnicas/sitemap.xml |
sitemap | https://www.motor.es/noticias/sitemap.xml |
sitemap | https://www.motor.es/feed/ |
sitemap | https://www.motor.es/xml/sitemap_vo.xml |
sitemap | https://www.motor.es/sitemaps/noticias_completo.xml |
sitemap | https://www.motor.es/xml/sitemap_diccionario.xml |
Comments