autoscout24.fr
robots.txt

Robots Exclusion Standard data for autoscout24.fr

Resource Scan

Scan Details

Site Domain autoscout24.fr
Base Domain autoscout24.fr
Scan Status Ok
Last Scan2024-05-13T12:12:15+00:00
Next Scan 2024-05-20T12:12:15+00:00

Last Scan

Scanned2024-05-13T12:12:15+00:00
URL https://autoscout24.fr/robots.txt
Redirect https://www.autoscout24.fr/robots.txt
Redirect Domain www.autoscout24.fr
Redirect Base autoscout24.fr
Domain IPs 18.65.25.105, 18.65.25.27, 18.65.25.59, 18.65.25.6
Redirect IPs 13.226.210.116, 13.226.210.121, 13.226.210.26, 13.226.210.80
Response IP 18.165.171.62
Found Yes
Hash a05a7629f1c8b7b84104084b011cf9720d6b282cfc50a5ff81a95b2f586c6d76
SimHash e1874ec167d3

Groups

proximic

Rule Path
Disallow

mediapartners-google

Rule Path
Allow /

applebot

Rule Path
Allow /auto/

*

Rule Path
Disallow /dealerarea/
Disallow /entry/
Disallow /financeslice-detail/slice
Disallow /favorites
Disallow /classified-detail/recommendations
Disallow /seals/classified-detail
Disallow /frontend-metrics
Disallow /seals/classified-list-item
Disallow /classified-list/react-listelements
Disallow /ret-feedback
Disallow /classified-detail/navigation/
Disallow */util/*
Disallow */utils/*
Disallow /as24-search-funnel/details/
Allow /garages/*page%3D1
Disallow /offres/-
Disallow /lst?
Disallow /lst/?
Disallow /lst-moto?
Disallow /lst-moto/?
Disallow /as24-search-funnel/direct-finance-api-query
Disallow /classified-detail/navigation/
Disallow /haendler/
Disallow /nl/verkopers/
Disallow /fr/professional/
Disallow /autobedrijven/
Disallow /profesionales/
Disallow /concessionari/
Disallow /dealerinfo/
Disallow /professional/
Disallow /recherche-avancee
Disallow /account
Disallow /auto-verkopen/
Disallow /auto-verkaufen/
Disallow /vendere-auto/
Disallow /cockpit/
Disallow /listing-creation-entry-point
Disallow /dealer-rating/
Disallow /seal-popups/
Disallow /dealer-detail/
Disallow /listing-form/
Disallow /garages/*/informations-legales
Disallow /partner-experience/
Disallow /dealer-statistics
Disallow /as24-search-funnel/api/vip-showroom/

Comments

  • MH, 29.04.2024