autoscaut.it
robots.txt

Robots Exclusion Standard data for autoscaut.it

Resource Scan

Scan Details

Site Domain autoscaut.it
Base Domain autoscaut.it
Scan Status Ok
Last Scan2024-05-21T07:59:03+00:00
Next Scan 2024-06-20T07:59:03+00:00

Last Scan

Scanned2024-05-21T07:59:03+00:00
URL http://autoscaut.it/robots.txt
Redirect https://www.autoscout24.it/robots.txt
Redirect Domain www.autoscout24.it
Redirect Base autoscout24.it
Domain IPs 91.121.154.229
Redirect IPs 18.154.206.119, 18.154.206.20, 18.154.206.21, 18.154.206.76
Response IP 108.157.60.45
Found Yes
Hash e8bd8ad17f25804cf4f9a06968ed766a7d536aa00856751adf9fefe923adf19d
SimHash c18747e161d1

Groups

proximic

Rule Path
Disallow

mediapartners-google

Rule Path
Allow /

applebot

Rule Path
Allow /auto/

*

Rule Path
Disallow /dealerarea/
Disallow /entry/
Disallow /financeslice-detail/slice
Disallow /favorites
Disallow /classified-detail/recommendations
Disallow /seals/classified-detail
Disallow /frontend-metrics
Disallow /seals/classified-list-item
Disallow /classified-list/react-listelements
Disallow /ret-feedback
Disallow /classified-detail/navigation/
Disallow /lst?
Disallow /lst/?
Disallow /lst-moto?
Disallow /lst-moto/?
Disallow /as24-search-funnel/direct-finance-api-query
Disallow */util/*
Disallow */utils/*
Disallow /as24-search-funnel/details/
Disallow /haendler/
Disallow /nl/verkopers/
Disallow /fr/professional/
Disallow /autobedrijven/
Disallow /garages/
Disallow /profesionales/
Disallow /dealerinfo/
Disallow /professional/
Disallow /annunci/-
Disallow /ricerca-avanzata
Disallow /account
Disallow /auto-verkaufen/
Disallow /auto-verkopen/
Disallow /vendre-voiture/
Disallow /cockpit/
Disallow /listing-creation-entry-point
Disallow /dealer-rating/
Disallow /seal-popups/
Disallow /dealer-detail/
Disallow /listing-form/
Disallow /concessionari/*/informazioni
Disallow /partner-experience/
Disallow /dealer-statistics
Disallow /as24-search-funnel/api/vip-showroom/

Comments

  • MH, 29.04.2024