autoscout24.cz
robots.txt

Robots Exclusion Standard data for autoscout24.cz

Resource Scan

Scan Details

Site Domain autoscout24.cz
Base Domain autoscout24.cz
Scan Status Ok
Last Scan2024-06-30T07:27:02+00:00
Next Scan 2024-07-07T07:27:02+00:00

Last Scan

Scanned2024-06-30T07:27:02+00:00
URL https://autoscout24.cz/robots.txt
Redirect https://www.autoscout24.cz/robots.txt
Redirect Domain www.autoscout24.cz
Redirect Base autoscout24.cz
Domain IPs 65.9.112.3, 65.9.112.45, 65.9.112.50, 65.9.112.73
Redirect IPs 52.222.144.124, 52.222.144.73, 52.222.144.91, 52.222.144.92
Response IP 18.165.171.47
Found Yes
Hash 8dd9e52b26bbadc9a65f5104426a195c1f9b197f7a6334c73b56121461f78f02
SimHash e88757e193db

Groups

proximic

Rule Path
Disallow

mediapartners-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adidxbot

Rule Path
Allow /nabidky/

twitterbot

Rule Path
Allow /nabidky/

facebookexternalhit

Rule Path
Allow /nabidky/

pinterestbot

Rule Path
Allow /nabidky/

applebot

Rule Path
Allow /auto/

*

Rule Path
Disallow /dealerarea/
Disallow /financeslice-detail/slice
Disallow /favorites
Disallow /classified-detail/recommendations
Disallow /seals/classified-detail
Disallow /frontend-metrics
Disallow /seals/classified-list-item
Disallow /classified-list/react-listelements
Disallow /ret-feedback
Disallow /classified-detail/navigation/
Disallow /lst?
Disallow /lst/?
Disallow /lst-moto?
Disallow /lst-moto/?
Disallow /as24-search-funnel/direct-finance-api-query
Disallow /haendler/
Disallow /nl/verkopers/
Disallow /fr/professional/
Disallow /autobedrijven/
Disallow /garages/
Disallow /profesionales/
Disallow /dealerinfo/
Disallow /professional/
Disallow /concessionari/
Disallow */util/*
Disallow */utils/*
Disallow /as24-search-funnel/details/
Disallow /nabidky/-
Disallow /podrobnemuhledani
Disallow /as24-search-funnel/api/vip-showroom/

Comments

  • MH, 07.06.2024