autoscout24.com.tr
robots.txt

Robots Exclusion Standard data for autoscout24.com.tr

Resource Scan

Scan Details

Site Domain autoscout24.com.tr
Base Domain autoscout24.com.tr
Scan Status Ok
Last Scan2024-06-30T07:27:02+00:00
Next Scan 2024-07-07T07:27:02+00:00

Last Scan

Scanned2024-06-30T07:27:02+00:00
URL https://autoscout24.com.tr/robots.txt
Redirect https://www.autoscout24.com.tr/robots.txt
Redirect Domain www.autoscout24.com.tr
Redirect Base autoscout24.com.tr
Domain IPs 52.84.45.105, 52.84.45.108, 52.84.45.51, 52.84.45.95
Redirect IPs 65.9.112.113, 65.9.112.14, 65.9.112.24, 65.9.112.52
Response IP 18.165.171.42
Found Yes
Hash 5f8d9b991ce19987f64341147731d738efe6b64a51468e0b1814e5a5ae82de5f
SimHash c987476997fb

Groups

proximic

Rule Path
Disallow

mediapartners-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adidxbot

Rule Path
Allow /teklifler/

twitterbot

Rule Path
Allow /teklifler/

facebookexternalhit

Rule Path
Allow /teklifler/

pinterestbot

Rule Path
Allow /teklifler/

applebot

Rule Path
Allow /auto/

*

Rule Path
Disallow /dealerarea/
Disallow /financeslice-detail/slice
Disallow /favorites
Disallow /classified-detail/recommendations
Disallow /seals/classified-detail
Disallow /frontend-metrics
Disallow /seals/classified-list-item
Disallow /classified-list/react-listelements
Disallow /ret-feedback
Disallow /classified-detail/navigation/
Disallow /lst?
Disallow /lst/?
Disallow /lst-moto?
Disallow /lst-moto/?
Disallow /as24-search-funnel/direct-finance-api-query
Disallow /haendler/
Disallow /nl/verkopers/
Disallow /fr/professional/
Disallow /autobedrijven/
Disallow /garages/
Disallow /profesionales/
Disallow /dealerinfo/
Disallow /professional/
Disallow /concessionari/
Disallow */util/*
Disallow */utils/*
Disallow /as24-search-funnel/details/
Disallow /teklifler/-
Disallow /genisara
Disallow /as24-search-funnel/api/vip-showroom/

Comments

  • MH, 07.06.2024