migros.com.tr
robots.txt

Robots Exclusion Standard data for migros.com.tr

Resource Scan

Scan Details

Site Domain migros.com.tr
Base Domain migros.com.tr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-13T22:03:53+00:00
Next Scan 2024-11-12T22:03:53+00:00

Last Successful Scan

Scanned2024-07-16T22:03:04+00:00
URL https://migros.com.tr/robots.txt
Redirect https://www.migros.com.tr:443/robots.txt
Redirect Domain www.migros.com.tr
Redirect Base migros.com.tr
Domain IPs 99.83.255.107
Redirect IPs 104.18.41.117, 172.64.146.139, 2606:4700:4400::6812:2975, 2606:4700:4400::ac40:928b
Response IP 104.18.41.117
Found Yes
Hash bd3a3f67464aab55b545ce5cf6faad1e19a9f1ddac206eb01b26aa86462c627f
SimHash 926ec806c233

Groups

*

Rule Path
Disallow /*espv

mediapartners-google

Rule Path
Disallow /siparis-tamamlandi*$

blexbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

moget

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

naverbot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.migros.com.tr/hermes/api/sitemaps/sitemap.xml