migros.com.tr
robots.txt
Robots Exclusion Standard data for migros.com.tr
Resource Scan
Scan Details
Site Domain | migros.com.tr |
Base Domain | migros.com.tr |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-13T22:03:53+00:00 |
Next Scan | 2024-11-12T22:03:53+00:00 |
Last Successful Scan
Scanned | 2024-07-16T22:03:04+00:00 |
URL | https://migros.com.tr/robots.txt |
Redirect | https://www.migros.com.tr:443/robots.txt |
Redirect Domain | www.migros.com.tr |
Redirect Base | migros.com.tr |
Domain IPs | 99.83.255.107 |
Redirect IPs | 104.18.41.117, 172.64.146.139, 2606:4700:4400::6812:2975, 2606:4700:4400::ac40:928b |
Response IP | 104.18.41.117 |
Found | Yes |
Hash | bd3a3f67464aab55b545ce5cf6faad1e19a9f1ddac206eb01b26aa86462c627f |
SimHash | 926ec806c233 |
Groups
*
Rule | Path |
---|---|
Disallow | /*espv |
Other Records
Field | Value |
---|---|
sitemap | https://www.migros.com.tr/hermes/api/sitemaps/sitemap.xml |