metro.bg
robots.txt
Robots Exclusion Standard data for metro.bg
Resource Scan
Scan Details
Site Domain | metro.bg |
Base Domain | metro.bg |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-27T04:54:16+00:00 |
Next Scan | 2024-12-26T04:54:16+00:00 |
Last Successful Scan
Scanned | 2022-10-29T22:21:26+00:00 |
URL | https://metro.bg/robots.txt |
Redirect | https://www.metro.bg/robots.txt |
Redirect Domain | www.metro.bg |
Redirect Base | metro.bg |
Response IP | 13.107.246.59, 13.107.213.59 |
Found | Yes |
Hash | c8b630953ffe120b9de2581de2bd4fec767d18fe6b6b8f6d6435a51ab0677d7f |
SimHash | 5909a341cd98 |
Groups
*
Rule | Path |
---|---|
Disallow | /not-found-page |
Disallow | /uslugi/partniorska-programa |
Disallow | /uslugi/partniorska-programa-en |
Disallow | /produkti-i-oferti/oferti/dobre-doshli |
Disallow | /informatsia-i-uslugi/mobilno-prilozhenie/pokana |
Disallow | /informatsia-i-uslugi/uslugi/metro-services/elektroenergia |
Other Records
Field | Value |
---|---|
sitemap | https://www.metro.bg/sitemap.xml |