mymarket.ge
robots.txt
Robots Exclusion Standard data for mymarket.ge
Resource Scan
Scan Details
Site Domain | mymarket.ge |
Base Domain | mymarket.ge |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-09-13T15:20:19+00:00 |
Next Scan | 2024-12-12T15:20:19+00:00 |
Last Successful Scan
Scanned | 2022-09-27T17:10:50+00:00 |
URL | https://mymarket.ge/robots.txt |
Redirect | https://www.mymarket.ge/robots.txt |
Redirect Domain | www.mymarket.ge |
Redirect Base | mymarket.ge |
Response IP | 80.241.246.72 |
Found | Yes |
Hash | 2a344c8234ce17b65e2bf70eb3714e277a8d0d704a4408e40be7b2f0a953e4fa |
SimHash | aa3ad96243d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /cache/ |
Disallow | /controllers/ |
Disallow | /core/ |
Disallow | /crons/ |
Disallow | /helpers/ |
Disallow | /langs/ |
Disallow | /libs/ |
Disallow | /models/ |
Disallow | /tmp/ |
Disallow | /templates/cache/ |