wine-butik.ru
robots.txt
Robots Exclusion Standard data for wine-butik.ru
Resource Scan
Scan Details
Site Domain | wine-butik.ru |
Base Domain | wine-butik.ru |
Scan Status | Ok |
Last Scan | 2024-10-31T14:57:43+00:00 |
Next Scan | 2024-11-30T14:57:43+00:00 |
Last Scan
Scanned | 2024-10-31T14:57:43+00:00 |
URL | https://wine-butik.ru/robots.txt |
Domain IPs | 2a00:15f8:a000:5:1:11:8:3c3, 2a00:15f8:a000:5:1:12:8:3c3, 2a00:15f8:a000:5:1:13:8:3c3, 2a00:15f8:a000:5:1:14:8:3c3, 90.156.201.37, 90.156.201.59, 90.156.201.64, 90.156.201.87 |
Response IP | 90.156.201.64 |
Found | Yes |
Hash | 65a19fd0dfc75dd6020ee65571affa838913e4ce75941de449923322581935a2 |
SimHash | cc71cb616651 |
Groups
*
Rule | Path |
---|---|
Disallow | /callback* |
Disallow | /ajax* |
Disallow | /ajax/callback |
Disallow | /admin |
Disallow | */search/* |
Disallow | /*?page=* |
Disallow | /*?order=* |
Disallow | /register/* |
Disallow | /login* |
Disallow | /cart/* |
Disallow | *?vendor=* |
Disallow | *?type=* |
Disallow | *?page=* |
Disallow | *?order=* |
Disallow | *?startrow* |
Disallow | *?sort* |
Disallow | *direction%3D* |
Disallow | /*?utm* |
Disallow | /*?openstat* |
Disallow | /*?gclid* |
Disallow | /*?from* |
Disallow | /*?PHPSESSID* |
Disallow | /*?ref* |
Disallow | /*? |
Disallow | /*searchliqueurs%3D* |
Disallow | *by_*by_* |
Disallow | *from_*from_* |
Allow | /*.png* |
Allow | /*.jpeg* |
Allow | /*.jpg* |
Other Records
Field | Value |
---|---|
sitemap | https://wine-butik.ru/sitemap.xml |
Comments