shafa.ua
robots.txt
Robots Exclusion Standard data for shafa.ua
Resource Scan
Scan Details
| Site Domain | shafa.ua |
| Base Domain | shafa.ua |
| Scan Status | Ok |
| Last Scan | 2024-09-24T16:55:30+00:00 |
| Next Scan | 2024-10-01T16:55:30+00:00 |
Last Scan
| Scanned | 2024-09-24T16:55:30+00:00 |
| URL | https://shafa.ua/robots.txt |
| Domain IPs | 104.26.8.82, 104.26.9.82, 172.67.75.13, 2606:4700:20::681a:852, 2606:4700:20::681a:952, 2606:4700:20::ac43:4b0d |
| Response IP | 104.26.9.82 |
| Found | Yes |
| Hash | 4ecac32feb14ce64aeef12e5329549d7ff60191fd57642584b78a1e9f485abc0 |
| SimHash | 4890c1477f15 |
Groups
*
googlebot
| Rule | Path |
|---|---|
| Disallow | */new-arrivals?category=* |
| Allow | /new-arrivals |
| Disallow | */login* |
| Disallow | /pro-account |
| Disallow | /phone-verification |
| Disallow | */items/* |
| Disallow | */util/* |
| Disallow | */member/*/* |
| Disallow | */checkout/* |
| Disallow | /msg/* |
| Disallow | /my/* |
| Disallow | */search_text |
| Allow | /*?page |
| Disallow | *extra%3D* |
| Allow | /*?xmlpgn |
| Disallow | */collections |
| Disallow | /day-discount |
| Disallow | /facebook-constructor/* |
| Disallow | /api/* |
| Disallow | /uk/*gorod-* |
| Disallow | /uk/member/*/ |
| Disallow | /social/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shafa.ua/sitemap.xml |