fatmarket.ru
robots.txt
Robots Exclusion Standard data for fatmarket.ru
Resource Scan
Scan Details
Site Domain | fatmarket.ru |
Base Domain | fatmarket.ru |
Scan Status | Ok |
Last Scan | 2024-06-19T21:13:38+00:00 |
Next Scan | 2024-06-26T21:13:38+00:00 |
Last Scan
Scanned | 2024-06-19T21:13:38+00:00 |
URL | https://fatmarket.ru/robots.txt |
Redirect | https://fatma.ru/robots.txt |
Redirect Domain | fatma.ru |
Redirect Base | fatma.ru |
Domain IPs | 104.21.80.141, 172.67.185.14, 2606:4700:3032::6815:508d, 2606:4700:3033::ac43:b90e |
Redirect IPs | 104.21.32.65, 172.67.184.63, 2606:4700:3032::ac43:b83f, 2606:4700:3036::6815:2041 |
Response IP | 104.21.32.65 |
Found | Yes |
Hash | fd305175b0eee359f5faa150a6adf30438c50bb1f7f5903e95b81a32b3bb7d02 |
SimHash | 09008e62cf70 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /admin |
Disallow | /system |
Disallow | /test |
Disallow | /actions |
Disallow | /reachGoal |
Disallow | /noindex |
Disallow | /responses |
Disallow | /go |
Allow | /system/libs/js |
Allow | /system/libs/jquery |
Allow | /system/libs/fancybox |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.