dyson-shop-com.ru
robots.txt
Robots Exclusion Standard data for dyson-shop-com.ru
Resource Scan
Scan Details
| Site Domain | dyson-shop-com.ru |
| Base Domain | dyson-shop-com.ru |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-05-02T20:07:15+00:00 |
| Next Scan | 2024-07-01T20:07:15+00:00 |
Last Successful Scan
| Scanned | 2024-02-10T18:34:31+00:00 |
| URL | https://dyson-shop-com.ru/robots.txt |
| Redirect | https://dysonsshop.ru/robots.txt |
| Redirect Domain | dysonsshop.ru |
| Redirect Base | dysonsshop.ru |
| Domain IPs | 104.21.93.189, 172.67.214.3, 2606:4700:3031::6815:5dbd, 2606:4700:3035::ac43:d603 |
| Redirect IPs | 104.21.0.250, 172.67.151.130, 2606:4700:3033::6815:fa, 2606:4700:3034::ac43:9782 |
| Response IP | 104.21.0.250 |
| Found | Yes |
| Hash | df00df2077ee110bcd33f334841ffc4e26bb7ad5508ecb8c4982cbfbe9ad5177 |
| SimHash | 68044c54cf93 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin/ |
| Disallow | /netcat/ |
| Disallow | /netcat_cache/ |
| Disallow | /netcat_dump/ |
| Disallow | /netcat_trash/ |
| Disallow | /cart/ |
| Disallow | /favorites/ |
| Disallow | /*? |
| Allow | /*.css?v= |
| Allow | /*.js?v= |
| Allow | /*?cur_cc=*&curPos=* |
| Allow | /*?cur_cc=* |
| Allow | /sitemap.xml?start=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dysonsshop.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.