samurayushka.ru
robots.txt
Robots Exclusion Standard data for samurayushka.ru
Resource Scan
Scan Details
| Site Domain | samurayushka.ru |
| Base Domain | samurayushka.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-10T17:00:26+00:00 |
| Next Scan | 2024-07-10T17:00:26+00:00 |
Last Scan
| Scanned | 2024-06-10T17:00:26+00:00 |
| URL | https://samurayushka.ru/robots.txt |
| Domain IPs | 104.26.6.75, 104.26.7.75, 172.67.72.176, 2606:4700:20::681a:64b, 2606:4700:20::681a:74b, 2606:4700:20::ac43:48b0 |
| Response IP | 104.26.7.75 |
| Found | Yes |
| Hash | 448f81f2605fe7c32224a6fdf5ab9938f0fab44568e7fc947dae15b9098c0847 |
| SimHash | b99da5886ab0 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?* |
| Disallow | /yahoo/auction/ |
| Disallow | /yahoo/lcategory/ |
| Disallow | /carshop/ |
| Disallow | /form_request |
| Disallow | /my/ |
| Disallow | /admin/ |
| Disallow | /auth |
| Disallow | /reconfirm |
| Disallow | /confirm |
| Disallow | /forgot$ |
| Disallow | /join$ |
| Disallow | /sajax/ |
| Disallow | /system/ |
| Allow | *?page= |
| Disallow | *?page=*& |
| Disallow | /amazon/ucategory |
| Disallow | /amazon/product |
| Disallow | /amazon/uproduct |
| Disallow | /yahoo/auctiondesc |
| Disallow | /*display |
| Disallow | /*minprice |
| Disallow | /*maxprice |
| Disallow | /*minbuynow |
| Disallow | /*maxbuynow |
| Disallow | /*store |
| Disallow | /*condition |
| Disallow | /*desc |
| Disallow | /cart |
| Disallow | /fast_registration |
| Disallow | /cookie_files/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://samurayushka.ru/sitemap.xml |