petrasport.ru
robots.txt
Robots Exclusion Standard data for petrasport.ru
Resource Scan
Scan Details
Site Domain | petrasport.ru |
Base Domain | petrasport.ru |
Scan Status | Ok |
Last Scan | 2024-05-11T14:16:26+00:00 |
Next Scan | 2024-06-10T14:16:26+00:00 |
Last Scan
Scanned | 2024-05-11T14:16:26+00:00 |
URL | https://petrasport.ru/robots.txt |
Domain IPs | 185.32.58.139 |
Response IP | 185.32.58.139 |
Found | Yes |
Hash | 62541bdac6e2c464dfe351957e351a9b2d159ee7eb623143f0081c955471f32c |
SimHash | 6a08cf42c231 |
Groups
*
Rule | Path |
---|---|
Allow | /*.js |
Allow | /*.css |
Allow | /*.jpg |
Disallow | /*? |
Disallow | */tag/* |
Disallow | /*?p= |
Disallow | /*?p=*& |
Disallow | /my/ |
Disallow | /users/ |
Disallow | /petrasport.ru-internet-magazin-sp/cart/ |
Disallow | /forma-v-shapke/ |
Disallow | /gr-form/ |
Other Records
Field | Value |
---|---|
sitemap | https://petrasport.ru/x/sitemap.xml |
Warnings
- `host` is not a known field.