wpfpowerlifting.ru
robots.txt
Robots Exclusion Standard data for wpfpowerlifting.ru
Resource Scan
Scan Details
| Site Domain | wpfpowerlifting.ru |
| Base Domain | wpfpowerlifting.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-08T09:01:11+00:00 |
| Next Scan | 2024-11-07T09:01:11+00:00 |
Last Scan
| Scanned | 2024-10-08T09:01:11+00:00 |
| URL | https://wpfpowerlifting.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:3:8c32, 2a00:15f8:a000:5:1:12:3:8c32, 2a00:15f8:a000:5:1:13:3:8c32, 2a00:15f8:a000:5:1:14:3:8c32, 90.156.201.103, 90.156.201.46, 90.156.201.56, 90.156.201.83 |
| Response IP | 90.156.201.46 |
| Found | Yes |
| Hash | 1abf1cd5907d580d2d3d145db6440dd4be66353e52c3f0022a38b3cbf5bf8816 |
| SimHash | 2c27d8f168bf |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /*gclid%3D |
| Disallow | /*utm_source%3D |
| Disallow | /*ym_playback%3D |
| Disallow | /ajax/ |
| Disallow | /cache/ |
| Disallow | /css/ |
| Disallow | /gooru/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /lib/ |
| Disallow | /custom/ |
| Disallow | /download/ |
| Disallow | /*?catalog_q= |
| Disallow | /*?view= |
| Disallow | /*?show= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
yandex
| Rule | Path |
|---|---|
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /*gclid%3D |
| Disallow | /*utm_source%3D |
| Disallow | /*ym_playback%3D |
| Disallow | /ajax/ |
| Disallow | /cache/ |
| Disallow | /css/ |
| Disallow | /gooru/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /lib/ |
| Disallow | /custom/ |
| Disallow | /download/ |
| Disallow | /*?catalog_q= |
| Disallow | /*?view= |
| Disallow | /*?show= |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /*gclid%3D |
| Disallow | /*utm_source%3D |
| Disallow | /*ym_playback%3D |
| Disallow | /ajax/ |
| Disallow | /cache/ |
| Disallow | /css/ |
| Disallow | /gooru/ |
| Disallow | /templates/ |
| Disallow | /tmp/ |
| Disallow | /lib/ |
| Disallow | /custom/ |
| Disallow | /download/ |
| Disallow | /*?catalog_q= |
| Disallow | /*?view= |
| Disallow | /*?show= |
| Allow | /css/*.css |
| Allow | /custom/*.css |
| Allow | /custom/*.js |
| Allow | /custom/images/* |
| Allow | /gooru/*.js |
| Allow | /ajax/*.js* |
| Allow | /gooru/*.png |
| Allow | /gooru/*.woff |
| Allow | /gooru/*.ttf |
| Allow | /gooru/*.svg |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://wpfpowerlifting.ru/sitemap.xml |