megapir.com
robots.txt
Robots Exclusion Standard data for megapir.com
Resource Scan
Scan Details
| Site Domain | megapir.com |
| Base Domain | megapir.com |
| Scan Status | Ok |
| Last Scan | 2024-10-17T12:27:04+00:00 |
| Next Scan | 2024-11-16T12:27:04+00:00 |
Last Scan
| Scanned | 2024-10-17T12:27:04+00:00 |
| URL | https://megapir.com/robots.txt |
| Redirect | https://www.megapir.com/robots.txt |
| Redirect Domain | www.megapir.com |
| Redirect Base | megapir.com |
| Domain IPs | 80.93.176.26 |
| Redirect IPs | 80.93.176.26 |
| Response IP | 80.93.176.26 |
| Found | Yes |
| Hash | fcc894c33535d22cb7c04fb1c514d7d1b4a5def44b0a2bc54b7301cd1e878142 |
| SimHash | 0f9409f18a1a |
Groups
*
| Rule | Path |
|---|---|
| Allow | /assets/images |
| Disallow | /download |
| Disallow | /cgi-bin |
| Disallow | /connectors |
| Disallow | /core |
| Disallow | /fancybox |
| Disallow | /fonts |
| Disallow | /import |
| Disallow | /manager |
| Disallow | /jivosite |
| Disallow | /js |
| Disallow | /php |
| Disallow | /s2p_good |
| Disallow | /s2p_tmp |
| Disallow | /tmp |
| Disallow | /webstat |
| Disallow | /assets/components/phpthumbof/cache |
| Disallow | /assets/classes |
| Disallow | /assets/video |
| Disallow | /assets/landing |
| Disallow | /ru/ |
| Disallow | /samara |
| Disallow | */korzina |
| Disallow | */oformlenie-zakaza |
| Disallow | */tex-straniczyi |
| Disallow | /rezultatyi-poiska |
| Disallow | *rezultatyi-poiska?query* |
| Disallow | */registration |
| Disallow | /*cache$ |
| Disallow | /?hauth |
| Disallow | /*.php$ |
| Disallow | *?utm* |
| Disallow | *?imagescaler* |
| Disallow | *bannerclick* |
| Disallow | *?service* |
| Disallow | /? |
| Disallow | /*?id= |
| Disallow | *?video=* |
yandex
| Rule | Path |
|---|---|
| Allow | /assets/images |
| Allow | /p3class.xml |
| Disallow | /download |
| Disallow | /cgi-bin |
| Disallow | /connectors |
| Disallow | /core |
| Disallow | /css |
| Disallow | /fancybox |
| Disallow | /fonts |
| Disallow | /import |
| Disallow | /manager |
| Disallow | /jivosite |
| Disallow | /js |
| Disallow | /php |
| Disallow | /s2p_good |
| Disallow | /s2p_tmp |
| Disallow | /tmp |
| Disallow | /webstat |
| Disallow | /assets/components/phpthumbof/cache |
| Disallow | /assets/components |
| Disallow | /assets/classes |
| Disallow | /assets/video |
| Disallow | /assets/landing |
| Disallow | /ru/ |
| Disallow | /samara |
| Disallow | */korzina |
| Disallow | */oformlenie-zakaza |
| Disallow | */tex-straniczyi |
| Disallow | /rezultatyi-poiska |
| Disallow | *rezultatyi-poiska?query* |
| Disallow | */registration |
| Disallow | /*cache$ |
| Disallow | /?hauth |
| Disallow | /*.php$ |
| Disallow | *?utm* |
| Disallow | *?imagescaler* |
| Disallow | *bannerclick* |
| Disallow | *?service* |
| Disallow | */qr?video=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 6 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.megapir.com/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.
Comments