combat.pl
robots.txt
Robots Exclusion Standard data for combat.pl
Resource Scan
Scan Details
Site Domain | combat.pl |
Base Domain | combat.pl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-14T17:15:13+00:00 |
Next Scan | 2025-02-12T17:15:13+00:00 |
Last Successful Scan
Scanned | 2023-04-18T14:24:24+00:00 |
URL | https://combat.pl/robots.txt |
Redirect | https://www.combat.pl/robots.txt |
Redirect Domain | www.combat.pl |
Redirect Base | combat.pl |
Domain IPs | 104.26.8.29, 104.26.9.29, 172.67.70.91, 2606:4700:20::681a:81d, 2606:4700:20::681a:91d, 2606:4700:20::ac43:465b |
Redirect IPs | 104.26.8.29, 104.26.9.29, 172.67.70.91, 2606:4700:20::681a:81d, 2606:4700:20::681a:91d, 2606:4700:20::ac43:465b |
Response IP | 104.26.8.29 |
Found | Yes |
Hash | aa13b161b0f21f22f046f09575efffaabaf6711dfe98ccdd0582ba8b3275863a |
SimHash | 479752cb4fa3 |
Groups
*
Rule | Path |
---|---|
Disallow | /index.php/ |
Disallow | /checkout/ |
Disallow | /app/ |
Disallow | /lib/ |
Disallow | /*.php$ |
Disallow | /pkginfo/ |
Disallow | /report/ |
Disallow | /var/ |
Disallow | /catalog/ |
Disallow | /sendfriend/ |
Disallow | /review/ |
Disallow | /*SID%3D |
Disallow | /catalogsearch/ |
Disallow | /amasty_xsearch/ |
Disallow | /amasty_banners/ |
Disallow | /*product_list_order%3Dprice |
Disallow | /*product_list_order%3Dproducent |
Disallow | /*product_list_order%3Dname |
Disallow | /*product_list_limit%3D40* |
Disallow | /*product_list_limit%3D60 |
Other Records
Field | Value |
---|---|
crawl-delay | 10 |
Other Records
Field | Value |
---|---|
sitemap | https://www.combat.pl/sitemap.xml |
Comments