botmarketing.pl
robots.txt

Robots Exclusion Standard data for botmarketing.pl

Resource Scan

Scan Details

Site Domain botmarketing.pl
Base Domain botmarketing.pl
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-28T15:33:32+00:00
Next Scan 2025-12-27T15:33:32+00:00

Last Successful Scan

Scanned2022-08-09T02:57:25+00:00
URL https://botmarketing.pl/robots.txt
Redirect https://www.botmarketing.pl/robots.txt
Redirect Domain www.botmarketing.pl
Redirect Base botmarketing.pl
Response IP 172.67.209.231
Found Yes
Hash 279d9e4baae0414c3e2120c8571febb9c5cc8a2bba067da18227c26774509356
SimHash 485ce9a2c756

Groups

*

Rule Path
Disallow /*?sort
Disallow /*?route=checkout%2F
Disallow /*?route=account%2F
Disallow /*?route=product%2F
Disallow /*?page=1
Disallow /*%26create%3D1
Disallow /*?route=information%2F*
Disallow /*?route=*
Disallow /*?route=product%2Fproduct*&manufacturer_id=
Disallow /*?route=account%2Freturn%2Fadd
Disallow /*?route=information%2Fcontact
Disallow /admin/
Disallow /system/
Disallow /.well-known/
Disallow /cgi-bin/
Disallow /privacy.html
Disallow /gv_faq.html
Disallow /shippinginfo.html
Disallow /conditions.html
Disallow /about_us.html
Disallow /about_us
Disallow /frequently_asked_questions.html
Disallow /contact_us.html
Disallow /contact
Disallow /shopping_cart.html
Disallow /account.html
Disallow /privacy-policy
Disallow /create_account.html
Disallow /discount_coupon.html
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Allow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

googlebot

Rule Path
Disallow /admin/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/

googlebot-image

Rule Path
Disallow /admin/
Disallow /system/
Disallow /catalog/
Disallow /vqmod/
Disallow /themeinstall/
Disallow /.well-known/
Disallow /cgi-bin/

Other Records

Field Value
sitemap site_map.xml

Warnings

  • 1 invalid line.