pilotwheels.com
robots.txt

Robots Exclusion Standard data for pilotwheels.com

Resource Scan

Scan Details

Site Domain pilotwheels.com
Base Domain pilotwheels.com
Scan Status Ok
Last Scan2026-02-12T16:49:17+00:00
Next Scan 2026-03-14T16:49:17+00:00

Last Scan

Scanned2026-02-12T16:49:17+00:00
URL https://pilotwheels.com/robots.txt
Domain IPs 144.217.76.152
Response IP 144.217.76.152
Found Yes
Hash f378885fa8117481f1e56dee246727832040988c071511f1101ceed7b2adc473
SimHash a0762d7f438e

Groups

semrushbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

tineye

Rule Path
Disallow /

tineye/1.0

Rule Path
Disallow /

tineye/1.1

Rule Path
Disallow /

googlebot-image

Rule Path
Disallow /

catchbot

Rule Path
Disallow /

webrankspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /banner/
Disallow /catalogue2015/
Disallow /catalogueKia/
Disallow /css/
Disallow /documents/
Disallow /dropincontent/
Disallow /entreposage/
Disallow /entreposageOLD/
Disallow /entrepot/
Disallow /event/
Disallow /favicon/
Disallow /fonts/
Disallow /images/
Disallow /infolettre/
Disallow /js/
Disallow /library/
Disallow /newsletter/
Disallow /orders/
Disallow /orders2014/
Disallow /orders2017/
Disallow /qrcode/
Disallow /sd/
Disallow /securform/
Disallow /shipping/
Disallow /supplier/
Disallow /template/

Comments

  • robots.txt
  • Created: 01 / 01 / 2013 15:16:37 GMT
  • Please note: There are a lot of pages on this site, and there are
  • some misbehaved spiders out there. If you're
  • irresponsible, your access to the site may be blocked.