storck-bikes.com
robots.txt
Robots Exclusion Standard data for storck-bikes.com
Resource Scan
Scan Details
| Site Domain | storck-bikes.com |
| Base Domain | storck-bikes.com |
| Scan Status | Ok |
| Last Scan | 2024-09-21T13:39:44+00:00 |
| Next Scan | 2024-10-21T13:39:44+00:00 |
Last Scan
| Scanned | 2024-09-21T13:39:44+00:00 |
| URL | https://www.storck-bikes.com/robots.txt |
| Domain IPs | 2a01:4f8:221:384f::2, 46.4.27.51 |
| Response IP | 46.4.27.51 |
| Found | Yes |
| Hash | 984ad6e3d4609123df96461294fda1f6f96cd5ffe6b4a4ec026f73be06ac6901 |
| SimHash | 425482642c58 |
Groups
ahrefsbot
amazonbot
baiduspider
blexbot
bytespider
dataforseobot
grapeshotcrawler
ioncrawl
jobkicks
linguee bot
mail.ru_bot
megaindex
metajobbot
mj12bot
mojeekbot
petalbot
seekport
seekport crawler
semrushbot
seznambot
sogou web spider
uptimerobot
yandex
yandexbot
yandeximages
optimizer
| Rule | Path |
|---|---|
| Disallow | / |
*
| Rule | Path |
|---|---|
| Disallow | /ai-cache |
| Disallow | /cache |
| Disallow | /config |
| Disallow | /cvs |
| Disallow | /download |
| Disallow | /fehlerseiten |
| Disallow | /logarchiv |
| Disallow | /logs |
| Disallow | /node_modules |
| Disallow | /tmp |
| Disallow | /transfer |
| Disallow | /webman |
| Allow | /config/includes/templates |