yopi.de
robots.txt
Robots Exclusion Standard data for yopi.de
Resource Scan
Scan Details
| Site Domain | yopi.de |
| Base Domain | yopi.de |
| Scan Status | Ok |
| Last Scan | 2024-06-15T06:46:16+00:00 |
| Next Scan | 2024-06-22T06:46:16+00:00 |
Last Scan
| Scanned | 2024-06-15T06:46:16+00:00 |
| URL | https://www.yopi.de/robots.txt |
| Domain IPs | 104.26.14.241, 104.26.15.241, 172.67.68.28, 2606:4700:20::681a:ef1, 2606:4700:20::681a:ff1, 2606:4700:20::ac43:441c |
| Response IP | 172.67.68.28 |
| Found | Yes |
| Hash | 97626058260e433289cac28d0c67773b5a9b6260e39ae4cad282f76574f7571c |
| SimHash | 6421071667f0 |
Groups
msnbot
msnbot-media
adidxbot
bingbot
bingpreview
semrushbot
semrushbot-sa
ahrefsbot
dotbot
blexbot
slurp
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
*
| Rule | Path |
|---|---|
| Disallow | /new-image/ |
| Disallow | /neues-produkt/ |
| Disallow | /exit/byebye |
| Disallow | /exit/* |
| Disallow | /frontend/ |
| Disallow | /rewrites/ |
| Disallow | /param/ |
| Disallow | /my-yopi/ |
| Disallow | /adserver/ |
| Disallow | /index.php |
| Disallow | /tracking.php |
| Disallow | /logging/ |
| Disallow | /scripts/ |
| Disallow | /seal_of_excellence/ |
| Disallow | /styles/ |
| Disallow | /produktbild/ |
| Disallow | /reviews/*/ratings/new |
| Disallow | /user/*/generated-content-reviews |
| Disallow | /user/*/generated-content-review-reactions |
| Disallow | /user/*/generated-content-images |
| Disallow | /kategorien/*/more-filters |
baiduspider
baiduspider-image
baiduspider-news
baiduspider-video
daumoa
exploratodo
feedly
findxbot
gooblog
haosouspider
ichiro
istellabot
jikespider
lycos
mail.ru
mojeekbot
orangebot
pinterest
plukkie
rambler
seznambot
sosospider
sogou blog
sogou news spider
sogou orion spider
sogou spider2
sputnikbot
wotbox
yacybot
yandex
yandexmobilebot
yeti
yioopbot
yoozbot
| Rule | Path |
|---|---|
| Disallow | / |
Warnings
- 3 invalid lines.
Comments