Log In Sign Up

ep-mediastore-ab.de
robots.txt

Robots Exclusion Standard data for ep-mediastore-ab.de

Resource Scan

Scan Details

Site Domain ep-mediastore-ab.de
Base Domain ep-mediastore-ab.de
Scan Status Ok
Last Scan2025-06-10T16:34:17+00:00
Next Scan 2025-06-17T16:34:17+00:00

Last Scan

Scanned2025-06-10T16:34:17+00:00
URL https://ep-mediastore-ab.de/robots.txt
Redirect https://www.ep-mediastore-ab.de/robots.txt
Redirect Domain www.ep-mediastore-ab.de
Redirect Base ep-mediastore-ab.de
Domain IPs 212.53.149.131
Redirect IPs 212.53.149.131
Response IP 212.53.149.131
Found Yes
Hash e0bfef87c5116918b359cfaffa355dcbad5f3d6b6a70317ea3d66d4cfd04fe11
SimHash 46126141a79d

Groups

xovibot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

mediapartners-google*

Rule Path
Allow /

googlebot*

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

bingbot
amazonbot

Rule Path
Disallow /advanced_search_result.php
Disallow /advanced_search.php
Disallow /ersatzteile.php
Disallow /product_reviews_write.php
Disallow /contact_us.php

Other Records

Field Value
crawl-delay 30

dataforseobot

Rule Path
Disallow /contact_us.php
Disallow /product_reviews_write.php

semrushbot

Rule Path
Disallow /contact_us.php
Disallow /advanced_search.php
Disallow /product_reviews_write.php
Disallow /ersatzteile.php

seokicks-robot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

*

Rule Path
Disallow /admin
Disallow /includes
Disallow /account.php
Disallow /checkout_shipping.php
Disallow /create_account.php
Disallow /login.php
Disallow /password_forgotten.php
Disallow /shopping_cart.php
Disallow /product_reviews_write.php
Disallow /cookie_usage.php

baiduspider*

Rule Path
Disallow /

jobs.de-robot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /advanced_search_result.php

baiduspider+

Rule Path
Disallow /advanced_search_result.php

seekportbot

Rule Path
Disallow /contact_us.php
Back to top

Comments

  • Sample robots.txt file (make sure the filename is ALL LOWERCASE on Linux/Unix systems)
  • This file should go in your web site's ROOT directory
  • The root directory is where your site's main /index.html file would be found
  • It is usually found in /yourhomedir/public_html/ or /yourhomedir/httpdocs
  • Where "yourhomedir" is your user account's name
  • This says to apply these settings to ALL search engine spiders/crawlers
  • Disallow: /advanced_search_result.php
  • Disallow: /advanced_search.php
  • Disallow: /ersatzteile.php
  • These settings will keep spiders from indexing your unwanted pages
  • This assumes that your OSC install is in your web site's ROOT directory
  • ie: http://www.yoursite.com/index.php <- Use if this brings up your OSC main page
  • Disallow: /advanced_search.php
  • Disallow: /advanced_search_result.php
  • Disallow: /popup_image.php
  • Disallow: /contact_us.php
  • Disallow: /redirect.php
  • Disallow: /product_thumb.php
  • User-agent: ShopWiki
  • User-agent: Googlebot-Image
Back to top