Log In Sign Up

merchants.skroutz.gr
robots.txt

Robots Exclusion Standard data for merchants.skroutz.gr

Resource Scan

Scan Details

Site Domain merchants.skroutz.gr
Base Domain skroutz.gr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-22T04:10:10+00:00
Next Scan 2024-08-20T04:10:10+00:00

Last Successful Scan

Scanned2023-05-19T18:09:14+00:00
URL https://merchants.skroutz.gr/robots.txt
Domain IPs 104.18.43.93, 172.64.144.163, 2606:4700:4400::6812:2b5d, 2606:4700:4400::ac40:90a3
Response IP 104.18.43.93
Found Yes
Hash 1c177294c974d60567a37518ea02458d569892b0fa0366be80fbea67760c65da
SimHash bc047c21f450

Groups

*

Rule Path
Disallow /products/show
Disallow /products/compare_selected_products
Disallow /apiv2/
Disallow /users/
Disallow /account/
Disallow /signup
Disallow /sign_in
Disallow /api/
Disallow /suggest
Disallow /personalization/
Disallow /comparelists/
Disallow /s/recently_viewed
Disallow /badge/api
Disallow /*/ugc_prompt.json
Disallow /adam/latest_keyphrases.json
Disallow /counters
Disallow /cart/*
Disallow /current_cart_count
Disallow /checkout/
Disallow /*/shops_highlights.json
Disallow /shop/*keyphrase%3D*
Disallow /s/product_cards_nearest_location.json
Disallow /s/*/recommendations
Disallow /api_login
Disallow /users/account

exabot

Rule Path
Disallow /

yandex

Rule Path
Allow /$
Disallow /

yandexbot

Rule Path
Allow /$
Disallow /

yandexmobilebot

Rule Path
Allow /$
Disallow /

yandexdirect

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.skroutz.gr/sitemaps/sitemap_index.xml.gz
Back to top

Comments

  • See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file
  • To ban all spiders from the entire site uncomment the next two lines:
  • User-Agent: *
  • Disallow: /
  • Everything is prohibited except the main page at Yandex
  • :......:::..::::..::..:::::..:::.......::::.......::::::..:::::........::
  • :'######::'##:::'##:'########:::'#######::'##::::'##:'########:'########:
  • '##... ##: ##::'##:: ##.... ##:'##.... ##: ##:::: ##:... ##..::..... ##::
  • :::..:: ##:'##::: ##:::: ##: ##:::: ##: ##:::: ##:::: ##:::::::: ##:::
  • . ######:: #####:::: ########:: ##:::: ##: ##:::: ##:::: ##::::::: ##::::
  • :..... ##: ##. ##::: ##.. ##::: ##:::: ##: ##:::: ##:::: ##:::::: ##:::::
  • '##::: ##: ##:. ##:: ##::. ##:: ##:::: ##: ##:::: ##:::: ##::::: ##::::::
  • . ######:: ##::. ##: ##:::. ##:. #######::. #######::::: ##:::: ########:
  • :......:::..::::..::..:::::..:::.......::::.......::::::..:::::........::
  • :......:::..Work with us: https://www.skroutz.gr/careers..:::::........::
Back to top