ceneje.si
robots.txt

Robots Exclusion Standard data for ceneje.si

Resource Scan

Scan Details

Site Domain ceneje.si
Base Domain ceneje.si
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-21T09:32:57+00:00
Next Scan 2024-10-20T09:32:57+00:00

Last Successful Scan

Scanned2024-06-23T09:30:57+00:00
URL https://ceneje.si/robots.txt
Redirect https://www.ceneje.si/robots.txt
Redirect Domain www.ceneje.si
Redirect Base ceneje.si
Domain IPs 104.18.33.12, 172.64.154.244, 2606:4700:4400::6812:210c, 2606:4700:4400::ac40:9af4
Redirect IPs 104.18.33.12, 172.64.154.244, 2606:4700:4400::6812:210c, 2606:4700:4400::ac40:9af4
Response IP 172.64.154.244
Found Yes
Hash 75173062986568ad3eae6de83579a337c51364641525589104f3f2bab3c983b2
SimHash 20595c68b4d3

Groups

*

Rule Path
Disallow *crft%3D*
Disallow *craz%3D*
Disallow */Iskanje/Izdelki?type=*
Disallow */Trgovina/*?page=*
Disallow *Iskanje/Katalogi?page=*
Disallow */Iskanje/Katalogi?sel=*%2C*
Disallow */Iskanje/Izdelki?page=*
Disallow */Iskanje/Izdelki?sort=*
Disallow *Trgovina?sort=*
Disallow *~*
Disallow *MLI%3D*
Disallow *ITP%3D*
Disallow *compareProducts%3D*
Disallow /Redirect/*
Disallow /PopUp/*
Disallow /Security/*
Disallow /Product/AddProductLike
Disallow /Product/AddCommentLike
Disallow /Product/AddComment
Disallow /Product/AddNewOpinionToOpinion
Disallow /Product/AddCommentToComment
Disallow /Product/GetSellerMoreData
Disallow /Product/ShowRateSellerNotifier
Disallow /Product/LogTopProductImpressions
Disallow /Product/LogPageView
Disallow /Product/GetAlsoViewed
Disallow /Product/SAndC
Disallow /Ajax/*
Disallow /UserPost/SendToFriend
Disallow /UserPost/SendToFriendForm
Disallow /UserPost/SendAnswerToFriend
Disallow /UserPost/SendAnswerToFriendForm
Disallow /UserPost/AddQuestionLike
Disallow /UserPost/AddCommentLike
Disallow /UserPost/SubmitAnswer
Disallow /UserPost/SubmitPost
Disallow /UserPost/ReportUserPost
Disallow /UserPost/ReportUserPostAnswer
Disallow /UserPost/ReportUserPostForm
Disallow /UserPost/ReportUserPostAnswerForm
Disallow /News/SubmitComment
Disallow /News/AddCommentLike
Disallow /News/AddNewsLike
Disallow /News/ReportInappropriateContent
Disallow /News/ReportInappropriateContentForm
Disallow /4738558/*
Disallow /*?*s1s=true*
Disallow /*?*sl=*
Disallow /Reviews/*
Disallow /Anp/*
Disallow /Honeypot/*
Disallow /offline.html
Disallow */Forum/Vprasanje*
Disallow */Iskanje/Nasveti*
Disallow */Iskanje/Testi*
Disallow */Izdelki?page*
Disallow */Search/Search*
Disallow */cdn-cgi/*
Disallow */Popup/ShowPriceTrendNotification

mj12bot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

discobot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

inarchive.com

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider+

Rule Path
Disallow /

adsbot-google

Rule Path
Disallow *crft%3D*
Disallow *craz%3D*
Disallow *~*
Disallow *MLI%3D*
Disallow *ITP%3D*
Disallow *?pbra=*%2C*
Disallow *compareProducts%3D*
Disallow /Redirect/*
Disallow /PopUp/*
Disallow /Security/*
Disallow /Product/AddProductLike
Disallow /Product/AddCommentLike
Disallow /Product/AddComment
Disallow /Product/AddNewOpinionToOpinion
Disallow /Product/AddCommentToComment
Disallow /Product/GetSellerMoreData
Disallow /Product/ShowRateSellerNotifier
Disallow /Product/LogTopProductImpressions
Disallow /UserPost/SendToFriend
Disallow /UserPost/SendToFriendForm
Disallow /UserPost/SendAnswerToFriend
Disallow /UserPost/SendAnswerToFriendForm
Disallow /UserPost/AddQuestionLike
Disallow /UserPost/AddCommentLike
Disallow /UserPost/SubmitAnswer
Disallow /UserPost/SubmitPost
Disallow /UserPost/ReportUserPost
Disallow /UserPost/ReportUserPostAnswer
Disallow /UserPost/ReportUserPostForm
Disallow /UserPost/ReportUserPostAnswerForm
Disallow /News/SubmitComment
Disallow /News/AddCommentLike
Disallow /News/AddNewsLike
Disallow /News/ReportInappropriateContent
Disallow /News/ReportInappropriateContentForm
Disallow /4738558/*
Disallow */Forum/Vprasanje*
Disallow */Iskanje/Nasveti*
Disallow */Iskanje/Testi*
Disallow */Izdelki?page*
Disallow */Search/Search*
Disallow */cdn-cgi/*
Disallow */Popup/ShowPriceTrendNotification
Disallow */Iskanje/Izdelki?type=*
Disallow */Trgovina/*?page=*
Disallow *Iskanje/Katalogi?page=*
Disallow */Iskanje/Katalogi?sel=*%2C*
Disallow */Iskanje/Izdelki?page=*
Disallow */Iskanje/Izdelki?sort=*

blexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ceneje.si/sitemap_index.xml

Comments

  • ALL BOTS RULES
  • --------------
  • Filter combinations:
  • highlevel filtration
  • sliders
  • sitesearch funkyness
  • multiple values of same parameter
  • Disallow: *?filt=*,*
  • Disallow: *?pbra=*,*
  • old rules
  • Slovenia
  • CloudFlare
  • Disallow: */api/v1/*
  • Disallow: */api/V1/*
  • GOOGLE ADBOT RULES
  • ------------------
  • sliders
  • multiple values of same parameter
  • Disallow: *?filt=*,*
  • Slovenia
  • CloudFlare
  • Disallow: */api/v1/*
  • Disallow: */api/V1/*
  • sitesearch funkyness