sexblue-box.gr
robots.txt

Robots Exclusion Standard data for sexblue-box.gr

Resource Scan

Scan Details

Site Domain sexblue-box.gr
Base Domain sexblue-box.gr
Scan Status Ok
Last Scan2024-10-06T18:41:15+00:00
Next Scan 2024-11-05T18:41:15+00:00

Last Scan

Scanned2024-10-06T18:41:15+00:00
URL https://sexblue-box.gr/robots.txt
Domain IPs 88.99.193.234
Response IP 88.99.193.234
Found Yes
Hash ee2f01a1c3aa5c0de4109042c1000ede95b621382c32507dbd62ced6ac5eabb8
SimHash 8b267e720e89

Groups

*

Rule Path
Disallow /W/*
Allow /w/*
Disallow /w/administrator/
Disallow /w/installation/
Disallow /w/language/
Disallow /w/libraries/
Disallow /w/tmp/
Disallow /w/xmlrpc/
Disallow /piwik/
Allow /piwik/piwik.js
Allow /piwik/piwik.php
Allow /w/online-sex-shop/catid/*
Allow /w/online-sex-shop/prodid/*
Disallow /w/*/redtube/*
Disallow /w/virtuemart/*
Disallow /w/online-sex-shop/cart.html
Disallow /w/index.php/virtuemart/*
Disallow /w/index2.php
Disallow /w/*pop%3D*
Disallow /w/*popup*
Disallow /w/*option%3Dcom*
Disallow /w/*page%3Dshop.ask*
Disallow /w/*page%3Dshop.recommend*
Disallow /w/*tmpl%3Dcomponent*
Disallow /w/online-sex-shop/user-registration.html
Disallow /w/component/*
Disallow /w/*/rss/*
Allow /w/*option%3Dcom_virtuemart*
Allow /w/component/content/article/*
Allow /w/components/com_virtuemart/show_image_in_imgtag.php
Allow /w/components/com_virtuemart/fetchscript.php
Allow /w/components/com_virtuemart/shop_image/
Allow /w/online-sex-shop.html
Allow /w/sitemap.html
Allow /w/online-sex-shop/products.html
Disallow /w/online-sex-shop/catid/?keyword=
Disallow /w/online-sex-shop/catid/?limit=

antbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

spiderling

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mail.ru_bot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

daumoa

Rule Path
Disallow /

meanpathbot

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

lwnutch/nutch-1.4

Rule Path
Disallow /

lwnutch

Rule Path
Disallow /

nutch

Rule Path
Disallow /

bubing

Rule Path
Disallow /

lssrocketcrawler

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

hrcrawler

Rule Path
Disallow /

yahoocachesystem

Rule Path
Disallow /

worldwebheritage.org

Rule Path
Disallow /

worldwebheritage

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

lcc

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://sexblue-box.gr/sitemap.xml

Comments

  • Disallow: /w/cache/
  • Disallow: /w/components/
  • Disallow: /w/images/
  • Disallow: /w/includes/
  • Disallow: /w/media/
  • Disallow: /w/modules/
  • Disallow: /w/plugins/
  • Disallow: /w/templates/
  • Disallow: /w/*components*
  • Allow: /w/components/com_virtuemart/themes/lightfashion/themecss.php

Warnings

  • 4 invalid lines.