refundo.sk
robots.txt

Robots Exclusion Standard data for refundo.sk

Resource Scan

Scan Details

Site Domain refundo.sk
Base Domain refundo.sk
Scan Status Ok
Last Scan2024-09-29T07:29:20+00:00
Next Scan 2024-10-06T07:29:20+00:00

Last Scan

Scanned2024-09-29T07:29:20+00:00
URL https://refundo.sk/robots.txt
Redirect https://www.refundo.sk:443/robots.txt
Redirect Domain www.refundo.sk
Redirect Base refundo.sk
Domain IPs 185.178.174.213, 2a0a:6580:16::b9b2:aed5
Redirect IPs 185.178.174.213, 2a0a:6580:16::b9b2:aed5
Response IP 185.178.174.213
Found Yes
Hash cc20bbec0cf7864447d0fe3fa8681bb09b471878675f1b637bc9042e7dd3937e
SimHash 30cc40d2a0e2

Groups

proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
blexbot
ccbot
tencenttraveler
timpibot
cookiebot

Rule Path
Disallow /

mj12bot
ahrefsbot
seokicks-robot
dotbot
dotbot
semrushbot
semrushbot-sa
megaindex.ru
spbot
dataforseobot

Rule Path
Disallow /

linguee
deusu
turnitinbot
awariobot
geedoproductsearch

Rule Path
Disallow /

yandex
yandexbot
yandexmobilebot
yandeximageresizer
coccocbot
coccocbot-web
coccocbot-image
yeti
baiduspider
sogou web spider
sogou
seekbot
seekport
seekport crawler
amazonbot

Rule Path
Disallow /

amazonbot
bytespider
claudebot
facebookbot
meta-externalagent
gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /*?do=*
Disallow /*?*&do=*
Disallow /?orderby=*
Disallow /*?orderby=*
Disallow /*?*&orderby=*
Disallow /?order=*
Disallow /*?order=*
Disallow /*?*&order=*
Disallow /exit/*
Disallow /json/*
Disallow /facebook/*
Disallow /sign/facebook-authorize
Disallow /*/undefined
Disallow /*/*q%3A*/*
Disallow /*/*%3A*%2C*/*

Other Records

Field Value
sitemap https://www.refundo.sk/sitemap.xml

Comments

  • Bad bots ------> BLOCK
  • SEO bots ------> BLOCK
  • Crawler
  • Search engines
  • AI bots
  • Disallow: /*/*p:*/*
  • Disallow: /*/*:*;*/*

Warnings

  • 1 invalid line.