refundo.cz
robots.txt

Robots Exclusion Standard data for refundo.cz

Resource Scan

Scan Details

Site Domain refundo.cz
Base Domain refundo.cz
Scan Status Ok
Last Scan2024-09-27T04:39:02+00:00
Next Scan 2024-10-04T04:39:02+00:00

Last Scan

Scanned2024-09-27T04:39:02+00:00
URL https://refundo.cz/robots.txt
Redirect https://www.refundo.cz:443/robots.txt
Redirect Domain www.refundo.cz
Redirect Base refundo.cz
Domain IPs 185.178.174.213, 2a0a:6580:16::b9b2:aed5
Redirect IPs 185.178.174.213, 2a0a:6580:16::b9b2:aed5
Response IP 185.178.174.213
Found Yes
Hash d261498575e7020da1b459dfa9e625eb45fcb5ba564b11a84e15c626e0712744
SimHash 30cc40d2a1a2

Groups

proximic
bizinformation
blexbot
riddler
ltx71
magpie-crawler
grapeshot
grapeshotcrawler
gigablastopensource
bubing
linkdexbot
seokicks
seokicks-robot
panscient.com
webdatastats
zoominfobot
blexbot
ccbot
tencenttraveler
timpibot
cookiebot

Rule Path
Disallow /

mj12bot
ahrefsbot
seokicks-robot
dotbot
dotbot
semrushbot
semrushbot-sa
megaindex.ru
spbot
dataforseobot

Rule Path
Disallow /

linguee
deusu
turnitinbot
awariobot
geedoproductsearch

Rule Path
Disallow /

yandex
yandexbot
yandexmobilebot
yandeximageresizer
coccocbot
coccocbot-web
coccocbot-image
yeti
baiduspider
sogou web spider
sogou
seekbot
seekport
seekport crawler
amazonbot

Rule Path
Disallow /

amazonbot
bytespider
claudebot
facebookbot
meta-externalagent
gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /*?do=*
Disallow /*?*&do=*
Disallow /?orderby=*
Disallow /*?orderby=*
Disallow /*?*&orderby=*
Disallow /?order=*
Disallow /*?order=*
Disallow /*?*&order=*
Disallow /exit/*
Disallow /json/*
Disallow /facebook/*
Disallow /sign/facebook-authorize
Disallow /*/undefined
Disallow /*/*q%3A*/*
Disallow /*/*%3A*%2C*/*

Other Records

Field Value
sitemap https://www.refundo.cz/sitemap.xml

Comments

  • Bad bots ------> BLOCK
  • SEO bots ------> BLOCK
  • Crawler
  • Search engines
  • AI bots
  • Disallow: /*/*p:*/*
  • Disallow: /*/*:*;*/*

Warnings

  • 1 invalid line.