it-i-ko.de
robots.txt

Robots Exclusion Standard data for it-i-ko.de

Resource Scan

Scan Details

Site Domain it-i-ko.de
Base Domain it-i-ko.de
Scan Status Ok
Last Scan2024-11-12T13:34:41+00:00
Next Scan 2024-11-19T13:34:41+00:00

Last Scan

Scanned2024-11-12T13:34:41+00:00
URL https://it-i-ko.de/robots.txt
Redirect https://www.itiko.de/robots.txt
Redirect Domain www.itiko.de
Redirect Base itiko.de
Domain IPs 144.76.112.27
Redirect IPs 144.76.112.27
Response IP 144.76.112.27
Found Yes
Hash c441fb6b0d9b1c34b5086c693725463082dfbf4105928260e8ab9489ff9cd565
SimHash c26e47004ab1

Groups

magpie-crawler
ccbot
mj12bot
baiduspider
baiduspider-image
baiduspider-video
baiduspider-news
baiduspider-favo
baiduspider-cpro
baiduspider-ads
semrushbot
semruchbot-sa
ahrefsbot
petalbot
dotbot
yandex
vocusbot
suggybot
shopwiki
emefgebot
germcrawler
wbsearchbot
discobot
exabot
youdaobot
naverbot
spinn3r
mlbot
yioopbot
yeti
moget
netseer
ichiro
jikespider
maxpointcrawler/nutch-1.1
crystalsemanticsbot
turnitinbot
yacybot
ezooms
nerdbynature
acoon

Rule Path
Disallow /

*

Rule Path
Disallow /admin
Disallow /albums/
Disallow /blocks/
Disallow /images/
Disallow /includes/
Disallow /install/
Disallow /language/
Disallow /modules/
Disallow /spaw/
Disallow /themes/
Disallow /upgrade/
Disallow /themecache/
Disallow /dynadata/
Disallow /setup/
Disallow /mobile/
Disallow /bottrap/
Disallow /cgi-bin/suite/

Other Records

Field Value
sitemap https://www.itiko.de/sitemap.xml

Comments

  • robots.txt
  • Server: itiko.de
  • last change: 2021-10-07
  • Sitemaps

Warnings

  • 1 invalid line.