Log In Sign Up

internet-marketer.ch
robots.txt

Robots Exclusion Standard data for internet-marketer.ch

Resource Scan

Scan Details

Site Domain internet-marketer.ch
Base Domain internet-marketer.ch
Scan Status Ok
Last Scan2024-09-25T18:13:32+00:00
Next Scan 2024-10-02T18:13:32+00:00

Last Scan

Scanned2024-09-25T18:13:32+00:00
URL https://internet-marketer.ch/robots.txt
Redirect https://www.internet-marketer.ch/robots.txt
Redirect Domain www.internet-marketer.ch
Redirect Base internet-marketer.ch
Domain IPs 2001:1600:13:102:f816:3eff:febf:9cb3, 83.166.130.186
Redirect IPs 2001:1600:13:102:f816:3eff:febf:9cb3, 83.166.130.186
Response IP 83.166.130.186
Found Yes
Hash 9de526ba297c610c8304ab586256c14baeace815d48f807ce10ba824ce32ce85
SimHash 591cc2fc7478

Groups

backlinkcrawler
baiduspider
bdcbot
dotbot
haosouspider
jamesbot
iccrawler - icjobs
linkdexbot/2.0
mail.ru_bot
mj12bot
moreoverbot/5.1
moreoverbot
proximic
ssearch_bot
searchmetricsbot
semrushbot
seznambot
x28-job-bot
xovibot
yandex
wotbox

Rule Path
Disallow /

*

Rule Path
Disallow /administrator/
Disallow /api/
Disallow /bin/
Disallow /cache/
Disallow /cli/
Disallow /components/
Disallow /includes/
Disallow /installation/
Disallow /language/
Disallow /layouts/
Disallow /libraries/
Disallow /logs/
Disallow /modules/
Disallow /plugins/
Disallow /tmp/
Disallow /index.php?*=*
Disallow /component/*
Disallow /en/component/*
Disallow /*?types*
Disallow /*.php
Disallow /*.inc
Disallow /*.gz
Disallow /*.zip
Back to top

Other Records

Field Value
sitemap https://www.internet-marketer.ch/plan-site-xml
sitemap https://www.internet-marketer.ch/en/sitemap-xml
Back to top

Comments

  • HaosouSpider
  • JamesBOT
  • Jobbörse.com
  • Linkdexbot
  • Mail.RU_Bot
  • Majestic
  • Moreoverbot
  • proximic
  • Search bots
  • Search metrics
  • Sem rush
  • SeznamBot
  • 28 job
  • XoviBot
  • Yandex
  • Wotbox
  • For syntax checking, see:
  • http://tool.motoricerca.info/robots-checker.phtml
  • Block query strings
  • Two sitemaps
  • Block files
Back to top