netprofit.de
robots.txt
Robots Exclusion Standard data for netprofit.de
Resource Scan
Scan Details
| Site Domain | netprofit.de |
| Base Domain | netprofit.de |
| Scan Status | Ok |
| Last Scan | 2024-09-22T02:34:26+00:00 |
| Next Scan | 2024-10-22T02:34:26+00:00 |
Last Scan
| Scanned | 2024-09-22T02:34:26+00:00 |
| URL | https://netprofit.de/robots.txt |
| Redirect | https://www.netprofit.de/robots.txt |
| Redirect Domain | www.netprofit.de |
| Redirect Base | netprofit.de |
| Domain IPs | 94.102.220.195 |
| Redirect IPs | 94.102.220.195 |
| Response IP | 94.102.220.195 |
| Found | Yes |
| Hash | 6ec97acfa99247cd22ff7d1d88ca366660e7ad9fa8111b3a118698738ccb06b4 |
| SimHash | 514f7876c9b2 |
Groups
aboundexbot
ahrefsbot
aihitbot
archive.org_bot
baiduspider
easouspider
ccbot
cliqzbot
ec2linkfinder
exabot
ezooms
fetch
genieo
gptbot
grub-client
httrack
ia_archiver
ia_archiver-web.archive.org
ia_archiver/1.6
infopath
infopath.2
ip-web-crawler.com
libwww
linkpadbot
mail.ru
meanpathbot
microsoft.url.control
mj12bot
mozilla/4.0
msiecrawler
netestate ne crawler
npbot
offline explorer
panscient.com
petalbot
psbot
screaming frog seo spider
searchmetericsbot
searchspider
seokicks-robot
seznambot
sitecheck.internetseer.com
sitesnagger
sosospider
spbot
sitebot
swebot
taptubot
teleport
teleportpro
turnitinbot
twengabot
twiceler
ubicrawler
vscooter
wbsearchbot
webcapture
webcopier
webreaper
webstripper
webzip
wget
wotbox
xenu
xenu's
xenu's link sleuth 1.1c
yandex
zealbot
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /contao/ |
| Disallow | /_contao/ |
*
| Rule | Path |
|---|---|
| Disallow | /?keyword= |
| Disallow | /preview.php/ |
| Disallow | */preview.php/ |
| Disallow | /share/ |
| Disallow | /webalizer/ |
| Disallow | /youtube/ |
| Disallow | /files/dateien/bilder/kontakt/ansprechpartner/ |
| Disallow | /files/dateien/bilder/agentur/team/ |
| Disallow | /files/dateien/bilder/agentur/presse/ |
| Disallow | /files/dateien/bilder/blog/b2b-ecommerce/kaufabbrueche-online-shops-gruende.png |
| Disallow | /files/dateien/bilder/blog/b2b-ecommerce/umsatz-b2b-commerce.png |
| Disallow | /files/dateien/bilder/blog/extern/ |
| Disallow | /files/dateien/bilder/blog/sonstige/ |
| Disallow | /files/dateien/bilder/sonstige/ |
| Disallow | /files/dateien/pdf/ |
| Disallow | /files/themes/netprofit/images/standort-netprofit.jpg |
| Disallow | /files/themes/netprofit/images/map/ |
| Disallow | /files/themes/netprofit/images/adobe-pdf.svg |
| Disallow | /files/themes/netprofit/images/insert-coin.svg |
| Disallow | /assets/images/*/2023-seminar-rid-netprofit* |
| Disallow | /contao/ |
| Disallow | /_contao/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.netprofit.de/sitemap.xml |