primholstein.com
robots.txt

Robots Exclusion Standard data for primholstein.com

Resource Scan

Scan Details

Site Domain primholstein.com
Base Domain primholstein.com
Scan Status Ok
Last Scan2024-06-06T01:24:31+00:00
Next Scan 2024-07-06T01:24:31+00:00

Last Scan

Scanned2024-06-06T01:24:31+00:00
URL https://primholstein.com/robots.txt
Domain IPs 185.13.64.101
Response IP 185.13.64.101
Found Yes
Hash e991d78a4e5b6df8f3d176f21c1a1957fe7e3675059730a23c19da8769c50998
SimHash a479598a48f3

Groups

googlebot

Rule Path
Allow /*

googlebot-news

Rule Path
Allow /*

googlebot-image

Rule Path
Allow /*

adsbot-google

Rule Path
Allow /*

googlebot-mobile

Rule Path
Allow /*

mediapartners-google

Rule Path
Allow /*

bingbot

Rule Path
Allow /*

yahoo! slurp

Rule Path
Allow /*

duckduckbot

Rule Path
Allow /*

qwantify

Rule Path
Allow /*

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

webzip

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

yandex

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

yandexmedia

Rule Path
Disallow /

yandeximages

Rule Path
Disallow /

yandexcatalog

Rule Path
Disallow /

yandexdirect

Rule Path
Disallow /

yandexblogs

Rule Path
Disallow /

yandexnews

Rule Path
Disallow /

yandexpagechecker

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

baiduspider-mobile

Rule Path
Disallow /

baiduspider-video

Rule Path
Disallow /

baiduspider-news

Rule Path
Disallow /

baiduspider-favo

Rule Path
Disallow /

baiduspider-sfkr

Rule Path
Disallow /

baiduspider-cpro

Rule Path
Disallow /

wget

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

k2spider

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /feed/
Disallow /trackback/
Disallow /wp-login.php
Disallow /xmlrpc.php
Disallow /test/
Disallow /plesk-stat/
Disallow /picture_library/
Disallow /inra_ctig/
Disallow /tableau_index/
Disallow /tableau_index_svg_20110701/
Disallow /techniciens/
Disallow /annonces/
Disallow /index.php?Itemid=
Disallow /index.php?option=
Disallow /probleme-connexion/
Disallow /presentations-techniques/
Disallow /cgu/
Disallow /wp-json/
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /*.swf$
Disallow /*.wmv$
Disallow /*.cgi$
Disallow /*.xhtml$

Comments

  • User-agent: ia_archiver
  • Disallow: /wiki/User
  • Disallow: /wiki/Benutzer
  • User-agent: facebookexternalhit
  • Disallow: /
  • Disallow: /wp-admin/
  • Disallow: /wp-content/
  • Disallow: /wp-includes/