dogco.de
robots.txt

Robots Exclusion Standard data for dogco.de

Resource Scan

Scan Details

Site Domain dogco.de
Base Domain dogco.de
Scan Status Ok
Last Scan2024-05-26T08:25:15+00:00
Next Scan 2024-06-02T08:25:15+00:00

Last Scan

Scanned2024-05-26T08:25:15+00:00
URL https://dogco.de/robots.txt
Domain IPs 104.26.2.194, 104.26.3.194, 172.67.71.190, 2606:4700:20::681a:2c2, 2606:4700:20::681a:3c2, 2606:4700:20::ac43:47be
Response IP 104.26.2.194
Found Yes
Hash da478c6db865f5c7e22c414b78a5a71becf355977feeceb7ec50da55d6706058
SimHash 4a285185d9a1

Groups

*

Rule Path
Disallow /wp-snapshots/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /amazon-lunderland
Disallow /amazon-barf-koller
Disallow /amazon-wolfsblut-wildduck
Disallow /amazon-christopherus-hirschkartoffel
Disallow /amazon-christopherus-purebueffel
Disallow /feed/
Disallow */feed
Disallow */feed$
Disallow /*/feed/$
Disallow /tag/*/feed/
Disallow /search/*/feed/rss2/
Disallow /comments/feed
Disallow /?feed=
Disallow /wp-feed
Disallow /*//1000$
Disallow /*/1000$
Allow /wp-admin/admin-ajax.php

googlebot

Rule Path
Allow /wp-includes/js/wp-emoji-release.min.js

sistrix

Rule Path
Disallow /

sistrix crawler

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

seokicks

Rule Path
Disallow /

seobility

Rule Path
Disallow /

xenu

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

unisterbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seodiver

Rule Path
Disallow /

bubing

Rule Path
Disallow /

proximic

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

Other Records

Field Value
sitemap https://dogco.de/sitemap_index.xml