Log In Sign Up

dnddeutsch.de
robots.txt

Robots Exclusion Standard data for dnddeutsch.de

Resource Scan

Scan Details

Site Domain dnddeutsch.de
Base Domain dnddeutsch.de
Scan Status Ok
Last Scan2024-10-09T02:13:24+00:00
Next Scan 2024-10-10T02:13:24+00:00

Last Scan

Scanned2024-10-09T02:13:24+00:00
URL https://dnddeutsch.de/robots.txt
Redirect https://www.dnddeutsch.de/robots.txt
Redirect Domain www.dnddeutsch.de
Redirect Base dnddeutsch.de
Domain IPs 2001:8d8:1800:402::1, 217.160.145.225
Redirect IPs 217.160.145.225, 2a01:239:294:b300::1
Response IP 217.160.145.225
Found Yes
Hash 3f0195a1c6d87f73e0f62e6b6f74475d5faf7e59b93b231f867ac4b7cf61a81d
SimHash b0121c71fc62

Groups

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

yak

Rule Path
Disallow /

linkfluence.com

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

omigilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

awariobot
awariorssbot
awariosmartbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

dataprovider

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

technicalseodotcom

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

botify

Rule Path
Disallow /

oncrawl

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

netestate ne crawler

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

pinterestbot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

*

Rule Path
Disallow /media_proxy/
Disallow /interact/

*

Rule Path
Disallow /calendar/action~posterboard/
Disallow /calendar/action~agenda/
Disallow /calendar/action~oneday/
Disallow /calendar/action~month/
Disallow /calendar/action~week/
Disallow /calendar/action~stream/
Disallow /calendar/action~undefined/
Disallow /calendar/action~http%3A/
Disallow /calendar/action~default/
Disallow /calendar/action~poster/
Disallow /calendar/action~*/
Disallow /*controller%3Dai1ec_exporter_controller*
Disallow /*/action~*/
Disallow /calendar-2/action~posterboard/
Disallow /calendar-2/action~agenda/
Disallow /calendar-2/action~oneday/
Disallow /calendar-2/action~month/
Disallow /calendar-2/action~week/
Disallow /calendar-2/action~stream/
Disallow /calendar-2/action~undefined/
Disallow /calendar-2/action~http%3A/
Disallow /calendar-2/action~default/
Disallow /calendar-2/action~poster/
Disallow /calendar-2/action~*/
Disallow /calendar-3/action~posterboard/
Disallow /calendar-3/action~agenda/
Disallow /calendar-3/action~oneday/
Disallow /calendar-3/action~month/
Disallow /calendar-3/action~week/
Disallow /calendar-3/action~stream/
Disallow /calendar-3/action~undefined/
Disallow /calendar-3/action~http%3A/
Disallow /calendar-3/action~default/
Disallow /calendar-3/action~poster/
Disallow /calendar-3/action~*/
Back to top

Comments

  • See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
  • AI
  • SEO
  • from https://technicalseo.com/tools/robots-txt/
  • others
Back to top