netdoktor.de
robots.txt

Robots Exclusion Standard data for netdoktor.de

Resource Scan

Scan Details

Site Domain netdoktor.de
Base Domain netdoktor.de
Scan Status Ok
Last Scan2024-11-15T11:13:57+00:00
Next Scan 2024-11-22T11:13:57+00:00

Last Scan

Scanned2024-11-15T11:13:57+00:00
URL https://netdoktor.de/robots.txt
Redirect https://www.netdoktor.de/robots.txt
Redirect Domain www.netdoktor.de
Redirect Base netdoktor.de
Domain IPs 62.138.91.97
Redirect IPs 62.138.91.97
Response IP 62.138.91.97
Found Yes
Hash bb864497d5ab45b7a3a26dec38755874a83d21fd8c0e2d7139c5c408f2c4844c
SimHash 49145874e39a

Groups

*

Rule Path
Disallow /admin/
Disallow /preview/
Disallow /api/
Disallow /nested_admin/
Disallow /select2/
Disallow /cms_wizard/
Disallow /imagegallery*/
Disallow /swf/
Disallow /preview/newsletter/
Disallow /redesign/
Disallow /facts/
Disallow /datenschutz-faq/
Disallow /gesundheitsratgeber/

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.netdoktor.de/sitemap.xml