die-konjugation.de
robots.txt

Robots Exclusion Standard data for die-konjugation.de

Resource Scan

Scan Details

Site Domain die-konjugation.de
Base Domain die-konjugation.de
Scan Status Ok
Last Scan2025-05-06T19:59:22+00:00
Next Scan 2025-05-13T19:59:22+00:00

Last Scan

Scanned2025-05-06T19:59:22+00:00
URL https://www.die-konjugation.de/robots.txt
Domain IPs 54.38.64.157
Response IP 54.38.64.157
Found Yes
Hash 6dcfba768524d3ec97c1faa8a2848c3fecfd4c5e8f53b2ad171900fdc19ec979
SimHash 5110c940e510

Groups

*

Rule Path
Allow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /