redensarten-index.de
robots.txt

Robots Exclusion Standard data for redensarten-index.de

Resource Scan

Scan Details

Site Domain redensarten-index.de
Base Domain redensarten-index.de
Scan Status Ok
Last Scan2024-06-29T00:55:48+00:00
Next Scan 2024-07-06T00:55:48+00:00

Last Scan

Scanned2024-06-29T00:55:48+00:00
URL https://redensarten-index.de/robots.txt
Redirect https://www.redensarten-index.de/robots.txt
Redirect Domain www.redensarten-index.de
Redirect Base redensarten-index.de
Domain IPs 2a00:f48:2000:affe::50, 91.216.248.20, 91.216.248.22, 91.216.248.23
Redirect IPs 2a00:f48:2000:affe::50, 91.216.248.20, 91.216.248.22, 91.216.248.23
Response IP 91.216.248.23
Found Yes
Hash e6d3d79e5f3f08b88a97e73d5f20b81ac277c11d2ba3cd924f81fff43686800c
SimHash 5d1d4970e480

Groups

perplexitybot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

openai

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

*

Rule Path
Disallow /details.php
Disallow /*%26page%3D*

Other Records

Field Value
sitemap https://www.redensarten-index.de/sitemap-rart.xml
sitemap https://www.redensarten-index.de/sitemap-rart2.xml
sitemap https://www.redensarten-index.de/sitemap-erl.xml
sitemap https://www.redensarten-index.de/sitemap-erl2.xml
sitemap https://www.redensarten-index.de/sitemap-allg.xml
sitemap https://www.redensarten-index.de/sitemap-uber.xml
sitemap https://www.redensarten-index.de/sitemap-synonyme.xml