bnn.de
robots.txt

Robots Exclusion Standard data for bnn.de

Resource Scan

Scan Details

Site Domain bnn.de
Base Domain bnn.de
Scan Status Ok
Last Scan2024-11-13T18:12:47+00:00
Next Scan 2024-11-20T18:12:47+00:00

Last Scan

Scanned2024-11-13T18:12:47+00:00
URL https://bnn.de/robots.txt
Domain IPs 3.126.95.217, 52.28.29.17
Response IP 3.126.95.217
Found Yes
Hash 0afe1d63683f46fda3cfbddbe17af59a16a4b364e08fb58f22f83bc94d67335e
SimHash 121459118413

Groups

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

meltwater

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bnn.de/sitemap/sitemap_index.xml