manager-magazin.de
robots.txt

Robots Exclusion Standard data for manager-magazin.de

Resource Scan

Scan Details

Site Domain manager-magazin.de
Base Domain manager-magazin.de
Scan Status Ok
Last Scan2024-06-06T20:29:24+00:00
Next Scan 2024-06-13T20:29:24+00:00

Last Scan

Scanned2024-06-06T20:29:24+00:00
URL https://manager-magazin.de/robots.txt
Redirect https://www.manager-magazin.de/robots.txt
Redirect Domain www.manager-magazin.de
Redirect Base manager-magazin.de
Domain IPs 34.102.172.215
Redirect IPs 128.65.210.186
Response IP 128.65.210.186
Found Yes
Hash 06499f1b888f56edfb78500458ef526e0b23d8b99428fdc02f47659131cf2be2
SimHash b234045acdab

Groups

*

Rule Path
Allow /
Disallow /*CR-Dokumentation.pdf$

mozilla/5.0 (compatible; ogdwctxcrawler)

Rule Path
Allow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

sirdatabot

Rule Path
Disallow /

lcc

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.manager-magazin.de/sitemaps/news-de.xml
sitemap https://www.manager-magazin.de/sitemaps/videos/sitemap.xml
sitemap https://www.manager-magazin.de/plus/sitemap.xml
sitemap https://www.manager-magazin.de/sitemap.xml

Comments

  • Legal notice: manager-magazin.de expressly reserves the right to use its content for commercial text and data mining (ยง 44b Urheberrechtsgesetz).
  • The use of robots or other automated means to access manager-magazin.de or collect or mine data without the express permission of spiegel.de is strictly prohibited.
  • manager-magazin.de may, in its discretion, permit certain automated access to certain spiegel.de pages,
  • If you would like to apply for permission to crawl manager-magazin.de, collect or use data, please email syndication@manager-magazin.de