computerwoche.de
robots.txt

Robots Exclusion Standard data for computerwoche.de

Resource Scan

Scan Details

Site Domain computerwoche.de
Base Domain computerwoche.de
Scan Status Ok
Last Scan2024-06-06T20:17:24+00:00
Next Scan 2024-06-13T20:17:24+00:00

Last Scan

Scanned2024-06-06T20:17:24+00:00
URL https://computerwoche.de/robots.txt
Redirect https://www.computerwoche.de/robots.txt
Redirect Domain www.computerwoche.de
Redirect Base computerwoche.de
Domain IPs 13.33.252.112, 13.33.252.81, 13.33.252.91, 13.33.252.94, 2600:9000:260f:0:1c:f7aa:4540:93a1, 2600:9000:260f:1400:1c:f7aa:4540:93a1, 2600:9000:260f:2200:1c:f7aa:4540:93a1, 2600:9000:260f:4200:1c:f7aa:4540:93a1, 2600:9000:260f:6200:1c:f7aa:4540:93a1, 2600:9000:260f:9400:1c:f7aa:4540:93a1, 2600:9000:260f:c200:1c:f7aa:4540:93a1, 2600:9000:260f:c800:1c:f7aa:4540:93a1
Redirect IPs 2600:9000:260f:1200:1c:f7aa:4540:93a1, 2600:9000:260f:1800:1c:f7aa:4540:93a1, 2600:9000:260f:800:1c:f7aa:4540:93a1, 2600:9000:260f:8800:1c:f7aa:4540:93a1, 2600:9000:260f:8c00:1c:f7aa:4540:93a1, 2600:9000:260f:9200:1c:f7aa:4540:93a1, 2600:9000:260f:9e00:1c:f7aa:4540:93a1, 2600:9000:260f:f000:1c:f7aa:4540:93a1, 3.163.125.104, 3.163.125.31, 3.163.125.71, 3.163.125.98
Response IP 3.160.246.59
Found Yes
Hash e07905870b46d13c0443d15bc8b4614f1f75c811c10da6c07435993910c1e565
SimHash 6323da53c731

Groups

*

Rule Path
Disallow /a/navigate/*
Disallow /a/print/*
Disallow /admin/*
Disallow /assets/galleries/*
Disallow /fileserver/*
Disallow /g/ajax/ad
Disallow /global/ajax/*
Disallow /global/loginState
Disallow /global/showlogin
Disallow /ls/*
Disallow /p/software-archiv%2C829*
Disallow /p/stellenmarkt%2C3484*
Disallow /p/suche
Disallow /pt/ajax/navigation/
Disallow /p/cwo-home%2C253
Disallow /7503
Disallow /8456

mediapartners-google*

Rule Path
Allow /

rogerbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.computerwoche.de/sitemaps/sitemap_index_cwo.xml
sitemap https://www.computerwoche.de/sitemaps/sitemapnews_cwo.xml
sitemap https://www.computerwoche.de/sitemaps/sitemapvideos_cwo.xml

Comments

  • Adcodes