aerztezeitung.de
robots.txt

Robots Exclusion Standard data for aerztezeitung.de

Resource Scan

Scan Details

Site Domain aerztezeitung.de
Base Domain aerztezeitung.de
Scan Status Ok
Last Scan2024-11-09T09:44:25+00:00
Next Scan 2024-11-16T09:44:25+00:00

Last Scan

Scanned2024-11-09T09:44:25+00:00
URL https://aerztezeitung.de/robots.txt
Redirect https://www.aerztezeitung.de/robots.txt
Redirect Domain www.aerztezeitung.de
Redirect Base aerztezeitung.de
Domain IPs 195.128.8.58
Redirect IPs 195.128.8.58
Response IP 195.128.8.58
Found Yes
Hash 97289044198810811fe8fbd616b0e8248a5ec98bccf9871b0ee248024e1860f9
SimHash af1c1e54c453

Groups

*

Rule Path
Disallow /*?bPrint=true
Disallow /User/
Disallow /Custom/Modules
Disallow /*?error-login
Disallow /*?error-notfound
Disallow /Dateien/
Disallow /Sso/
Disallow /E-Paper/

meltwater
newsnow
semrushbot-sa
flamingo_searchengine
audisto
bloodhound
cydralspider
downloadexpress
gammaspider
objectssearch
pimptrain
raven
wapspider
webzinger
fasterfox
sentibot
baiduspider
ahrefsbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.aerztezeitung.de/Sitemap_Index.xml.gz

Comments

  • robots.txt updated 2020-02-21