braunschweiger-zeitung.de
robots.txt

Robots Exclusion Standard data for braunschweiger-zeitung.de

Resource Scan

Scan Details

Site Domain braunschweiger-zeitung.de
Base Domain braunschweiger-zeitung.de
Scan Status Ok
Last Scan2024-05-25T03:12:48+00:00
Next Scan 2024-06-01T03:12:48+00:00

Last Scan

Scanned2024-05-25T03:12:48+00:00
URL https://braunschweiger-zeitung.de/robots.txt
Redirect https://www.braunschweiger-zeitung.de:443/robots.txt
Redirect Domain www.braunschweiger-zeitung.de
Redirect Base braunschweiger-zeitung.de
Domain IPs 18.185.81.127, 18.196.221.37, 3.72.121.83
Redirect IPs 18.155.68.106, 18.155.68.110, 18.155.68.31, 18.155.68.84, 2600:9000:23d2:7a00:5:7e4d:58c0:93a1, 2600:9000:23d2:8000:5:7e4d:58c0:93a1, 2600:9000:23d2:8200:5:7e4d:58c0:93a1, 2600:9000:23d2:bc00:5:7e4d:58c0:93a1, 2600:9000:23d2:da00:5:7e4d:58c0:93a1, 2600:9000:23d2:dc00:5:7e4d:58c0:93a1, 2600:9000:23d2:e200:5:7e4d:58c0:93a1, 2600:9000:23d2:fa00:5:7e4d:58c0:93a1
Response IP 18.155.68.106
Found Yes
Hash 1f974abecf3e397b352e01f911fbb8ed01c323a62b7402c849d86b13b3438d5b
SimHash b014d877cf51

Groups

*

Rule Path
Allow /static/*/client.js
Allow /static/*/main.css
Allow /static/*/favicon.png
Disallow /stats/*
Disallow /*?config*
Disallow /*.xmli*
Disallow /*?service=Ajax
Disallow /*?service=ajax
Disallow /config/*
Disallow /test/*
Disallow /Test/*
Disallow /template/*
Disallow /*?*token=*
Disallow /*?*eventId=*
Disallow /static/*
Disallow /migration_import_no_section/*
Disallow /secure/
Disallow /socialmedia/*
Disallow *reader_id%3DREADER_ID*
Disallow /suche/*
Disallow /*?widgetid=
Disallow /newsletter-result/
Disallow *tpcc%3D*
Disallow /resources/
Disallow /bin/
Disallow /service/newsletter-adconsent
Disallow /pagespeed_static/
Disallow /resources/img/*icon*pagespeed

cliqzbot

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

flamingo_searchengine

Rule Path
Disallow /

audisto

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.braunschweiger-zeitung.de/sitemaps/news.xml