volksfreund.de
robots.txt

Robots Exclusion Standard data for volksfreund.de

Resource Scan

Scan Details

Site Domain volksfreund.de
Base Domain volksfreund.de
Scan Status Ok
Last Scan2024-05-26T15:26:35+00:00
Next Scan 2024-06-02T15:26:35+00:00

Last Scan

Scanned2024-05-26T15:26:35+00:00
URL https://volksfreund.de/robots.txt
Redirect https://www.volksfreund.de/robots.txt
Redirect Domain www.volksfreund.de
Redirect Base volksfreund.de
Domain IPs 104.18.10.203, 104.18.11.203
Redirect IPs 104.18.10.203, 104.18.11.203
Response IP 104.18.10.203
Found Yes
Hash 8bf7ae2d01e45ef778d21e939c16397c7ef3655742b5f6c29fe53d4d296e0d1f
SimHash 681d7c3881b3

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /check_area/
Disallow /sso/
Disallow /soko/
Disallow /suche/
Disallow /app/consent/
Disallow /api/
Disallow /auth/
Disallow /*?entitlement=*
Disallow /*?output=*

Other Records

Field Value
sitemap https://www.volksfreund.de/sitemap.xml
sitemap https://www.volksfreund.de/sitemap-news.xml
sitemap https://www.volksfreund.de/sitemap-image.xml.gz
sitemap https://www.volksfreund.de/sitemap-video.xml.gz
sitemap https://www.volksfreund.de/sitemap-dossier.xml.gz