gutekueche.de
robots.txt

Robots Exclusion Standard data for gutekueche.de

Resource Scan

Scan Details

Site Domain gutekueche.de
Base Domain gutekueche.de
Scan Status Ok
Last Scan2024-06-23T05:38:07+00:00
Next Scan 2024-06-30T05:38:07+00:00

Last Scan

Scanned2024-06-23T05:38:07+00:00
URL https://gutekueche.de/robots.txt
Redirect https://www.gutekueche.de/robots.txt
Redirect Domain www.gutekueche.de
Redirect Base gutekueche.de
Domain IPs 62.138.179.246
Redirect IPs 62.138.179.246
Response IP 62.138.179.246
Found Yes
Hash 105272c042175e38b0b5a686a5a767906327786fd59ebd7ccf173bfa4d32bd69
SimHash 7055d954a193

Groups

*

Rule Path
Disallow /user/
Disallow /suche
Disallow /api/*

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://cdn.gutekueche.de/sitemaps/sitemap.xml.gz