buffet-brunch.de
robots.txt

Robots Exclusion Standard data for buffet-brunch.de

Resource Scan

Scan Details

Site Domain buffet-brunch.de
Base Domain buffet-brunch.de
Scan Status Ok
Last Scan2024-09-27T17:36:29+00:00
Next Scan 2024-10-04T17:36:29+00:00

Last Scan

Scanned2024-09-27T17:36:29+00:00
URL https://buffet-brunch.de/robots.txt
Domain IPs 185.232.68.108
Response IP 185.232.68.108
Found Yes
Hash 7eb6f463548b7f3f3420aa53c388232db4b26b5d640cf5a31041d9183c2c2f74
SimHash 0904e44ac916

Groups

turnitinbot

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

surveybot_ignoreip

Rule Path
Disallow /

ips-agent

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

urlpulse

Rule Path
Disallow /

pixray-seeker

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /*/*/*
Disallow /*?*

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Warnings

  • `noarchive` is not a known field.