kaufsonntag.de
robots.txt

Robots Exclusion Standard data for kaufsonntag.de

Resource Scan

Scan Details

Site Domain kaufsonntag.de
Base Domain kaufsonntag.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-01T21:08:38+00:00
Next Scan 2024-06-30T21:08:38+00:00

Last Successful Scan

Scanned2024-03-03T21:06:15+00:00
URL https://kaufsonntag.de/robots.txt
Redirect https://www.kaufsonntag.de/robots.txt
Redirect Domain www.kaufsonntag.de
Redirect Base kaufsonntag.de
Domain IPs 85.13.161.23
Redirect IPs 85.13.161.23
Response IP 85.13.161.23
Found Yes
Hash a896fc8990bf3940d72cbcd057c565f0491d5190ff6aea706e2907af0c8083bf
SimHash 0080d1418031

Groups

semrushbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /intern/
Disallow /intern/impressum/
Disallow /intern/datenschutz/
Disallow /intern/editor/
Disallow /files/
Disallow /rw_commons/
Disallow /sandbox/
Disallow /82CBC314-79F0-4BF5-B6F1-D4F2BF6CD40E_rwbackup/
Disallow /baumaerkte/files/
Disallow /baumaerkte/rw_commons/

Other Records

Field Value
sitemap https://www.kaufsonntag.de/sitemap.xml
sitemap https://www.kaufsonntag.de/baumaerkte/sitemap.xml
sitemap https://www.kaufsonntag.de/aktuelle-news/rss.xml

Comments

  • robots.txt von https://www.kaufsonntag.de