cleandefirms.de
robots.txt

Robots Exclusion Standard data for cleandefirms.de

Resource Scan

Scan Details

Site Domain cleandefirms.de
Base Domain cleandefirms.de
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-08-14T22:07:40+00:00
Next Scan 2025-11-12T22:07:40+00:00

Last Successful Scan

Scanned2024-07-21T22:04:22+00:00
URL http://cleandefirms.de/robots.txt
Domain IPs 5.45.64.156
Response IP 5.45.64.156
Found Yes
Hash d63df5fe3c03bf8a7ca6c33f273478b4c783bc9ff49f9df6eb5a11cb4cb38573
SimHash 25346b006736

Groups

*

Rule Path
Disallow /add/
Disallow /pages/
Disallow /edit/

Comments

  • www.robotstxt.org/
  • Allow crawling of all content