greenchef.nl
robots.txt
Robots Exclusion Standard data for greenchef.nl
Resource Scan
Scan Details
Site Domain | greenchef.nl |
Base Domain | greenchef.nl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-16T12:42:15+00:00 |
Next Scan | 2024-08-14T12:42:15+00:00 |
Last Successful Scan
Scanned | 2023-10-13T12:37:34+00:00 |
URL | https://greenchef.nl/robots.txt |
Redirect | https://www.greenchef.nl:443/robots.txt |
Redirect Domain | www.greenchef.nl |
Redirect Base | greenchef.nl |
Domain IPs | 54.194.107.200, 54.72.109.176, 54.76.66.113 |
Redirect IPs | 104.18.41.245, 172.64.146.11, 2606:4700:4400::6812:29f5, 2606:4700:4400::ac40:920b |
Response IP | 104.18.41.245 |
Found | Yes |
Hash | 52b1f5b6b29fa42cb6c3b043b771687813f271c4a7144792939b19549b147080 |
SimHash | 0934da7421e6 |
Groups
*
Rule | Path |
---|---|
Disallow | /faq?* |
Disallow | /whitelabel/faq?* |
Disallow | /plans |
Disallow | /weekly-menu/* |
Disallow | /settings/* |
Disallow | /forgotpassword/* |
Disallow | /logout/* |
Disallow | /*?*email= |
Disallow | /*?*resetKey= |
Disallow | /*?*u= |
Other Records
Field | Value |
---|---|
sitemap | https://www.greenchef.nl/sitemap.xml |