organiclifestyle.com
robots.txt
Robots Exclusion Standard data for organiclifestyle.com
Resource Scan
Scan Details
Site Domain | organiclifestyle.com |
Base Domain | organiclifestyle.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-08-15T12:45:49+00:00 |
Next Scan | 2024-11-13T12:45:49+00:00 |
Last Successful Scan
Scanned | 2024-03-26T12:35:36+00:00 |
URL | https://organiclifestyle.com/robots.txt |
Domain IPs | 104.26.12.222, 104.26.13.222, 172.67.71.247, 2606:4700:20::681a:cde, 2606:4700:20::681a:dde, 2606:4700:20::ac43:47f7 |
Response IP | 104.26.13.222 |
Found | Yes |
Hash | dab8f6ac0ff111c3d183b7e20936b435053a46067bf5636024dcb20a7ee8b7df |
SimHash | 325e145189ee |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
googlebot
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /cli/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /tmp/ |
Disallow | /j25b/ |
Disallow | /j375 |
Disallow | /home |
Disallow | /root |
Disallow | /shop |
Disallow | /index2.php |
Disallow | /?currency_code= |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
*
Rule | Path |
---|---|
Disallow | /administrator/ |
Disallow | /cli/ |
Disallow | /components/ |
Disallow | /includes/ |
Disallow | /language/ |
Disallow | /libraries/ |
Disallow | /logs/ |
Disallow | /tmp/ |
Disallow | /j25b/ |
Disallow | /j375 |
Disallow | /home |
Disallow | /shop |
Disallow | /index2.php |
Disallow | /?currency_code= |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Other Records
Field | Value |
---|---|
sitemap | https://organiclifestyle.com/index.php?option=com_osmap&view=xml&tmpl=component&id=1 |
sitemap | https://organiclifestyle.com/blog/sitemap_index.xml |
Warnings
- 2 invalid lines.
Comments