choosesmoothies.com
robots.txt
Robots Exclusion Standard data for choosesmoothies.com
Resource Scan
Scan Details
Site Domain | choosesmoothies.com |
Base Domain | choosesmoothies.com |
Scan Status | Ok |
Last Scan | 2025-03-07T06:39:40+00:00 |
Next Scan | 2025-03-14T06:39:40+00:00 |
Last Scan
Scanned | 2025-03-07T06:39:40+00:00 |
URL | https://choosesmoothies.com/robots.txt |
Domain IPs | 104.21.12.77, 172.67.151.231, 2606:4700:3033::6815:c4d, 2606:4700:3034::ac43:97e7 |
Response IP | 172.67.151.231 |
Found | Yes |
Hash | 814bd9b75cc8b6bf356b2a75d8e1fc5fc3a90d347de57b35e0ab9a53c67fe4f6 |
SimHash | 6159d3455dd3 |
Groups
*
Rule | Path |
---|---|
Disallow | |
Disallow | /cgi-bin/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.choosesmoothies.com/sitemap.xml |
Warnings
- 1 invalid line.