wren.co
robots.txt
Robots Exclusion Standard data for wren.co
Resource Scan
Scan Details
Site Domain | wren.co |
Base Domain | wren.co |
Scan Status | Ok |
Last Scan | 2024-06-18T19:57:23+00:00 |
Next Scan | 2024-07-18T19:57:23+00:00 |
Last Scan
Scanned | 2024-06-18T19:57:23+00:00 |
URL | https://wren.co/robots.txt |
Redirect | https://www.wren.co/robots.txt |
Redirect Domain | www.wren.co |
Redirect Base | wren.co |
Domain IPs | 3.220.40.113 |
Redirect IPs | 23.22.5.68, 3.226.182.14, 52.21.227.162, 54.237.159.171 |
Response IP | 54.237.159.171 |
Found | Yes |
Hash | b62113c7ac94136e0119e87fbe61ef606b20c8266aea8f4bbb2f571ed1697f34 |
SimHash | c879d1427110 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/ |
Disallow | /choose-plan |
Disallow | *checkout* |
Disallow | /public-footprint/* |
Disallow | /footprint/* |
Disallow | /blog/posts/how-3-silicon-valley-whiz-kids-are-saving-the-planet |
Disallow | /article |