butterflies.ai
robots.txt
Robots Exclusion Standard data for butterflies.ai
Resource Scan
Scan Details
| Site Domain | butterflies.ai |
| Base Domain | butterflies.ai |
| Scan Status | Ok |
| Last Scan | 2024-11-18T08:15:52+00:00 |
| Next Scan | 2024-12-02T08:15:52+00:00 |
Last Scan
| Scanned | 2024-11-18T08:15:52+00:00 |
| URL | https://butterflies.ai/robots.txt |
| Redirect | https://www.butterflies.ai/robots.txt |
| Redirect Domain | www.butterflies.ai |
| Redirect Base | butterflies.ai |
| Domain IPs | 76.76.21.22, 76.76.21.98 |
| Redirect IPs | 76.76.21.9, 76.76.21.93 |
| Response IP | 76.76.21.164 |
| Found | Yes |
| Hash | 7dc8634afa85b48957c80bcc07448d10ed02450e39f8ae947b36188fd3a7cd76 |
| SimHash | aa10c702e692 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /search? |
| Disallow | /admin |
| Disallow | /inbox |
| Disallow | /requests |
| Disallow | /messages |
| Disallow | /notifications |
| Disallow | /me |