wilio.co.il
robots.txt
Robots Exclusion Standard data for wilio.co.il
Resource Scan
Scan Details
| Site Domain | wilio.co.il |
| Base Domain | wilio.co.il |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2025-03-13T13:31:35+00:00 |
| Next Scan | 2025-06-11T13:31:35+00:00 |
Last Successful Scan
| Scanned | 2023-05-19T19:30:16+00:00 |
| URL | https://wilio.co.il/robots.txt |
| Redirect | https://www.wilio.co.il/robots.txt |
| Redirect Domain | www.wilio.co.il |
| Redirect Base | wilio.co.il |
| Domain IPs | 104.21.73.41, 172.67.140.29, 2606:4700:3033::ac43:8c1d, 2606:4700:3034::6815:4929 |
| Redirect IPs | 104.21.73.41, 172.67.140.29, 2606:4700:3033::ac43:8c1d, 2606:4700:3034::6815:4929 |
| Response IP | 172.67.140.29 |
| Found | Yes |
| Hash | 685d71b8a87e12c85a4647a3e082f2bc2b227de23a8ba1fe12287047e6e93ac1 |
| SimHash | 6900fb43ae3b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /register |
| Disallow | /registration |
| Disallow | /login |
| Disallow | /forgotten-password |
| Disallow | /logout |
| Disallow | /verify-email |
| Disallow | /my-projects |
| Disallow | /new-demand |
| Disallow | /app/ |
| Disallow | /sp/ |
| Disallow | /blog |
| Disallow | /category/ |
| Disallow | /webapp/ |
| Allow | /ads.txt |
| Allow | /app-ads.txt |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.wilio.co.il/sitemap.xml |