piesystems.io
robots.txt
Robots Exclusion Standard data for piesystems.io
Resource Scan
Scan Details
| Site Domain | piesystems.io |
| Base Domain | piesystems.io |
| Scan Status | Ok |
| Last Scan | 2025-08-12T08:17:32+00:00 |
| Next Scan | 2025-08-26T08:17:32+00:00 |
Last Scan
| Scanned | 2025-08-12T08:17:32+00:00 |
| URL | https://piesystems.io/robots.txt |
| Domain IPs | 104.26.0.228, 104.26.1.228, 172.67.69.28, 2606:4700:20::681a:1e4, 2606:4700:20::681a:e4, 2606:4700:20::ac43:451c |
| Response IP | 104.26.1.228 |
| Found | Yes |
| Hash | 1652f6af30a16c0c5e65109dcc53aeb55658c61fcbc9fdb301262b7a2aab3ed0 |
| SimHash | 82588d859f61 |
Groups
*
mozilla/5.0 (compatible; hubspot crawler; web-crawlers@hubspot.com)
| Rule | Path |
|---|---|
| Allow | /$ |
| Allow | /?*$ |
| Allow | /merchants |
| Allow | /travelers |
| Allow | /apps |
| Allow | /jp |
| Allow | /e-commerce |
| Allow | /careers |
| Allow | /about |
| Allow | /users/sign_up |
| Allow | /signup |
| Allow | /privacy-policy |
| Allow | /terms-and-conditions |
| Allow | /sitemap.xml |
| Disallow | / |
Comments