parsel.ai
robots.txt
Robots Exclusion Standard data for parsel.ai
Resource Scan
Scan Details
| Site Domain | parsel.ai |
| Base Domain | parsel.ai |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a server error. |
| Last Scan | 2024-05-30T04:05:35+00:00 |
| Next Scan | 2024-08-28T04:05:35+00:00 |
Last Successful Scan
| Scanned | 2024-01-09T00:13:49+00:00 |
| URL | https://parsel.ai/robots.txt |
| Domain IPs | 13.33.33.107, 13.33.33.128, 13.33.33.59, 13.33.33.79 |
| Response IP | 3.160.188.79 |
| Found | Yes |
| Hash | 308afd8c72b4c0673da248ba51b040a43fe93deb1223fa9398144ce4c1200a8f |
| SimHash | 4b47b50809b3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /billing-history |
| Disallow | /bundles/* |
| Disallow | /datasets |
| Disallow | /first-log-in |
| Disallow | /plans/* |
| Disallow | /profile |
| Disallow | /reset-password |
| Disallow | /signUp/activation |
| Disallow | /signUp/details |
| Disallow | /signUp-confirm |
| Disallow | /token-expired |
| Disallow | /unsupported-browser |
| Disallow | /upgrade/* |
| Disallow | /logIn |
| Disallow | /forgot-password |
Other Records
| Field | Value |
|---|---|
| sitemap | https://parsel.ai/sitemap.xml |