parsel.ai
robots.txt
Robots Exclusion Standard data for parsel.ai
Resource Scan
Scan Details
Site Domain | parsel.ai |
Base Domain | parsel.ai |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-08-28T04:05:41+00:00 |
Next Scan | 2024-11-26T04:05:41+00:00 |
Last Successful Scan
Scanned | 2024-01-09T00:13:49+00:00 |
URL | https://parsel.ai/robots.txt |
Domain IPs | 13.33.33.107, 13.33.33.128, 13.33.33.59, 13.33.33.79 |
Response IP | 3.160.188.79 |
Found | Yes |
Hash | 308afd8c72b4c0673da248ba51b040a43fe93deb1223fa9398144ce4c1200a8f |
SimHash | 4b47b50809b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /billing-history |
Disallow | /bundles/* |
Disallow | /datasets |
Disallow | /first-log-in |
Disallow | /plans/* |
Disallow | /profile |
Disallow | /reset-password |
Disallow | /signUp/activation |
Disallow | /signUp/details |
Disallow | /signUp-confirm |
Disallow | /token-expired |
Disallow | /unsupported-browser |
Disallow | /upgrade/* |
Disallow | /logIn |
Disallow | /forgot-password |
Other Records
Field | Value |
---|---|
sitemap | https://parsel.ai/sitemap.xml |