todoist.com
robots.txt
Robots Exclusion Standard data for todoist.com
Resource Scan
Scan Details
| Site Domain | todoist.com |
| Base Domain | todoist.com |
| Scan Status | Ok |
| Last Scan | 2024-04-30T06:30:52+00:00 |
| Next Scan | 2024-05-14T06:30:52+00:00 |
Last Scan
| Scanned | 2024-04-30T06:30:52+00:00 |
| URL | https://todoist.com/robots.txt |
| Domain IPs | 13.33.30.11, 13.33.30.33, 13.33.30.8, 13.33.30.98, 2600:9000:2135:1800:1d:b016:1bc0:93a1, 2600:9000:2135:2c00:1d:b016:1bc0:93a1, 2600:9000:2135:3000:1d:b016:1bc0:93a1, 2600:9000:2135:7600:1d:b016:1bc0:93a1, 2600:9000:2135:8200:1d:b016:1bc0:93a1, 2600:9000:2135:b600:1d:b016:1bc0:93a1, 2600:9000:2135:c800:1d:b016:1bc0:93a1, 2600:9000:2135:e400:1d:b016:1bc0:93a1 |
| Response IP | 13.33.30.98 |
| Found | Yes |
| Hash | f604b53ba6731b48df33dcdba9ed3725cfa279c7ab26af90dc9bdd35474eb6b2 |
| SimHash | 7500d6752511 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /app |
| Disallow | /api |
| Disallow | /API |
| Disallow | /sync |
| Disallow | /rest |
| Disallow | /showTask |
| Disallow | /showProject |
| Disallow | /review_json |
| Disallow | /psaccent/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://todoist.com/sitemap.xml |
| sitemap | https://todoist.com/static/sitemap-legacy.xml |
| sitemap | https://todoist.com/inspiration/sitemap.xml |
Warnings
- `host` is not a known field.
Comments