datensen.com
robots.txt
Robots Exclusion Standard data for datensen.com
Resource Scan
Scan Details
| Site Domain | datensen.com |
| Base Domain | datensen.com |
| Scan Status | Ok |
| Last Scan | 2025-10-21T11:34:23+00:00 |
| Next Scan | 2025-11-20T11:34:23+00:00 |
Last Scan
| Scanned | 2025-10-21T11:34:23+00:00 |
| URL | https://datensen.com/robots.txt |
| Redirect | https://www.datensen.com/robots.txt |
| Redirect Domain | www.datensen.com |
| Redirect Base | datensen.com |
| Domain IPs | 217.198.114.175, 2a00:19a0:3:72:0:d9c6:72af:1 |
| Redirect IPs | 217.198.114.175, 2a00:19a0:3:72:0:d9c6:72af:1 |
| Response IP | 217.198.114.175 |
| Found | Yes |
| Hash | 3fd8731914263c5bf9c095835fabd1f70e3355cccb383f20ffa7e5f1e3e515c3 |
| SimHash | 8b19fc25cb81 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin/ |
| Disallow | /api/ |
| Disallow | /archive/ |
| Disallow | /classes/ |
| Disallow | /config/ |
| Disallow | /dist/ |
| Disallow | /downloads/ |
| Disallow | /moonmodeler/ |
| Disallow | /meteormodeler/ |
| Disallow | /tests/ |
| Disallow | /builds/ |
| Disallow | /mgm/ |
| Disallow | /mgmstaging/ |
| Disallow | /feedback/ |
| Disallow | /files/ |
| Disallow | /errorlog/ |
| Disallow | /service/ |
| Disallow | /cron/ |
| Disallow | /mailer/ |
| Disallow | /newsletters/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.datensen.com/sitemap.xml |
| sitemap | https://www.datensen.com/blog/page-sitemap.xml |
| sitemap | https://www.datensen.com/blog/post-sitemap.xml |