divuni.com
robots.txt
Robots Exclusion Standard data for divuni.com
Resource Scan
Scan Details
| Site Domain | divuni.com |
| Base Domain | divuni.com |
| Scan Status | Ok |
| Last Scan | 2025-04-19T10:40:49+00:00 |
| Next Scan | 2025-04-26T10:40:49+00:00 |
Last Scan
| Scanned | 2025-04-19T10:40:49+00:00 |
| URL | https://divuni.com/robots.txt |
| Domain IPs | 104.21.22.131, 172.67.205.20, 2606:4700:3033::ac43:cd14, 2606:4700:3034::6815:1683 |
| Response IP | 104.21.22.131 |
| Found | Yes |
| Hash | c4839f12e1db359c26a919442ef130fa223ab953bca2921bf046ce33cb8717a7 |
| SimHash | 090e9152879b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /admin-center |
| Disallow | /admin-center/ |
| Disallow | /account-center |
| Disallow | /account-center/ |
| Disallow | /plugins/ |
| Disallow | /login/new |
| Disallow | /login/new/ |
| Disallow | /ajax/ |
| Disallow | /contact/new/ |
| Disallow | /questions/getSimilarQuestionsListRender/ |
| Disallow | /signup/new/ |
| Disallow | /thoughts/ |
| Disallow | /forgot/ |
| Disallow | /reset-password/ |
| Disallow | /cdn-cgi/ |
| Disallow | /notifications/ |
| Disallow | /user_notifications/mark_all_as_read/ |
| Disallow | /user_notifications/ |
| Disallow | /daily-questions/ |
| Disallow | /watchers/ |
| Disallow | /comments/ |
| Disallow | /forgot/ |
| Disallow | /search/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://divuni.com/sitemap.xml |
| sitemap | https://divuni.com/sitemap_base.xml |
| sitemap | https://divuni.com/sitemap_content.xml |