docsity.com
robots.txt
Robots Exclusion Standard data for docsity.com
Resource Scan
Scan Details
| Site Domain | docsity.com |
| Base Domain | docsity.com |
| Scan Status | Ok |
| Last Scan | 2024-10-20T00:54:37+00:00 |
| Next Scan | 2024-11-19T00:54:37+00:00 |
Last Scan
| Scanned | 2024-10-20T00:54:37+00:00 |
| URL | https://docsity.com/robots.txt |
| Redirect | https://www.docsity.com/robots.txt |
| Redirect Domain | www.docsity.com |
| Redirect Base | docsity.com |
| Domain IPs | 13.35.238.110, 13.35.238.22, 13.35.238.28, 13.35.238.75 |
| Redirect IPs | 104.18.14.64, 104.18.15.64, 2606:4700::6812:e40, 2606:4700::6812:f40 |
| Response IP | 104.18.14.64 |
| Found | Yes |
| Hash | fb2dfd9601a7fa0cddfd1d69ce09ac675919bf6376a4556d6e4028a83654d550 |
| SimHash | 651673227721 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wordpress/ |
| Disallow | /uploads/ |
| Disallow | /it-docs/ |
| Disallow | /es-docs/ |
| Disallow | /en-docs/ |
| Disallow | /sr-docs/ |
| Disallow | /pl-docs/ |
| Disallow | /ru-docs/ |
| Disallow | /pt-docs/ |
| Disallow | /fr-docs/ |
| Disallow | /de-docs/ |
| Disallow | /it-video/ |
| Disallow | /es-video/ |
| Disallow | /en-video/ |
| Disallow | /sr-video/ |
| Disallow | /pl-video/ |
| Disallow | /ru-video/ |
| Disallow | /pt-video/ |
| Disallow | /fr-video/ |
| Disallow | /de-video/ |
| Disallow | /documents_pages/ |
| Disallow | */dashboard* |
| Disallow | */account/* |
| Disallow | *?show_login |
| Disallow | *escaped_fragment* |
| Disallow | *?fb* |
| Disallow | *?_pxhc=* |
| Disallow | *store%3D* |
| Disallow | *?qId=* |
| Disallow | */search* |
| Disallow | */profilo/* |
| Disallow | */perfil/* |
| Disallow | */profile/* |
| Disallow | */profil/* |
| Disallow | /en/university/ |
| Allow | /en/university/us |
| Allow | /en/university/gb |
| Allow | /en/university/in |
| Disallow | /fr/professeurs/ |
| Disallow | /ru/professora/ |
| Disallow | /sr/profesori/ |
| Disallow | /pl/profesorowie/ |
Comments