knowinsiders.com
robots.txt
Robots Exclusion Standard data for knowinsiders.com
Resource Scan
Scan Details
| Site Domain | knowinsiders.com |
| Base Domain | knowinsiders.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T18:37:28+00:00 |
| Next Scan | 2024-11-19T18:37:28+00:00 |
Last Scan
| Scanned | 2024-11-12T18:37:28+00:00 |
| URL | https://knowinsiders.com/robots.txt |
| Domain IPs | 104.21.235.141, 104.21.235.142, 2606:4700:3038::6815:eb8d, 2606:4700:3038::6815:eb8e |
| Response IP | 104.21.235.141 |
| Found | Yes |
| Hash | 58ca19d64b77542997b52dd1eed143fc53231860d7294a1541c8f320e87f4669 |
| SimHash | 094cfc646bb5 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /ajax/ |
| Disallow | /sp/ |
| Disallow | /services/ |
| Disallow | /utilities/ |
| Disallow | /Ajax/ |
| Disallow | /SP/ |
| Disallow | /Services/ |
| Disallow | /Utilities/ |
| Disallow | /apiservice%40/ |
| Disallow | /apicenter%40/ |
| Disallow | /widgets%40/ |
| Disallow | /member.api/ |
| Disallow | /preview_article/ |
| Disallow | /stats/ |
| Disallow | /slie/ |
| Disallow | /article/ |
| Disallow | /login/ |
| Disallow | /administrator/ |
| Disallow | /*.pdf$ |
| Disallow | /*.xls$ |
| Disallow | /*.xlsx$ |
| Disallow | /*.doc$ |
| Disallow | /*.docx$ |
| Disallow | /act/ |
| Disallow | /adsfw/ |
| Disallow | /preview_article/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://knowinsiders.com/sitemap.xml |