insiderscreener.com
robots.txt
Robots Exclusion Standard data for insiderscreener.com
Resource Scan
Scan Details
| Site Domain | insiderscreener.com |
| Base Domain | insiderscreener.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2026-01-29T02:31:58+00:00 |
| Next Scan | 2026-03-30T02:31:58+00:00 |
Last Successful Scan
| Scanned | 2025-11-29T04:38:34+00:00 |
| URL | https://insiderscreener.com/robots.txt |
| Redirect | https://www.insiderscreener.com/robots.txt |
| Redirect Domain | www.insiderscreener.com |
| Redirect Base | insiderscreener.com |
| Domain IPs | 104.21.71.182, 172.67.147.249, 2606:4700:3034::6815:47b6, 2606:4700:3034::ac43:93f9 |
| Redirect IPs | 104.21.71.182, 172.67.147.249, 2606:4700:3034::6815:47b6, 2606:4700:3034::ac43:93f9 |
| Response IP | 104.21.71.182 |
| Found | Yes |
| Hash | 1919341ea24e468a6ec1466c0d39534062d6ed604e425f499d66f88ef9f44bab |
| SimHash | e410dc548983 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /en/company/download/prompt* |
| Disallow | /fr/company/download/prompt* |
| Disallow | /de/company/download/prompt* |
| Disallow | /en/analytics/* |
| Disallow | /fr/analytics/* |
| Disallow | /de/analytics/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.insiderscreener.com/sitemap.xml |
Comments